Hosting
Domain Names
Search
Bookmark!
Home | Resources | Contact | FAQ | Templates | Generators | Affiliates | Shareware | Scripts | Articles
XML RSS Feeds

Site Design for Better Search Engine Positioning - Part II
by Sanders Consultation Group Plus

The Relationship Between the Search Engines, and Ways to Get Listed When all Your Past Attempts Have Failed.

So you've built your site, optimized it for search engine submission, and uploaded it to your server. You've also set up some strategic link swaps with some prominent sites, and submitted it to the search engines, but it isn't showing up, or there is no record your site has even been indexed by Google or Yahoo. Now what do you do? That's what we are going to discuss in this article.

Indexing, Spidering, Inclusion, and Paid Inclusion - Terminology and Differences in the Search Engine Optimization Game

Before I get into the relationships between the search engines, I want to talk about spidering and inclusion. You need to understand these. Understanding them will help you to understand the possible reasons why your site may not be showing up in search engine results. An important thing to keep in mind. Although your site might not be showing up in results, that doesn't mean that it ins't already spidered by a particular search engine. There is a difference between spidering and inclusion. There is also a difference between inclusion, not guaranteed, and paid inclusion, which is a guaranteed way to make sure your site shows up on search engine results. Not all search engines follow the steps I am about to go over. Some may jumble tasks together with the same spider or bot when they visit your pages. What follows is the long hand journey a page takes to find it's way into search engine results.

Each search engine has their own little spider or bot that spends all its time crawling around the web. Their soul intentions are to find pages, and then read the URL links on those pages. The spider or bot uses those URLs to find other pages on the net. In turn it visits the pages in these paths and collects certain information from them. In theory, manual submission is not required for your site in order for it to be spidered. Eventually, most pages are found and submitted to the next spider or bot. The first spider or bot's job is to find pages. It then drops those pages off to another bot or spider to index them. At this time your page is said to have been spidered. Once the first bot spiders your page, the next bot comes and gathers information off your page.

The bot will look at the words on the page. Most bots only read html code, and tend to ignore images, flash, and the other more flashy technology available on the web. This is where keyword placement comes into play. The bot looks at the text on your page and gathers what it feels is relevant to the page it is visiting. It reviews the text and assigns the page keywords. It will then drop off this information into a type of database, or a filter, where other programs can be run on the information to extract information about the pages it collect. At this time your page is said to have been indexed. Note that I have not said anything about search engine results yet. Once your page reaches this point, it may still not be included on search results. Also note, that until your page reaches this point, there is no chance for it to end up on search engine results either.

Once they collect this data, the search engines run programs on the data and apply filters and algorithms to select pages they want to include in their search results. Remember that the lifeblood of a search engine is providing pages to their visitors that apply to the information their visitors are looking for. If your pages are deemed link farms, then the chances of them being included in their results will be slim. I will talk more of potential problems that keep pages from being included later. Once they run these programs, the search engine will then include the page in their database. At this time, your page is now considered included in their database and will show up in search results relevant to the keywords on your page. Again, it is important to remember that most search engines do not guarantee inclusion. They are becoming very selective on what they include and don't include in their database. When dealing with a search engine that uses a human in any of the process, you are looking at it being more difficult to be included.

Search engines are becoming increasingly selective about what pages they include. There is good reasoning for this. Take for instance the search results you have gotten when searching on a topic. I'll bet at least one or two of the high ranking links you went to had nothing to do with what you were searching for. Am I correct about that? As time has gone by, unscrupulous webmasters and SEO's have caused this problem. They have found ways to manipulate the search engine results, and add words to pages simply because the words are searched for frequently. If the words applied to the topic on their pages then that would be fine. The problem is that most times, the words have nothing to do with their page topic. Search engines are trying to get away from this kind of manipulation. That is evident in the latest buzz about Google and their Florida update.

There is only one way to guarantee your pages to be included in search engine results. That guarantee is through paid inclusion. Most of the search engines have gone to this. I think it's just a way for them to capitalize on our need for them, and increase the revenue they already generate. Most of them put these results at the top of the search results page. The honorable search engines separate them and let you know that they are sponsored results. In short, to get paid inclusion on search results, you pay a fee to the search engine. It's almost like buying advertisement, but it is highly targeted advertisement. It differs from banners in the fact that banners are usually random and can show up on any page. Paid inclusion only shows up when a visitor searches for words relevant to the keywords you choose when you buy the inclusion. Since I do not pay for this type of inclusion, I am unsure if you can buy placement for keywords your page topic does not apply to. Now we'll move onto the relationships between the different search engines.

Back to Table of Contents        Knowing if Your Page has been Indexed  (Article Continues)


About the Author

James R. Sanders is the owner of Sanders Consultation Group Plus. He has been a webmaster and website designer since 1997. He has also been involved in self employment ventures since 1992. He is presently a contributing author of NewbieHangout. His writing is targeted to webmasters, would be webmasters, website designers, would be website designers, self employed, or those researching information looking for solutions to questions associated with design, business operations, and promotion today. His goal is to provide practical information based upon his years of experience to help webmasters, website designers, and self employed people achieve their goals in today's competitive global market. You can subscribe to his free newsletters at SCGP - Newsletter.

Previous Page


NewbieHangout Graphics Logo

Copyright © 2001-2004 NewbieHangout.com. All Rights Reserved.    Privacy Policy