Search Engines, Meta Crawlers
and Directories

           "Search engine" is actually a general term for any internet portal that has World Wide Web search capabilities. Perhaps you use Google to search for information on the 'net. Google is a search engine, but more specifically, Google is a crawler-based search engine. Yahoo and Open Directory are human-powered directories. Some search engines, such as MSN, are a combination of the two.

           Crawler-based search engines collect information about your website much differently than human-powered directories. This doesn't mean one is better than the other, but it does mean that the success of your website in each search engine is based on meeting its specific requirements. Here is a quick look at the different types of search engines.

Crawler-Based Search Engines
           You've probably heard the term "spider" in conjunction with search engines. Crawler-based search engines such as Google, Alta Vista and Inktomi (to name a few) "crawl" or "spider" the web looking for websites. A submission to these is essentially an invitation to visit your website. This is where patience comes in! It may take as long as eight weeks for a crawler to show up on your website's doorstep.

           Your website must be designed to meet the needs of a crawler-based search engine. Optimization of your website is vital as several elements play key roles in the successful spidering of your site including page titles, body text and links. Some crawler-based search engines such as Intomi charge an annual fee to visit your website.

Human-Powered Directories
           Open Directory is one such directory and submission depends on a human to actually submit a website. The submitter must provide website information including a proper title and description. Open Directory's editors may write their own description of your site, or re-write the information submitted. They have total control over your submission.

           When you submit a website to a human-powered directory you must follow the rules and regulations set forth by that specific directory. While following its directives, you must submit the most appropriate information needed by potential internet users. A good site with good content has a greater chance of being reviewed and accepted by a human-powered directory.

Combination Results
           If you search using MSN, you'll find results based on LookSmart listings. Search at AOL and you'll receive results from Google. Search for a subject at LookSmart and you'll receive results first from its own database and secondly from Inktomi submissions. Several search engines have agreements with other engines to use their results as primary or secondary listings. Want to know the results of several search engines at one time? Visit meta search engines Ixquick or Dogpile for top ten results from several search engines.

Meta Search Engines
           Want to know the results of several search engines at one time? Metacrawlers do not maintain their own listings but query other search engines for results. Usually these results are listed on one webpage. Ixquick, Webcrawler and Dogpile are popular metacrawlers. Use a metacrawler to search for something on the internet and you'll receive the top results from Yahoo, Google, MSN, Overture, Teoma and others.


          At any given time there can be thousands of search engines available to web surfers. It is important that your website be listed in the major search engines — Yahoo, MSN, Google, Open Directory, just to name a few. This listing of 50 search engines includes today's most popular directories and crawlers as well as some that may not be familiar to you.

About.com
AH-HA
All the Web
Alta Vista
AOL
Ask Jeeves
Beauco Up!
Cozy Cabin
Cyber411
Dogpile
Excite
Fast Search
Find Info
Galaxy
GigaBlast
Go.com
Google
Hotbot
InfoGrid
InfoSpace
Internet Sleuth
IWon
Ixquick
Kanoodle
Lycos
Mamma
Metacrawler
MSN
National Directory
NBCi
Netscape
Northern Light

Open Directory
Overture
Profusion
Quick Browse Search
Scrub the Web
Search.com
Search Hippo
Search the Web
SplatSearch
Teoma
Vivisimo
Webcrawler
What-U-Seek
Wise Nut
Yahoo!
Yahooligans!
Creative Design Group
Need a Website?
How to Begin!
CDG's Company Profile
CDG Services
Domain Name Search
The Key to Success
View CDG's Client Portfolio
Request a Quote
Ecommerce Options
Site Edit Software
Partner Program
Career Opportunities
Email Creative Design Group