SEO Specialist

Search engine spider

Posted on: January 24, 2009

Search engine spider is called web crawler. Web crawler is used to index the new web page for their database. There are thousand of search engine on net. For some famous websites like Dmoz, gov sites, etc, search engine sent their spider to cache but in new sites it is not possible.

I have listed some search engine spider names

Spider Name

Search Engine

Googlebot

Google.com

MSNbot

Search.msn.com

Ask Jeeves/Teoma

Ask.com

Architext spider

Excite.com

Fast-WebCrawler

Fast (AllTheWeb.com)

Slurp

Inktomi.com

Yahoo Slurp

Yahoo Web Search

Ia_archiver

Alexa.com

Scooter

Altavista.com

crawler@fast

Fast (AllTheWeb.com)

Crawler

Crawler.de

InfoSeek sidewinder

InfoSeek.com

Lycos_spider_(T-Rex)

Lycos.com

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

inba Seo Analyst

Archives

January 2009
M T W T F S S
« Dec   Feb »
 1234
567891011
12131415161718
19202122232425
262728293031  

Blog Stats

  • 14,158 hits

RSS Seo Analyst

free counters
%d bloggers like this: