SEO Specialist

Posts Tagged ‘search Engine

Search engine spider is called web crawler. Web crawler is used to index the new web page for their database. There are thousand of search engine on net. For some famous websites like Dmoz, gov sites, etc, search engine sent their spider to cache but in new sites it is not possible.

I have listed some search engine spider names

Spider Name

Search Engine

Googlebot

Google.com

MSNbot

Search.msn.com

Ask Jeeves/Teoma

Ask.com

Architext spider

Excite.com

Fast-WebCrawler

Fast (AllTheWeb.com)

Slurp

Inktomi.com

Yahoo Slurp

Yahoo Web Search

Ia_archiver

Alexa.com

Scooter

Altavista.com

crawler@fast

Fast (AllTheWeb.com)

Crawler

Crawler.de

InfoSeek sidewinder

InfoSeek.com

Lycos_spider_(T-Rex)

Lycos.com


inba Seo Analyst

Archives

August 2017
M T W T F S S
« Mar    
 123456
78910111213
14151617181920
21222324252627
28293031  

Blog Stats

  • 14,187 hits

RSS Seo Analyst

free counters