SEO Specialist

Posts Tagged ‘search Engine

Search engine spider is called web crawler. Web crawler is used to index the new web page for their database. There are thousand of search engine on net. For some famous websites like Dmoz, gov sites, etc, search engine sent their spider to cache but in new sites it is not possible.

I have listed some search engine spider names

Spider Name

Search Engine

Googlebot

Google.com

MSNbot

Search.msn.com

Ask Jeeves/Teoma

Ask.com

Architext spider

Excite.com

Fast-WebCrawler

Fast (AllTheWeb.com)

Slurp

Inktomi.com

Yahoo Slurp

Yahoo Web Search

Ia_archiver

Alexa.com

Scooter

Altavista.com

crawler@fast

Fast (AllTheWeb.com)

Crawler

Crawler.de

InfoSeek sidewinder

InfoSeek.com

Lycos_spider_(T-Rex)

Lycos.com


inba Seo Analyst

Archives

May 2017
M T W T F S S
« Mar    
1234567
891011121314
15161718192021
22232425262728
293031  

Blog Stats

  • 14,072 hits

RSS Seo Analyst

free counters