SEO Specialist

Posts Tagged ‘search Engine

Search engine spider is called web crawler. Web crawler is used to index the new web page for their database. There are thousand of search engine on net. For some famous websites like Dmoz, gov sites, etc, search engine sent their spider to cache but in new sites it is not possible.

I have listed some search engine spider names

Spider Name

Search Engine

Googlebot

Google.com

MSNbot

Search.msn.com

Ask Jeeves/Teoma

Ask.com

Architext spider

Excite.com

Fast-WebCrawler

Fast (AllTheWeb.com)

Slurp

Inktomi.com

Yahoo Slurp

Yahoo Web Search

Ia_archiver

Alexa.com

Scooter

Altavista.com

crawler@fast

Fast (AllTheWeb.com)

Crawler

Crawler.de

InfoSeek sidewinder

InfoSeek.com

Lycos_spider_(T-Rex)

Lycos.com

Advertisements

inba Seo Analyst

Archives

December 2017
M T W T F S S
« Mar    
 123
45678910
11121314151617
18192021222324
25262728293031

Blog Stats

  • 14,257 hits

RSS Seo Analyst

free counters