SEO Specialist

Posts Tagged ‘search Engine

Search engine spider is called web crawler. Web crawler is used to index the new web page for their database. There are thousand of search engine on net. For some famous websites like Dmoz, gov sites, etc, search engine sent their spider to cache but in new sites it is not possible.

I have listed some search engine spider names

Spider Name

Search Engine

Googlebot

Google.com

MSNbot

Search.msn.com

Ask Jeeves/Teoma

Ask.com

Architext spider

Excite.com

Fast-WebCrawler

Fast (AllTheWeb.com)

Slurp

Inktomi.com

Yahoo Slurp

Yahoo Web Search

Ia_archiver

Alexa.com

Scooter

Altavista.com

crawler@fast

Fast (AllTheWeb.com)

Crawler

Crawler.de

InfoSeek sidewinder

InfoSeek.com

Lycos_spider_(T-Rex)

Lycos.com


inba Seo Analyst

Archives

June 2017
M T W T F S S
« Mar    
 1234
567891011
12131415161718
19202122232425
2627282930  

Blog Stats

  • 14,141 hits

RSS Seo Analyst

free counters