Friday, August 29, 2008

A crawler is a program of search engines which visit on the web pages automatically to read, store and index them; whatever on the web pages. Its anot

A crawler is a program of search engines which visit on the web pages automatically to read, store and index them; whatever on the web pages. Its another name are web spider, web robot, ants, bots, worms etc. but here I am talking about the name of major search engines spider. Below is the list -

Search Engines -- Spiders or Crawler Name

Google -- Googlebot

Yahoo -- Yahoo Slurp

MSN -- MSNbot

Ask -- Teoma

Excite -- Architext spider

Inktomi.com -- Slurp

Alexa -- ia_archiver

Altavista -- Scooter

Lycus -- Lycos_Spider_(T-Rex)

Cuil -- Twiceler (New Search Engine)

Looksmart -- MantraAgent

These are the name of major search engines crawler.

0 comments: