User agent - pretrazivaca?

[ Gojko Vujovic @ 16.11.2003. 18:41 ] @

Prva kolona su stringovi za webalizer komandu groupagent, druga kolona je kratko objašnjenje o kom spideru je reč. Našao sam to još ranije negde na netu, ne znam tačno izvor. :)

348NorthNews 348north.com
almaden.ibm.com/cs/crawler almaden.ibm.com
antibot Antidot.net http://www.antidot.net/Welcome/jsp/robots.html
Ask.24x.Info MnogoSearch.org
ASPseek ASPseek.org free search engine software
aspseek ASPseek.org free search engine software
augurfind augurnet.ch (Swiss Search Engine)
Baiduspider Baidu.com
BarraHomeCrawler Barrahome.org
BBot http://www.otthon.net/search/
Bilbo wise-guys.nl
blo.gs blo.gs
BlogBot Blogdex.net
Blogosphere Blogosphere.us
BlogPulse Blogpulse.com
BlogShares BlogShares.com
Blogwise.com Blogwise.com
boitho.com boitho.com
[email protected] OnFocus.com Weblog BookWatch
brainoff.com/geoblog/ The World as a Blog (brainoff.com/geoblog/)
business-socket.com www.business-socket.com
CJNetworkQuality CommissionJunction.com
combine http://www.lub.lu.se/combine/
COMBINE http://www.lub.lu.se/combine/
CoolBot www.suchmaschine21.de (German Search Engine)
CoologFeedSpider CoolLog http://www.webfanatic.lunarpages.com/coolog/
CopyHunter AWstats referrer log analyzer
daypopbot DayPop.com
Ecosystem/development Blogging Ecosystem
EgotoBot Egoto.com
ETS Freetranslation.com
exactseek.com exactseek.com
Exalead Exalead.com (AOL France)
FAST All The Web
Fast All The Web
Feedster Feedster.com
FlickBot DivX Networks FlickBot
Gaisbot GAIS (http://gais.cs.ccu.edu.tw/ )
GalaxyBot Galaxy.com
Genome Waypath.com
Gigabot Gigablast.com
Google* Google.com
gossamer-threads.com Links SQL
grub-client Grub.org
htdig htdig (Open Source Search Engine)
ia_archiver Archive.org
INGRID/3.0 ilse.nl (Dutch search engine)
InternetSeer InternetSeer.com (Web Site Monitoring)
internetseer InternetSeer.com (Web Site Monitoring)
IXE ideare.com
janes-blogosphere BlogMatrix.com
jiffe jiffe.com
k2spider Verity Spider
larbin larbin (http://sourceforge.net/projects/larbin/)
Leknor.com Leknor.com GZIP Tester
Linkbot Linkbot link monitoring tool (Watchfire.com)
LinkHype LinkHype.com
LinksManager.com LinksManager.com
LinkWalker seventwentyfour.com
LNSpiderguy Lexis-Nexis
MnogoSearch MnogoSearch.org
mogimogi www.goo.ne.jp (Japanese Search Engine)
MSNBOT MSN.com
MyWireServiceBot MyWireService.com
NaverRobot Naver.com (Korean Search Engine)
Netcraft Netcraft Web Survey
NetResearchServer Look.com
NIF Newsisfree.com
NG/1.0 Exalead.com (AOL France)
NITLE Blogcensus.net
NPBot NameProtect.com
NRK-bruker NRK.no
Openbot OpenFind (http://www.openfind.com.tw/)
Pompos Dir.com
Popdexter Popdex.com
psbot Picsearch.com
QuepasaCreep Quepasa.com (Spanish site)
Robozilla Link Checker for Dmoz.org
Scooter Altavista
searchspider.com searchspider.com
semanticdiscovery semanticdiscovery.com
SideWinder Infoseek
[email protected] Inktomi
[email protected] http://www.ilab.sztaki.hu/websearch/
Spinne webauskunft.at
Steeler Kitsuregawa Laboratory, The University of Tokyo
SurveyBot whois.sc
Syndic8 Syndic8
Tagword Tagword - http://tagword.com/dmoz_survey.php
Teoma Teoma
Teradex Teradex.com (directory)
Terrar Terrar (http://www.terrar.com)
Technoratibot Technorati
T-H-U-N-D-E-R-S-T-O-N-E Webinator (http://www.thunderstone.com/texis/site/pages/webinator.html)
timboBot BreakingBlogs.com
TurnitinBot Turnitin.com
tutorgig.com tutorgig.com
Vagabondo kobala.nl
verzamelgids verzamelgids.nl
VoilaBot Voila.com
W3C_Validator W3C Validator
walhello.com Walhello.com
WebCapture WebCapture.biz
Webclipping Webclipping.com
WebFilter http://www.ils.unc.edu/webfilter/
WebGather City Polytechnic of Hong Kong
WebRACE WebRACE (University of Cyprus, Distributed Crawler)
websitealert.net websitealert.net (Monitoring System)
Zealbot Looksmart.com
ZyBorg WiseNut.com