
04.10.2007, 19:14
|
|
Постоянный
Регистрация: 01.02.2006
Сообщений: 970
Провел на форуме: 9254548
Репутация:
1942
|
|
LEGEND:
B
(Client) browser
C
Link-, bookmark-, server- checking
D
Downloading tool
P
Proxy server, web filtering
R
Robot, crawler, spider
S
Spam or bad bot
Код:
!Susie (http://www.sync2it.com/susie) Sync2It bookmark management & clustering engine C R Info
<a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com) UnCHAOS search robot R Info
<a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com) UnCHAOS search robot R Info
<b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com) UnCHAOS search robot R Info
<http://www.sygol.com/> http://www.sygol.com Sygol Search (Italy) robot R Info
( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ) SearchEngineWorld's robots.txt validator C Info
(DreamPassport/3.0; isao/MyDiGiRabi) DreamCast DreamPassport browser B Info
(Privoxy/1.0) Privoxy web proxy P Info
*/Nutch-0.9-dev Unknown Yahoo robot R Info
+SitiDi.net/SitiDiBot/1.0 (+Have Good Day) SitiDi.net search (Germany) robot R Info
-DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de Die Kraehe Meta-Search-Engine (Germany) link checking R Info
123spider-Bot (Version: 1.02, powered by www.123spider.de 123spider.de (Germany) web directory link checking C Info
192.comAgent 192.com - UK web directory R Info
1st ZipCommander (Net) - http://www.zipcommander.com/ 1st ZipCommander Net - IE based browser B Info
2Bone_LinkChecker/1.0 libwww-perl/5.64 2Bone online link checker C Info
4anything.com LinkChecker v2.0 4Anything robot R Info
8484 Boston Project v 1.0 Unknown guestbook spamming or harvesting tool from diff. IPs S Info
:robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html ) neofonie search robot Germany R Info
A-Online Search A-Online.at robot - now Jet2Web Search R Info
A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27 A1 Keyword Research - search engine and keyword optimization software C Info
A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24 MiggiBot website crawler engine - A1 Sitemap Generator R Info
AbachoBOT Abacho / Crawler.de robot R Info
AbachoBOT (Mozilla compatible) Abacho / Crawler.de robot R Info
ABCdatos BotLink/5.xx.xxx#BBL ABCdatos - Castilian program & tutorial directory R Info
Aberja Checkomat Aberja Hybridsuchmaschine (Germany) link checking R Info
abot/0.1 (abot; http://www.abot.com; abot@abot.com) Nameprotect copyright search robot (24.177.134.x) R Info
About/0.1libwww-perl/5.47 About robot R Info
Accelatech RSSCrawler/0.4 Accela Technology RSS feed crawler R Info
accoona Accoona Search robot R Info
Accoona-AI-Agent/1.1.1 (crawler at accoona dot com) Accoona Search robot R Info
Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com) Accoona Search robot R Info
Ace Explorer Ace Explorer - IE based browser B Info
Ack (http://www.ackerm.com/) Ackerm search robot R Info
AcoiRobot Acoi picture finder robot R Info
Acoon Robot v1.50.001 Acoon.de robot R Info
Acoon Robot v1.52 (http://www.acoon.de) Acoon.de robot R Info
Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org) Acorn Search Project R Info
ActiveBookmark 1.x LibMaster.com Active Bookmark HTML page creator C B Info
Activeworlds Activeworlds 3D homepage browser B Info
ActiveWorlds/3.xx (xxx) Activeworlds 3D homepage browser B Info
Ad Muncher v4.xx.x Ad Muncher - banner killer P Info
Ad Muncher v4x Build xxxxx Ad Muncher - banner killer P Info
Adaxas Spider (http://www.adaxas.net/) website directory adaxas link checking C Info
Advanced Browser (http://www.avantbrowser.com) Avant Browser - IE based browser B Info
AESOP_com_SpiderMan Aesop robot R Info
agadine/1.x.x (+http://www.agada.de) Agada search (Germany) robot R Info
Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com) SharewarePlaza link checking R Info
AgentName/0.1 libwww-perl/5.48 Linkomatic submission verifier R Info
AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China) 21seek.com (China) robot (218.17.90.xxx) R Info
AideRSS/1.0 (aiderss.com) AideRss - Postrank RSS and Blog filtering C Info
aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) Nameprotect copyright search robot (24.177.134.x) R Info
aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com) Nameprotect copyright search robot (24.177.134.x) R Info
Aladin/3.324 Aladin robot R Info
Aleksika Spider/1.0 (+http://www.aleksika.com/) Aleksika Danmark - Search engine optimization spider R Info
AlkalineBOT/1.3 Vestris robot R Info
AlkalineBOT/1.4 (1.4.0326.0 RTM) Vestris robot R Info
Allesklar/0.1 libwww-perl/5.46 Allesklar.de robot R Info
Alligator 1.31 (www.nearsoftware.com) Alligator download manager D Info
AltaVista Intranet V2.0 AVS EVAL search@freeit.com Altavista robot R Info
AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net Altavista robot R Info
AltaVista Intranet V2.0 evreka.com crawler@evreka.com Altavista robot R Info
AltaVista V2.0B crawler@evreka.com Altavista robot R Info
AmfibiBOT Amfibi Search robot R Info
Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com) Amfibi Search robot R Info
Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) Amfibi Search robot R Info
amibot amibot - Amidalla search engine robot (62.241.33.xx) R Info
Amiga-AWeb/3.4.167SE AWeb Amiga browser B Info
AmigaVoyager/3.4.4 (MorphOS/PPC native) Voyager - Amiga browser B Info
AmiTCP Miami (AmigaOS 2.04) Amiga Miami TCP Stack Info
amzn_assoc Amazon.com robot for checking their affiliate sites C Info
AnnoMille spider 0.1 alpha - http://www.annomille.it Annomille Italian historical oriented robot R Info
annotate_google; http://ponderer.org/download/annotate_google.user.js annotate Google - Firefox extension for annotating Google search results B Info
Anonymized by ProxyOS: http://www.megaproxy.com Megaproxy user P Info
Anonymizer/1.1 faked user agent Info
AnswerBus (http://www.answerbus.com/) AnswerBus natural language search using COLLATE technology R Info
AnswerChase PROve x.0 AnswerChase search tool Info
AnswerChase x.0 AnswerChase search tool Info
ANTFresco/x.xx ANT Fresco Browser B Info
antibot-V1.1.5/i586-linux-2.2 Antibot (discontinued) robot R Info
AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine) Anzwers (Yahoo) Australia robot R Info
Apexoo Spider 1.x Apexoo Search spider R Info
Aplix HTTP/1.0.1 JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV B Info
Aplix_SANYO_browser/1.x (Japanese) JavaOS app. for Sanyo Internet-TV B Info
Aplix_SEGASATURN_browser/1.x (Japanese) JavaOS app. for SEGA Saturn Internet B Info
Aport Aport robot R Info
appie 1.1 (www.walhello.com) Walhello Internet Search robot R Info
ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;) Araby search - Arabia R Info
Arachnoidea (arachnoidea@euroseek.com) Euroseek spider R Info
aranhabot Amazon.com robot for checking their affiliate sites C Info
ArchitextSpider Excite spider R Info
archive.org_bot Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx) R Info
Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com) Simpy Bookmarklet crawler (69.55.233.xx) C Info
Arikus_Spider Arikus inContext search engine software R Info
Asahina-Antenna/1.x ASAHINA Antenna information detecting agent R Info
Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x) ASAHINA Antenna information detecting agent R Info
ask.24x.info Ask 24x Info robot R Info
AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com) Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch R Info
asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com) askEd! / Inferret search (Japan) robot using Nutch R Info
ASPSeek/1.2.5 ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot R Info
ASPseek/1.2.9d Swsoft.net robot using Aspseek R Info
ASPSeek/1.2.x ASPSeek search engine software R Info
ASPSeek/1.2.xa ASPSeek search engine software R Info
ASPseek/1.2.xx ASPSeek search engine software R Info
ASPSeek/1.2.xxpre ASPSeek search engine software R Info
ASSORT/0.10 Associative Sort robot R Info
asterias/2.0 Singingfish media spider (64.12.186.2xx) via AOL search R Info
AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html) Atlocal local business search robot R Info
Atomz/1.0 Atomz robot R Info
atSpider/1.0 atSpider (ceased) email harvester / spambot S Info
Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com) Attentio social media monitoring and analysing R Info
AU-MIC/2.0 MMP/2.0 Samsung SPH-A660 phone with Sprint software B Info
augurfind Augurnet Swiss (was www.augurnet.ch) search robot R Info
augurnfind V-1.x Augurnet Swiss (was www.augurnet.ch) search robot R Info
autoemailspider Auto Email Pro Email harvester S Info
Код:
autohttp Linkscan tool from Elsop C Info
AV Fetch 1.0 Altavista robot ?? R Info
Avant Browser (http://www.avantbrowser.com) Avant Browser - IE based browser B Info
AVSearch-1.0(peter.turney@nrc.ca) National Research Council Canada robot R Info
AVSearch-2.0-fusionIdx-14-CompetitorWebSites Unknown robot from 205.203.108.xx (telerate.com) Info
AVSearch-3.0(AltaVista/AVC) Altavista robot R Info
AWeb AWeb Amiga browser B Info
axadine/ (Axadine Crawler; http://www.axada.de/; ) Axada search Germany robot R Info
AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine. Axmo search robot R Info
Azureus 2.x.x.x Azureus Java BitTorrent Client D Info
BaboomBot/1.x.x (+http://www.baboom.us) BaBoom Web Portal (ODP) robot (66.98.254.xx) R Info
BackStreet Browser 3.x BackStreet Browser - Offline browser / website downloader D Info
BaiDuSpider Baidu spidering engine - used by diff. IPs R Info
Baiduspider+(+http://www.baidu.com/search/spider.htm) Baidu spidering engine - used by diff. IPs R Info
Baiduspider+(+http://www.baidu.com/search/spider_jp.html) Baidu spidering engine - used by diff. IPs R Info
BanBots/1.2 (spider@banbots.com) Project BanBots Perl script robot C Info
Barca/2.0.xxxx Barca Pro email & PIM software B Info
BarcaPro/1.4.xxxx Barca Pro email & PIM software B Info
BarraHomeCrawler (albertof@barrahome.org) Barrahome (64.246.56.xx) crawler Info
bCentral Billing Post-Process Unknown user agent from Microsoft Info
bdcindexer_2.6.2 (research@bdc) Business.com robot (208.144.233.xxx) Info
BDFetch Brandimensions Brand Protection robot R Info
BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686) Bdncentral Sitesearch robot R Info
BeamMachine/0.5 (dead link remover of www.beammachine.net) beammachine web directory (Germany) link checking R C Info
beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/) Beauty robot for Cosmoty - German beauty and wellness search R Info
BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html ) A Passion for Jazz music related search robot R Info
BeebwareDirectory/v0.01 LinkcheckerBeepware (site is down) web directory link checking C Info
Big Brother (http://pauillac.inria.fr/~fpottier/) Big Brother link checking tool C Info
Big Fish v1.0 GoonGee.com link popularity checking C Info
BigBrother/1.6e BB4 network monitoring Info
BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com) BigClique Search robot R Info
BIGLOTRON (Beta 2;GNU/Linux) Biglotron search (France) robot R Info
Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com) Bigsearch.ca search robot R Info
Bilbo/2.3b-UNIX Bilbo - web frontend for the Nessus Security Scanner Info
BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org) Bilgi.com (Beta) search robot - Turkey R Info
BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com) Bilgi.com (Beta) search robot - Turkey R Info
billbot wjj@cs.cmu.edu Carnegie Mellon School robot/link checking ? Info
Bitacle bot/1.1 Bitacle Blog Search Archive robot R Info
Bitacle Robot (V:1.0;) (http://www.bitacle.com) Bitacle Blog Search Archive robot R Info
Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx) Biyubi Navigator - Mexican browser for Fenix OS B Info
BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0) Blackberry Wireless Internet browser via Google WAP Proxy B P
Info
BlackWidow BlackWidow web site scanner / downloading tool D Info
BlackWidow FS Consulting (was www.fsconsult.net) Black Widow web crawler R Info
Blaiz-Bee/1.0 (+http://www.blaiz.net) Blaiz Enterprises RawGrunt search R Info
Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com) Blaiz Enterprises RawGrunt search R Info
Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net) Blaiz Enterprises RawGrunt search R Info
BlitzBOT@tricus.net Blitzsuche Germany robot R Info
BlitzBOT@tricus.net (Mozilla compatible) Blitzsuche Germany robot R Info
BlockNote.Net BlockNote web page editor B Info
BlogBot/1.x blogdex robot from MIT.edu R Info
BlogBridge 2.13 (http://www.blogbridge.com/) BlogBridge RSS reader B Info
Bloglines Title Fetch/1.0 (http://www.bloglines.com) Bloglines article search R Info
Bloglines-Images/0.1 (http://www.bloglines.com) Bloglines graphics crawler R Info
BlogMap (http://www.feedmap.net) FeedMap / BlogMap geo coding service C Info
Blogpulse (info@blogpulse.com) Intelliseek's BlogPulse blog search R Info
BlogSearch/1.x +http://www.icerocket.com/ IceRocket Web search robot R Info
blogsearchbot-pumpkin-3 Art of Computing blog search project R Info
BlogsNowBot, V 2.01 (+http://www.blogsnow.com/) BlogsNow realtime link tracker robot R Info
blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/) blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx) R Info
BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com) IceRocket Web search robot R Info
BlogzIce/1.0 +http://www.icerocket.com/ IceRocket Web search robot R Info
Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) Balihoo - Search Engine for Advertising Media R Info
bluefish 0.6 HTML editor Bluefish HTML-editor for Linux B Info
BMCLIENT Part of ButtMan remote access tool Info
BMLAUNCHER Bookmark Express bookmark manager C Info
Bobby/4.0.x RPT-HTTPClient/0.3-3E Bobby web accessibility desktop testing tool Info
boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html) Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx R Info
boitho.com-robot/1.x Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx R Info
boitho.com-robot/1.x (http://www.boitho.com/bot.html) Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx R Info
Bookdog/x.x Bookdog - Mac bookmark manager C Info
Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/) Bookmark Buddy - favorite bookmark manager C Info
Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] Favourites managing program C Info
Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta) Favourites managing program C Info
Bot mailto:craftbot@yahoo.com cybercity.fr user robot / faked user agent ? Info
BravoBrian bstop.bravobrian.it BravoBrian bSTOP parental control P R Info
BravoBrian SpiderEngine MarcoPolo Robot for BravoBrian bSTOP R Info
BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) Webarchive Project Bruinbot crawler R Info
BSDSeek/1.0 Inktomi (Hotbot-Lycos NBCi) robot R Info
BStop.BravoBrian.it Agent Detector BravoBrian bSTOP parental control P R Info
BTbot/0.x (+http://www.btbot.com/btbot.html) BitTorrent Search Engine btbot robot R Info
BuildCMS crawler (http://www.buildcms.com/crawler) BuildCMS crawler - market monitoring project of BuildCMS R Info
Bulkfeeds/r1752 (http://bulkfeeds.net/) Bulkfeeds: RSS directory link checking C Info
BullsEye BullsEye/Intelliseek robot R Info
bumblebee@relevare.com Relevare Portal software robot Info
BunnySlippers Microsoft server information robot (see link) C Info
BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com) BurstFind search crawler (64.34.172.xx) R Info
NEXT POST
Последний раз редактировалось T-Rey; 18.07.2008 в 11:59..
Причина: Не нагружайте тег CODE
|
|
|