Показать сообщение отдельно

  #4  
Старый 04.10.2007, 19:14
BlackCats
Постоянный
Регистрация: 01.02.2006
Сообщений: 970
Провел на форуме:
9254548

Репутация: 1942


По умолчанию

LEGEND:

B
(Client) browser
C
Link-, bookmark-, server- checking
D
Downloading tool
P
Proxy server, web filtering
R
Robot, crawler, spider
S
Spam or bad bot




Код:
 !Susie (http://www.sync2it.com/susie)   	 Sync2It bookmark management & clustering engine   	C R   	Info
<a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com)  	UnCHAOS search robot  	R  	Info
<a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com)  	UnCHAOS search robot  	R  	Info
<b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com)  	UnCHAOS search robot  	R  	Info
<http://www.sygol.com/> http://www.sygol.com  	Sygol Search (Italy) robot  	R  	Info
( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi )  	SearchEngineWorld's robots.txt validator  	C  	Info
(DreamPassport/3.0; isao/MyDiGiRabi)  	DreamCast DreamPassport browser  	B  	Info
(Privoxy/1.0)  	Privoxy web proxy  	P  	Info
*/Nutch-0.9-dev  	Unknown Yahoo robot  	R  	Info
+SitiDi.net/SitiDiBot/1.0 (+Have Good Day)  	SitiDi.net search (Germany) robot  	R  	Info
-DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de  	Die Kraehe Meta-Search-Engine (Germany) link checking  	R  	Info
123spider-Bot (Version: 1.02, powered by www.123spider.de  	123spider.de (Germany) web directory link checking  	C  	Info
192.comAgent  	192.com - UK web directory  	R  	Info
1st ZipCommander (Net) - http://www.zipcommander.com/  	1st ZipCommander Net - IE based browser  	B  	Info
2Bone_LinkChecker/1.0 libwww-perl/5.64  	2Bone online link checker  	C  	Info
4anything.com LinkChecker v2.0  	4Anything robot  	R  	Info
8484 Boston Project v 1.0  	Unknown guestbook spamming or harvesting tool from diff. IPs  	S  	Info
:robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html )  	neofonie search robot Germany  	R  	Info
A-Online Search  	A-Online.at robot - now Jet2Web Search  	R  	Info
A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27  	A1 Keyword Research - search engine and keyword optimization software  	C  	Info
A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24  	MiggiBot website crawler engine - A1 Sitemap Generator  	R  	Info
AbachoBOT  	Abacho / Crawler.de robot  	R  	Info
AbachoBOT (Mozilla compatible)  	Abacho / Crawler.de robot  	R  	Info
ABCdatos BotLink/5.xx.xxx#BBL  	ABCdatos - Castilian program & tutorial directory  	R  	Info
Aberja Checkomat  	Aberja Hybridsuchmaschine (Germany) link checking  	R  	Info
abot/0.1 (abot; http://www.abot.com; abot@abot.com)  	Nameprotect copyright search robot (24.177.134.x)  	R  	Info
About/0.1libwww-perl/5.47  	About robot  	R  	Info
Accelatech RSSCrawler/0.4  	Accela Technology RSS feed crawler  	R  	Info
accoona  	Accoona Search robot  	R  	Info
Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)  	Accoona Search robot  	R  	Info
Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)  	Accoona Search robot  	R  	Info
Ace Explorer  	Ace Explorer - IE based browser  	B  	Info
Ack (http://www.ackerm.com/)  	Ackerm search robot  	R  	Info
AcoiRobot  	Acoi picture finder robot  	R  	Info
Acoon Robot v1.50.001  	Acoon.de robot  	R  	Info
Acoon Robot v1.52 (http://www.acoon.de)  	Acoon.de robot  	R  	Info
Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org)  	Acorn Search Project  	R  	Info
ActiveBookmark 1.x  	LibMaster.com Active Bookmark HTML page creator  	C B  	Info
Activeworlds  	Activeworlds 3D homepage browser  	B  	Info
ActiveWorlds/3.xx (xxx)  	Activeworlds 3D homepage browser  	B  	Info
Ad Muncher v4.xx.x  	Ad Muncher - banner killer  	P  	Info
Ad Muncher v4x Build xxxxx  	Ad Muncher - banner killer  	P  	Info
Adaxas Spider (http://www.adaxas.net/)  	website directory adaxas link checking  	C  	Info
Advanced Browser (http://www.avantbrowser.com)  	Avant Browser - IE based browser  	B  	Info
AESOP_com_SpiderMan  	Aesop robot  	R  	Info
agadine/1.x.x (+http://www.agada.de)  	Agada search (Germany) robot  	R  	Info
Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com)  	SharewarePlaza link checking  	R  	Info
AgentName/0.1 libwww-perl/5.48  	Linkomatic submission verifier  	R  	Info
AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China)  	21seek.com (China) robot (218.17.90.xxx)  	R  	Info
AideRSS/1.0 (aiderss.com)  	AideRss - Postrank RSS and Blog filtering  	C  	Info
aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)  	Nameprotect copyright search robot (24.177.134.x)  	R  	Info
aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com)  	Nameprotect copyright search robot (24.177.134.x)  	R  	Info
Aladin/3.324  	Aladin robot  	R  	Info
Aleksika Spider/1.0 (+http://www.aleksika.com/)  	Aleksika Danmark - Search engine optimization spider  	R  	Info
AlkalineBOT/1.3  	Vestris robot  	R  	Info
AlkalineBOT/1.4 (1.4.0326.0 RTM)  	Vestris robot  	R  	Info
Allesklar/0.1 libwww-perl/5.46  	Allesklar.de robot  	R  	Info
Alligator 1.31 (www.nearsoftware.com)  	Alligator download manager  	D  	Info
AltaVista Intranet V2.0 AVS EVAL search@freeit.com  	Altavista robot  	R  	Info
AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net  	Altavista robot  	R  	Info
AltaVista Intranet V2.0 evreka.com crawler@evreka.com  	Altavista robot  	R  	Info
AltaVista V2.0B crawler@evreka.com  	Altavista robot  	R  	Info
AmfibiBOT  	Amfibi Search robot  	R  	Info
Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com)  	Amfibi Search robot  	R  	Info
Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)  	Amfibi Search robot  	R  	Info
amibot  	amibot - Amidalla search engine robot (62.241.33.xx)  	R  	Info
Amiga-AWeb/3.4.167SE  	AWeb Amiga browser  	B  	Info
AmigaVoyager/3.4.4 (MorphOS/PPC native)  	Voyager - Amiga browser  	B  	Info
AmiTCP Miami (AmigaOS 2.04)  	Amiga Miami TCP Stack  	  	Info
amzn_assoc  	Amazon.com robot for checking their affiliate sites  	C  	Info
AnnoMille spider 0.1 alpha - http://www.annomille.it  	Annomille Italian historical oriented robot  	R  	Info
annotate_google; http://ponderer.org/download/annotate_google.user.js  	annotate Google - Firefox extension for annotating Google search results  	B  	Info
Anonymized by ProxyOS: http://www.megaproxy.com  	Megaproxy user  	P  	Info
Anonymizer/1.1  	faked user agent   	  	Info
AnswerBus (http://www.answerbus.com/)  	AnswerBus natural language search using COLLATE technology  	R  	Info
AnswerChase PROve x.0  	AnswerChase search tool  	  	Info
AnswerChase x.0  	AnswerChase search tool  	  	Info
ANTFresco/x.xx  	ANT Fresco Browser  	B  	Info
antibot-V1.1.5/i586-linux-2.2  	Antibot (discontinued) robot  	R  	Info
AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine)  	Anzwers (Yahoo) Australia robot  	R  	Info
Apexoo Spider 1.x  	Apexoo Search spider  	R  	Info
Aplix HTTP/1.0.1  	JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV  	B   	Info
Aplix_SANYO_browser/1.x (Japanese)  	JavaOS app. for Sanyo Internet-TV  	B   	Info
Aplix_SEGASATURN_browser/1.x (Japanese)  	JavaOS app. for SEGA Saturn Internet  	B   	Info
Aport  	Aport robot  	R  	Info
appie 1.1 (www.walhello.com)  	Walhello Internet Search robot  	R  	Info
ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;)  	Araby search - Arabia  	R  	Info
Arachnoidea (arachnoidea@euroseek.com)  	Euroseek spider  	R  	Info
aranhabot  	Amazon.com robot for checking their affiliate sites  	C  	Info
ArchitextSpider  	Excite spider  	R  	Info
archive.org_bot  	Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx)  	R  	Info
Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com)  	Simpy Bookmarklet crawler (69.55.233.xx)  	C  	Info
Arikus_Spider  	Arikus inContext search engine software  	R  	Info
Asahina-Antenna/1.x  	ASAHINA Antenna information detecting agent  	R  	Info
Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x)  	ASAHINA Antenna information detecting agent  	R  	Info
ask.24x.info  	Ask 24x Info robot  	R  	Info
AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com)  	Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch  	R  	Info
asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com)  	askEd! / Inferret search (Japan) robot using Nutch  	R  	Info
ASPSeek/1.2.5  	ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot   	R  	Info
ASPseek/1.2.9d  	Swsoft.net robot using Aspseek  	R  	Info
ASPSeek/1.2.x  	ASPSeek search engine software  	R  	Info
ASPSeek/1.2.xa  	ASPSeek search engine software  	R  	Info
ASPseek/1.2.xx  	ASPSeek search engine software  	R  	Info
ASPSeek/1.2.xxpre  	ASPSeek search engine software  	R  	Info
ASSORT/0.10  	Associative Sort robot  	R  	Info
asterias/2.0  	Singingfish media spider (64.12.186.2xx) via AOL search  	R  	Info
AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)  	Atlocal local business search robot  	R  	Info
Atomz/1.0  	Atomz robot  	R  	Info
atSpider/1.0  	atSpider (ceased) email harvester / spambot  	S   	Info
Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com)  	Attentio social media monitoring and analysing   	R  	Info
AU-MIC/2.0 MMP/2.0  	Samsung SPH-A660 phone with Sprint software  	B  	Info
augurfind  	Augurnet Swiss (was www.augurnet.ch) search robot  	R   	Info
augurnfind V-1.x  	Augurnet Swiss (was www.augurnet.ch) search robot  	R   	Info
autoemailspider  	Auto Email Pro Email harvester  	S  	Info
Код:
autohttp  	Linkscan tool from Elsop  	C  	Info
AV Fetch 1.0  	Altavista robot ??  	R   	Info
Avant Browser (http://www.avantbrowser.com)  	Avant Browser - IE based browser  	B  	Info
AVSearch-1.0(peter.turney@nrc.ca)  	National Research Council Canada robot  	R  	Info
AVSearch-2.0-fusionIdx-14-CompetitorWebSites  	Unknown robot from 205.203.108.xx (telerate.com)   	  	Info
AVSearch-3.0(AltaVista/AVC)  	Altavista robot  	R  	Info
AWeb  	AWeb Amiga browser  	B  	Info
axadine/ (Axadine Crawler; http://www.axada.de/; )  	Axada search Germany robot  	R  	Info
AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine.  	Axmo search robot  	R  	Info
Azureus 2.x.x.x  	Azureus Java BitTorrent Client  	D  	Info
BaboomBot/1.x.x (+http://www.baboom.us)  	BaBoom Web Portal (ODP) robot (66.98.254.xx)  	R  	Info
BackStreet Browser 3.x  	BackStreet Browser - Offline browser / website downloader  	D  	Info
BaiDuSpider  	Baidu spidering engine - used by diff. IPs  	R  	Info
Baiduspider+(+http://www.baidu.com/search/spider.htm)  	Baidu spidering engine - used by diff. IPs  	R  	Info
Baiduspider+(+http://www.baidu.com/search/spider_jp.html)  	Baidu spidering engine - used by diff. IPs  	R  	Info
BanBots/1.2 (spider@banbots.com)  	Project BanBots Perl script robot  	C  	Info
Barca/2.0.xxxx  	Barca Pro email & PIM software  	B  	Info
BarcaPro/1.4.xxxx  	Barca Pro email & PIM software  	B  	Info
BarraHomeCrawler (albertof@barrahome.org)  	Barrahome (64.246.56.xx) crawler  	  	Info
bCentral Billing Post-Process  	Unknown user agent from Microsoft  	  	Info
bdcindexer_2.6.2 (research@bdc)  	Business.com robot (208.144.233.xxx)  	  	Info
BDFetch  	Brandimensions Brand Protection robot  	R  	Info
BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)  	Bdncentral Sitesearch robot  	R  	Info
BeamMachine/0.5 (dead link remover of www.beammachine.net)  	beammachine web directory (Germany) link checking  	R C  	Info
beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/)  	Beauty robot for Cosmoty - German beauty and wellness search  	R  	Info
BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html )  	A Passion for Jazz music related search robot  	R  	Info
BeebwareDirectory/v0.01  	LinkcheckerBeepware (site is down) web directory link checking  	C  	Info
Big Brother (http://pauillac.inria.fr/~fpottier/)  	Big Brother link checking tool  	C  	Info
Big Fish v1.0  	GoonGee.com link popularity checking  	C  	Info
BigBrother/1.6e  	BB4 network monitoring  	  	Info
BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com)  	BigClique Search robot  	R  	Info
BIGLOTRON (Beta 2;GNU/Linux)  	Biglotron search (France) robot  	R  	Info
Bigsearch.ca/Nutch-0.9-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)  	Bigsearch.ca search robot  	R  	Info
Bilbo/2.3b-UNIX  	Bilbo - web frontend for the Nessus Security Scanner  	  	Info
BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)  	Bilgi.com (Beta) search robot - Turkey  	R  	Info
BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com)  	Bilgi.com (Beta) search robot - Turkey  	R  	Info
billbot wjj@cs.cmu.edu  	Carnegie Mellon School robot/link checking ?  	  	Info
Bitacle bot/1.1  	Bitacle Blog Search Archive robot  	R  	Info
Bitacle Robot (V:1.0;) (http://www.bitacle.com)  	Bitacle Blog Search Archive robot  	R  	Info
Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx)  	Biyubi Navigator - Mexican browser for Fenix OS  	B  	Info
BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0)  	Blackberry Wireless Internet browser via Google WAP Proxy  	B P
Info
BlackWidow  	BlackWidow web site scanner / downloading tool  	D  	Info
BlackWidow  	FS Consulting (was www.fsconsult.net) Black Widow web crawler  	R   	Info
Blaiz-Bee/1.0 (+http://www.blaiz.net)  	Blaiz Enterprises RawGrunt search  	R  	Info
Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com)  	Blaiz Enterprises RawGrunt search  	R  	Info
Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net)  	Blaiz Enterprises RawGrunt search  	R  	Info
BlitzBOT@tricus.net  	Blitzsuche Germany robot  	R  	Info
BlitzBOT@tricus.net (Mozilla compatible)  	Blitzsuche Germany robot  	R  	Info
BlockNote.Net  	BlockNote web page editor  	B  	Info
BlogBot/1.x  	blogdex robot from MIT.edu  	R  	Info
BlogBridge 2.13 (http://www.blogbridge.com/)  	BlogBridge RSS reader  	B  	Info
Bloglines Title Fetch/1.0 (http://www.bloglines.com)  	Bloglines article search  	R  	Info
Bloglines-Images/0.1 (http://www.bloglines.com)  	Bloglines graphics crawler  	R  	Info
BlogMap (http://www.feedmap.net)  	FeedMap / BlogMap geo coding service  	C  	Info
Blogpulse (info@blogpulse.com)  	Intelliseek's BlogPulse blog search  	R  	Info
BlogSearch/1.x +http://www.icerocket.com/  	IceRocket Web search robot  	R  	Info
blogsearchbot-pumpkin-3  	Art of Computing blog search project  	R  	Info
BlogsNowBot, V 2.01 (+http://www.blogsnow.com/)  	BlogsNow realtime link tracker robot  	R  	Info
blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/)  	blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx)  	R  	Info
BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com)  	IceRocket Web search robot  	R  	Info
BlogzIce/1.0 +http://www.icerocket.com/  	IceRocket Web search robot  	R  	Info
Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com)  	Balihoo - Search Engine for Advertising Media  	R  	Info
bluefish 0.6 HTML editor  	Bluefish HTML-editor for Linux  	B  	Info
BMCLIENT  	Part of ButtMan remote access tool  	  	Info
BMLAUNCHER  	Bookmark Express bookmark manager  	C  	Info
Bobby/4.0.x RPT-HTTPClient/0.3-3E  	Bobby web accessibility desktop testing tool  	  	Info
boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html)  	Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx  	R  	Info
boitho.com-robot/1.x  	Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx  	R  	Info
boitho.com-robot/1.x (http://www.boitho.com/bot.html)  	Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx  	R  	Info
Bookdog/x.x  	Bookdog - Mac bookmark manager  	C  	Info
Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/)  	Bookmark Buddy - favorite bookmark manager   	C  	Info
Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/]  	Favourites managing program  	C  	Info

Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta)  	Favourites managing program  	C  	Info
Bot mailto:craftbot@yahoo.com  	cybercity.fr user robot / faked user agent ?   	  	Info
BravoBrian bstop.bravobrian.it  	BravoBrian bSTOP parental control  	P R  	Info
BravoBrian SpiderEngine MarcoPolo  	Robot for BravoBrian bSTOP  	R  	Info
BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html)   	Webarchive Project Bruinbot crawler  	R  	Info
BSDSeek/1.0  	Inktomi (Hotbot-Lycos NBCi) robot  	R  	Info
BStop.BravoBrian.it Agent Detector  	BravoBrian bSTOP parental control  	P R  	Info
BTbot/0.x (+http://www.btbot.com/btbot.html)  	BitTorrent Search Engine btbot robot  	R  	Info
BuildCMS crawler (http://www.buildcms.com/crawler)  	BuildCMS crawler - market monitoring project of BuildCMS  	R  	Info
Bulkfeeds/r1752 (http://bulkfeeds.net/)  	Bulkfeeds: RSS directory link checking  	C  	Info
BullsEye  	BullsEye/Intelliseek robot  	R  	Info
bumblebee@relevare.com  	Relevare Portal software robot  	  	Info
BunnySlippers  	Microsoft server information robot (see link)  	C  	Info
BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com)  	BurstFind search crawler (64.34.172.xx)  	R  	Info
NEXT POST

Последний раз редактировалось T-Rey; 18.07.2008 в 11:59.. Причина: Не нагружайте тег CODE
 
Ответить с цитированием