Crawler bots statistics [usings.ru]

Filter  •  Admin panel >>

Pages: 1 2 3 4 5 6 7 8 9 10  All
#BotBot's User-AgentIPDateTimeURI
1CommonCrawl

CCBot/2.0 (https://commoncrawl.org/faq/)

3.214.184.2232020-07-0417:56:23 ... 
2Unknown

Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://aspiegel.com/petalbot)

114.119.162.2362020-07-0417:49:13 ... 
3Unknown

Mozilla/5.0 (compatible; SeznamBot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)

77.75.77.722020-07-0417:42:46 ... 
4Bing

Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

207.46.13.462020-07-0417:27:16 ... 
5Google

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.92 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

66.249.68.152020-07-0417:25:39 / 
6Google

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

66.249.68.82020-07-0416:55:57 ... 
7Majestic-12

Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)

148.251.9.1452020-07-0414:19:41 ... 
8Unknown

Mozilla/5.0 (compatible; Nimbostratus-Bot/v1.3.2; http://cloudsystemnetworks.com)

209.17.96.1142020-07-0413:53:57 / 
9Yandex

Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12B411 Safari/600.1.4 (compatible; YandexMobileBot/3.0; +http://yandex.com/bots)

178.154.200.662020-07-0413:39:15 ... 
10Yandex

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

77.88.5.1912020-07-0413:11:44 ... 
11Unknown

Mozilla/5.0 (compatible; LetsearchBot/1.0; +https://letsearch.ru/bots)

85.21.99.2022020-07-0412:47:55 / 
12DotBot

Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, [email protected])

216.244.66.2262020-07-0411:12:03 ... 
13Unknown

python-requests/2.24.0

116.203.152.2002020-07-0410:38:32 / 
14Mail.RU

Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)

95.163.255.1642020-07-0410:01:21 / 
15oBot

Mozilla/5.0 (compatible; oBot/2.3.1; http://www.xforce-security.com/crawler/)

194.153.113.1012020-07-0403:17:16 / 
16Unknown

Mozilla/5.0 (compatible; WebDataStats/1.0 ; +https://webdatastats.com/policy.html)

185.86.93.512020-07-0403:03:19 / 
17Unknown

python-requests/2.22.0

81.19.83.1312020-07-0400:41:08 / 
18Unknown

python-requests/2.18.4

81.19.89.1362020-07-0400:10:04 / 
19Unknown

Python/3.7 aiohttp/3.4.4

176.99.15.192020-07-0320:00:14 / 
20Unknown

Mozilla/5.0 (compatible; StatOnlineRuBot/1.0)

194.58.113.2242020-07-0317:47:09 / 
21Unknown

python-requests/2.23.0

52.246.163.1732020-07-0313:04:55 / 
22Unknown

Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

40.88.21.2352020-07-0308:45:10 / 
23Unknown

Mozilla/5.0 (compatible; BackupLand/1.0; https://go.backupland.com/; Domain check for viruses;)

185.12.124.782020-07-0303:56:02 / 
24Google [favicon]

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36 Google Favicon

66.102.9.1842020-07-0222:35:18 ... 
25NetCraft

Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; [email protected])

167.71.185.52020-07-0218:29:27 / 
26Yandex

Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

37.9.118.292020-07-0216:54:55 / 
27Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)

17.58.101.1602020-07-0212:34:53 ... 
28Unknown

Mozilla/5.0 (compatible; openstat.ru/Bot)

148.251.223.212020-07-0204:13:32 / 
29Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15

Safari 13.0213.222.224.2382020-07-02 ... /
30Unknown

Internet-structure-research-project-bot

213.159.213.1372020-07-0120:53:29 / 
31statdom.ru

Mozilla/5.0 (compatible; statdom.ru/Bot; +http://statdom.ru/bot.html)

212.193.117.2452020-07-0118:24:39 / 
32Unknown

Mozilla/5.0 (compatible; webtechbot; +https://www.webtechsurvey.com/bot)

76.217.31.1952020-07-0113:15:55 ... 
33WayBackMachine

Mozilla/5.0 (compatible; special_archiver/3.1.1 +http://www.archive.org/details/archive.org_bot)

207.241.231.1502020-07-0109:15:39 ... 
34Unknown

Mozilla/5.0 (Macintosh;

209.208.79.1742020-07-0107:20:43 / 
35Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 11_4_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/11.1.2 Mobile/15E148 Safari/604.1

31.173.26.2102020-07-0106:05:01 / 
36Unknown

Mozilla/5.0 (compatible; Dataprovider.com)

158.69.116.772020-07-0104:07:23 ... 
37Unknown

Go-http-client/1.1

192.36.71.1332020-07-0100:25:19 / 
38Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15

193.169.254.1012020-06-3018:43:07 ... 
39WayBackMachine

Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot)

207.241.231.1502020-06-3016:36:21 ... 
40Unknown

Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_8; en-us) AppleWebKit/534.50 (KHTML, like Gecko) Version/5.1 Safari/534.50

13.72.110.1892020-06-3009:08:45 ... 
41Yandex

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.106

77.88.5.1382020-06-3008:39:42 ... 
42Unknown

Mozilla/5.0 (compatible; MixrankBot; [email protected])

66.231.185.702020-06-3004:19:47 ... 
43BLEXBot

Mozilla/5.0 (compatible; BLEXBot/1.0; +http://webmeup-crawler.com/)

178.63.13.1462020-06-3001:34:55 ... 
44Unknown

Blackboard Safeassign

54.90.112.2502020-06-2905:51:28 ... 
45UptimeRobot

Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)

69.162.124.2302020-06-2905:23:29 / 
46Unknown

Mozilla/5.0 (PLAYSTATION 3; 2.00)

79.172.193.322020-06-2820:04:50 ... 
47Google

Googlebot-Image/1.0

79.172.193.322020-06-2820:04:38 ... 
48Unknown

Mozilla/5.0 (compatible; top100.rambler.ru crawler)

91.192.149.2532020-06-2804:01:51 / 
49CloudFlare [AlwaysOnline]

Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

172.69.25.1342020-06-2800:44:37 ... 
50Unknown

Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html)

54.167.55.1202020-06-2720:57:54 / 
Copyright © 2009-2015 Dmitry
Pages: 1 2 3 4 5 6 7 8 9 10  All

Current date/time: 2020-07-04, 17:57:37

Valid XHTML 1.1  Правильный CSS!

If my script works and satisfied you, and you have some WebMoney, please help with the script's development: Z262568480988, R290740003883