Crawler bots statistics [usings.ru]

Filter  •  Admin panel >>

Pages: 1 2 3 4 5 6  All
#BotBot's User-AgentIPDateTimeURI
1CommonCrawl

CCBot/2.0 (https://commoncrawl.org/faq/)

54.226.58.1772019-01-2111:48:40 ... 
2Majestic-12

Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)

108.59.8.702019-01-2111:29:11 / 
3Bing

Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

207.46.13.792019-01-2110:23:46 ... 
4DotBot

Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, [email protected])

216.244.66.2262019-01-2109:40:29 ... 
5Google

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

66.249.64.1242019-01-2108:24:36 ... 
6Unknown

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/534.34 (KHTML, like Gecko) wkhtmltoimage Safari/534.34

80.242.34.1052019-01-2106:42:11 / 
7Yandex

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

141.8.143.1802019-01-2104:19:20 ... 
8Unknown

git/2.11.0

185.22.172.682019-01-2104:12:14 ... 
9Google [favicon]

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36 Google Favicon

66.102.9.1582019-01-2023:15:19 / 
10Google

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

66.249.64.1242019-01-2020:40:00 ... 
11Unknown

Mozilla/5.0 (compatible; Cloudflare-AMP/1.0; +https://amp.cloudflare.com/doc/fetcher.html) AppleWebKit/534.34

162.158.68.2142019-01-2019:05:39 ... 
12Unknown

Mozilla/5.0 (compatible; BackupLand/1.0; https://go.backupland.com/; Domain check for viruses;)

185.12.124.782019-01-2004:41:56 / 
13Bing

Mozilla/5.0 (iPhone; CPU iPhone OS 7_0 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A465 Safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

40.77.167.2112019-01-1922:28:32 ... 
14Unknown

Virusdie crawler/2.1

194.58.115.1442019-01-1918:25:04 ... 
15Yandex

Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

37.9.118.292019-01-1916:49:09 / 
16Unknown

Mozilla/5.0 (compatible; Nimbostratus-Bot/v1.3.2; http://cloudsystemnetworks.com)

209.17.97.22019-01-1911:45:16 / 
17Unknown

Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

107.21.1.82019-01-1901:23:42 / 
18Unknown

Mozilla/5.0 (compatible; SeznamBot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)

77.75.79.622019-01-1819:43:37 ... 
19Unknown

Mozilla/5.0 zgrab/0.x (compatible; Researchscan/t13rl; +http://researchscan.comsys.rwth-aachen.de)

137.226.113.262019-01-1809:01:34 / 
20Yandex

Mozilla/5.0 (iPhone; CPU iPhone OS 8_1 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12B411 Safari/600.1.4 (compatible; YandexMobileBot/3.0; +http://yandex.com/bots)

141.8.132.192019-01-1804:43:58 ... 
21Mail.RU

Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)

95.163.255.82019-01-1800:41:48 ... 
22Unknown

Mozilla/5.0 zgrab/0.x (compatible; Researchscan/t12ca; +http://researchscan.comsys.rwth-aachen.de)

137.226.113.262019-01-1720:20:54 / 
23Unknown

Mozilla/5.0 zgrab/0.x (compatible; Researchscan/t12sns; +http://researchscan.comsys.rwth-aachen.de)

137.226.113.282019-01-1720:18:27 / 
24Unknown

Mozilla/5.0 (compatible; openstat.ru/Bot)

148.251.223.212019-01-1712:22:39 ... 
25Exabot

Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)

178.255.215.942019-01-1710:38:30 / 
26Unknown

python-requests/2.21.0

179.43.156.462019-01-1614:20:57 / 
27Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1; +http://www.apple.com/go/applebot)

17.58.96.1302019-01-1610:52:48 / 
28Unknown

Surf/1.0 (Linux 4.4.0-138-generic; go1.10.4)

36.81.223.2492019-01-1604:27:09 / 
29Unknown

Mozilla/5.0 (compatible; StatOnlineRuBot/1.0)

194.58.113.2242019-01-1600:36:06 / 
30Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.58.2 (KHTML, like Gecko) Version/5.1.8 Safari/534.58.2

88.198.36.622019-01-1515:03:57 ... 
31Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8) AppleWebKit/536.25 (KHTML, like Gecko) Version/6.0 Safari/536.25

88.198.36.622019-01-1515:03:56 ... 
32Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 1084) AppleWebKit/536.28.10 (KHTML like Gecko) Version/6.0.3 Safari/536.28.10

88.198.36.622019-01-1515:03:55 ... 
33Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_2) AppleWebKit/604.4.7 (KHTML, like Gecko) Version/11.0.2 Safari/604.4.7

88.198.36.622019-01-1515:03:54 ... 
34Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/537.13+ (KHTML, like Gecko) Version/5.1.7 Safari/534.57.2

88.198.36.622019-01-1515:03:54 ... 
35Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/604.5.6 (KHTML, like Gecko) Version/11.0.3 Safari/604.5.6

88.198.36.622019-01-1515:03:53 ... 
36Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.59.8 (KHTML, like Gecko) Version/5.1.9 Safari/534.59.8

88.198.36.622019-01-1515:03:49 / 
37Unknown

Wget/1.18 (linux-gnu)

178.235.209.722019-01-1507:29:01 / 
38CloudFlare [AlwaysOnline]

Mozilla/5.0 (compatible; CloudFlare-AlwaysOnline/1.0; +http://www.cloudflare.com/always-online) AppleWebKit/534.34

162.158.65.1442019-01-1501:45:33 ... 
39Unknown

Mozilla/5.0 (compatible; Google-Site-Verification/1.0)

66.249.90.972019-01-1409:35:29 ... 
40Unknown

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/538.1 (KHTML, like Gecko) CutyCapt Safari/538.1

88.99.141.32019-01-1406:10:17 / 
41oBot

Mozilla/5.0 (compatible; oBot/2.3.1; http://filterdb.iss.net/crawler/)

206.253.224.742019-01-1221:28:49 / 
42Unknown

Mozilla/5.0 (compatible; ips-agent)

69.58.178.562019-01-1216:24:24 / 
43Unknown

Mozilla/5.0 (compatible; MojeekBot/0.6; +https://www.mojeek.com/bot.html)

5.102.173.712019-01-1214:15:24 / 
44UptimeRobot

Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)

46.101.250.1352019-01-1203:49:31 / 
45Alexa

ia_archiver

54.165.90.2032019-01-1018:37:01 ... 
46Unknown

Mozilla/5.0 (compatible; WebDataStats/1.0 ; +https://webdatastats.com/policy.html)

185.86.93.252019-01-1017:10:24 / 
47Unknown

Mozilla/5.0 (compatible; LetsearchBot/1.0; +https://letsearch.ru)

94.141.181.1312019-01-1013:48:08 / 
48Unknown

OrgProbe/2.0.0 (+http://www.blocked.org.uk)

86.186.102.1402019-01-1012:13:01 / 
49Unknown

Go-http-client/1.1

206.225.83.832019-01-0811:47:53 / 
50statdom.ru

Mozilla/5.0 (compatible; statdom.ru/Bot; +http://statdom.ru/bot.html)

212.193.117.2452019-01-0808:03:27 ... 
Copyright © 2009-2015 Dmitry
Pages: 1 2 3 4 5 6  All

Current date/time: 2019-01-21, 11:48:45

Valid XHTML 1.1  Правильный CSS!

If my script works and satisfied you, and you have some WebMoney, please help with the script's development: Z262568480988, R290740003883