Crawler bots statistics [usings.ru]

Filter  •  Admin panel >>

Pages: 1 2 3 ... 6 ... 10 11 12 13  All
#BotBot's User-AgentIPDateTimeURI
1CommonCrawl

CCBot/2.0 (https://commoncrawl.org/faq/)

54.236.62.492021-03-0806:11:05 ... 
2Bing

Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

13.66.139.902021-03-0806:05:07 ... 
3Google

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.188 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

66.249.79.2092021-03-0805:51:12 ... 
4Google

Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

66.249.79.2222021-03-0804:20:49 / 
5DotBot

Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, [email protected])

216.244.66.2262021-03-0804:14:17 ... 
6Unknown

NetSystemsResearch studies the availability of various services across the internet. Our website is netsystemsresearch.com

92.118.160.12021-03-0801:54:21 / 
7Yandex

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.268

77.88.5.332021-03-0801:39:14 ... 
8Unknown

Go http package

92.118.160.12021-03-0801:01:55 / 
9statdom.ru

Mozilla/5.0 (compatible; statdom.ru/Bot; +http://statdom.ru/bot.html)

212.193.117.2452021-03-0718:40:46 ... 
10BackupLand

Mozilla/5.0 (compatible; BackupLand/1.0; https://go.backupland.com/; Domain check for viruses;)

185.12.124.782021-03-0718:35:06 / 
11Unknown

python-requests/2.25.1

62.4.30.2282021-03-0717:29:59 ... 
12Yandex

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)

77.88.5.112021-03-0716:38:34 / 
13Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)

17.58.99.2082021-03-0713:09:04 / 
14UptimeRobot

Mozilla/5.0+(compatible; UptimeRobot/2.0; http://www.uptimerobot.com/)

69.162.124.2302021-03-0712:49:30 / 
15Yandex

Mozilla/5.0 (compatible; YandexMetrika/2.0; +http://yandex.com/bots)

37.9.118.292021-03-0712:47:21 / 
16Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 12_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) CriOS/85.0.4183.109 Mobile/15E148 Safari/604.1

176.59.53.1972021-03-0708:59:16 / 
17Unknown

Mozilla/5.0 (compatible; evc-batch/2.0)

64.71.131.2442021-03-0705:40:49 / 
18Mail.RU

Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/2.0; +http://go.mail.ru/help/robots)

95.163.255.542021-03-0704:43:18 ... 
19SeznamBot

Mozilla/5.0 (compatible; SeznamBot/3.2; +http://napoveda.seznam.cz/en/seznambot-intro/)

77.75.76.1692021-03-0701:17:21 ... 
20DuckDuckGo

Mozilla/5.0 (compatible; DuckDuckGo-Favicons-Bot/1.0; +http://duckduckgo.com)

40.88.21.2352021-03-0620:59:02 / 
21Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 14_4 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.3 Mobile/15E148 Safari/604.1

109.173.22.2232021-03-0614:27:15 / 
22Unknown

Mozilla/5.0 (compatible; top100.rambler.ru crawler)

91.192.148.2532021-03-0613:02:29 ... 
23Unknown

Expanse indexes the network perimeters of our customers. If you have any questions or concerns, please reach out to: [email protected]

34.77.162.82021-03-0606:46:33 / 
24Majestic-12

Mozilla/5.0 (compatible; MJ12bot/v1.4.8; http://mj12bot.com/)

173.64.77.132021-03-0606:38:16 ... 
25Unknown

Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)

178.93.22.102021-03-0604:41:23 ... 
26Unknown

Mozilla/5.0 (Linux i386; X11) AppleWebKit/536.32 (KHTML, like Gecko) Version/5.0.0 Safari/537.33

15.228.22.2382021-03-0602:57:35 ... 
27Unknown

Mozilla/5.0 (Linux i386; X11) AppleWebKit/535.28 (KHTML, like Gecko) Version/5.0.5 Safari/536.4

15.228.22.2382021-03-0602:57:30 ... 
28Unknown

Mozilla/5.0 (Linux x86_64; X11) AppleWebKit/536.18 (KHTML, like Gecko) Version/4.0.0 Safari/537.6

15.228.22.2382021-03-0602:57:01 ... 
29Unknown

Mozilla/5.0 (Linux x86_64; X11) AppleWebKit/537.33 (KHTML, like Gecko) Version/5.0.4 Safari/535.27

15.228.22.2382021-03-0602:56:30 ... 
30oBot

Mozilla/5.0 (compatible; oBot/2.3.1; http://www.xforce-security.com/crawler/)

206.253.224.142021-03-0512:18:02 / 
31NetCraft

Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; [email protected])

164.90.131.1032021-03-0510:58:35 / 
32Unknown

Mozilla/5.0 (compatible; Google-Site-Verification/1.0)

66.249.92.932021-03-0510:34:49 ... 
33Unknown

python-requests/2.22.0

50.116.50.62021-03-0509:44:12 ... 
34Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 12_0 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0 Mobile/15E148 Safari/604.1

192.36.71.1332021-03-0503:34:09 / 
35Unknown

Mozilla/5.0 (compatible; WebDataStats/1.0 ; +https://webdatastats.com/policy.html)

185.86.93.42021-03-0423:19:40 / 
36Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.2 Safari/605.1.15

213.159.50.72021-03-0420:07:09 / 
37Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 11_4_2) AppleWebKit/536.28 (KHTML, like Gecko) Version/6.1.3 Safari/536.2

15.228.20.492021-03-0417:57:25 ... 
38Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 14_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) CriOS/86.0.4240.93 Mobile/15E148 Safari/604.1

213.87.136.122021-03-0415:14:40 / 
39AhrefsBot

Mozilla/5.0 (compatible; AhrefsBot/7.0; +http://ahrefs.com/robot/)

191.30.140.2452021-03-0316:46:50 / 
40Unknown

Mozilla/5.0 (Macintosh; Intel Mac OS X 11_6_2) AppleWebKit/535.35 (KHTML, like Gecko) Version/4.1.9 Safari/536.24

18.231.139.932021-03-0316:15:35 ... 
41Yandex

Mozilla/5.0 (Linux; Android 7.0; SM-A310F Build/NRD90M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/74.0.3729.136 Mobile Safari/537.36 YandexSearch/8.20 YandexSearchBrowser/8.20

91.193.177.772021-03-0314:13:38 ... 
42Unknown

Mozilla/5.0 (compatible)

31.177.64.1002021-03-0313:57:53 / 
43Unknown

Mozilla/5.0 (compatible; SurdotlyBot/1.0; +http://sur.ly/bot.html)

54.221.173.2102021-03-0310:30:21 / 
44Unknown

python-requests/2.24.0

34.71.3.2082021-03-0310:17:46 ... 
45Unknown

Mozilla/5.0 (Linux; U; Android 4.4.2; en-US; HM NOTE 1W Build/KOT49H) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 UCBrowser/11.0.5.850 U3/0.8.0 Mobile Safari/534.30

34.71.3.2082021-03-0310:17:43 / 
46Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 13_5_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.1 Mobile/15E148 Safari/604.1

31.173.82.2052021-03-0310:17:35 / 
47Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 13_7 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.1.2 Mobile/15E148 Safari/604.1

178.176.75.2272021-03-0301:04:48 / 
48Google [favicon]

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/49.0.2623.75 Safari/537.36 Google Favicon

66.249.93.962021-03-0215:10:51 / 
49Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 13_3_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Mobile/15E148 Safari/604.1

83.220.237.2062021-03-0214:53:35 / 
50Unknown

Mozilla/5.0 (iPhone; CPU iPhone OS 14_0_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0 Mobile/15E148 Safari/604.1

188.170.85.1392021-03-0214:10:35 / 
Copyright © 2009-2015 Dmitry
Pages: 1 2 3 ... 6 ... 10 11 12 13  All

Current date/time: 2021-03-08, 06:18:39

Valid XHTML 1.1  Правильный CSS!

If my script works and satisfied you, and you have some WebMoney, please help with the script's development: Z262568480988, R290740003883