Robots |
1 | 657 | 29.88 | compatible Mozilla/5.0 |
2 | 316 | 14.37 | linkdexbot/2.0 |
3 | 159 | 7.23 | DotBot/1.1 |
4 | 152 | 6.91 | MJ12bot/v1.4.7 |
5 | 144 | 6.55 | Googlebot/2.1 |
6 | 129 | 5.87 | bingbot/2.0 |
7 | 125 | 5.68 | SemrushBot/1.2~bl |
8 | 106 | 4.82 | MJ12bot/v1.4.8 |
9 | 100 | 4.55 | AhrefsBot/5.2 |
10 | 94 | 4.27 | SeznamBot/3.2 |
11 | 90 | 4.09 | YandexBot/3.0 |
12 | 31 | 1.41 | Linux x86_64 |
13 | 25 | 1.14 | Exabot/3.0 |
14 | 22 | 1.00 | Sogou web spider/4.0(+http://www.sogou.c... |
15 | 6 | 0.27 | MBCrawler/1.0 (https://monitorbacklinks.... |
16 | 5 | 0.23 | - |
17 | 4 | 0.18 | spbot/5.0.3 |
18 | 3 | 0.14 | SafeDNSBot (https://www.safedns.com/sear... |
19 | 3 | 0.14 | MojeekBot/0.6 |
20 | 3 | 0.14 | CCBot/2.0 (http://commoncrawl.org/faq/) |
21 | 2 | 0.09 | MegaIndex.ru/2.0 |
22 | 2 | 0.09 | MSIE 6.0 |
23 | 2 | 0.09 | SurdotlyBot/1.0 |
24 | 2 | 0.09 | MSIE 9.0 |
25 | 2 | 0.09 | archive.org_bot |
26 | 2 | 0.09 | 007ac9 Crawler |
27 | 1 | 0.05 | netEstate NE Crawler (+http://www.websit... |
28 | 1 | 0.05 | Yahoo! Slurp |
29 | 1 | 0.05 | Uptimebot/1.0 |
30 | 1 | 0.05 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
31 | 1 | 0.05 | vebidoobot/1.0 |
32 | 1 | 0.05 | ImplisenseBot 1.1 |
33 | 1 | 0.05 | rogerbot/1.1 (http://moz.com/help/guides... |
34 | 1 | 0.05 | Python-urllib/3.5 |
35 | 1 | 0.05 | SearchmetricsBot |
36 | 1 | 0.05 | Go-http-client/1.1 |
37 | 1 | 0.05 | Barkrowler/0.7 (+http://www.exensa.com/c... |
38 | 1 | 0.05 | Nmap Scripting Engine |
39 | 1 | 0.05 | nutch-1.4/Nutch-1.4 |