CloudFlare known bots List



How does Firewall Rules handle traffic from known bots?
Caution about potentially blocking bots

When you create a Firewall rule with a Block, Challenge (Captcha), or JS Challenge action, you might unintentionally block traffic from known bots. Specifically, this might affect search engine optimization (SEO) and website monitoring when trying to enforce a mitigation action based on URI, path, host, ASN, or country.

See How do I create an exception to exclude certain requests from being blocked or challenged?

Bots currently detected

The table below lists a sample of known bots that Firewall Rules currently detects. When traffic comes from these bots and others not listed, the cf.client.bot field is set to true.
Bot Description

ahrefs
Ahrefs SEO bot

apple
Applebot is the web crawler for Apple, for products like Siri and Spotlight Suggestions

archive.org
Archive.org bots

baidu
Baidu search engine bots

better uptime
Bot for monitoring website uptime

bing
Bing search engine bots

feedbin
Feedbin.com bots

google
Google search engine bots

grapeshot
Grapeshot (Oracle) SEO bots

linkedin
LinkedIn bots

mail.ru
Mail.ru bots

naver
Naver (South Korean) search engine bots

pingdom
Pingdom.com monitoring bots

pinterest
Pinterest bots

seznam
Seznam search engine bots

sogou
Sogou search engine bots

uptimerobot
Uptime Robot monitoring bots

yahoo
Yahoo! search engine bots

yandex
Yandex search engine bots


: