Best alternative to hard blocking bots, and easier set up than Crawler Rate Limit?

Created on 20 August 2025, 3 days ago

Problem/Motivation

Thanks for creating this module, it looks really interesting! The closest module could be Crawler Rate Limit ? But since it requires setting up extra backend, this module looks easier to set up, and get started faster.

Also, it seems like using this module could be a more forgiving method, than out-right blocking aggressive crawler IP's, since you might actually want to allow bots and crawlers from search engines and LLM's access, but limit them for example to one request every 5th second. If true, it looks to me like this module could be the best alternative to hard block, as it is outlined under Block bad bots and crawlers > Block bot IPs in .htaccess .

Steps to reproduce

Proposed resolution

Perhaps a short sentence could be added, clarifying these two questions on the project page and maybe README?

Also, a link to the Protect Views Flood Control module could be added in the Block bad bots and crawlers > Block bot IPs in .htaccess section, with a mention that it might serve as a viable alternative, to facilitate a more gentle crawling.

Remaining tasks

User interface changes

API changes

Data model changes

📌 Task
Status

Active

Version

1.0

Component

Documentation

Created by

🇩🇰Denmark ressa Copenhagen

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024