Block excessive crawling of other facet URL patterns

Created on 20 August 2025, about 2 months ago

Problem/Motivation

Currently this module blocks requests which use an excessive number of facet parameters following the pattern:

/search?f%5B0%5D=my_filter:my_value

URL decoded:

/search?f[0]=my_filter:my_value

But I am seeing requests in my logs that follow different patterns, which oddly, is not what the UI of the site directs users to use.

&1=my_filter%3A281

URL decoded:

1=my_filter:281

Proposed resolution

I'm not certain how the bots are coming up with these URLs, but I'm thinking that the module should block these requests as well.

πŸ“Œ Task
Status

Active

Version

1.0

Component

Code

Created by

πŸ‡ΊπŸ‡ΈUnited States bburg Washington, DC

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024