Update README file

Thanks @vaish for creating and maintaining the module, I really appreciate all the great examples for reviewing the logs added in the Crawler Rate Limit README. They could be combined with the script here to send an alert, in extreme cases: https://www.drupal.org/docs/administering-a-drupal-site/security-in-drup... →

Thanks for your feedback @ressa. Thanks for pointing out to the page about blocking bad bots and crawlers. Any suggestions what would you like to add to that script. Currently it only reports high load average which probably makes sense. Also, what do you think about mentioning this module on your page as one of the options for blocking bad bots and crawlers?

You're welcome @vaish, I am grateful there a so many volunteers in the Drupal community such as yourself, who maintain amazing and feature rich free and open source Drupal modules, it truly is something unique.

Adding the Crawler Rate Limit module is a great suggestion, and I have added three bot blocker modules to the page.

I haven't yet looked into how to extend the alert script, using one or more of your examples of grepping in the log ... but if you feel inspired, you're more than welcome to add a new script, which uses the grep methods you just added in the Crawler Rate Limit README :)

Thanks @ressa. I'm not sure if I would want to add anything else to the alert script. I see one-liners from my README as something I would want to use after I receive the alert email in order to analyze the logs and try to figure out the cause of the high load average. If you have any other ideas or need my help in adopting/tweaking the one-liners, please let me know.

Yes, maybe you're right ... I just thought that perhaps you might want to extract other data, to use a different metric, to trigger the alert email. But let's see if that's necessary, it can always get expanded. It sounds good that I can reach out for help later, if necessary -- Have a nice day.

Automatically closed - issue fixed for 2 weeks with no activity.