- Issue created by @blymemikkel
- 🇱🇹Lithuania mindaugasd
Similar issue ✨ Disallow AI bots by default in robots.txt Active
- 🇮🇳India dev2.addweb
Related module available now :- https://www.drupal.org/project/aitxt →
Is supporting ai.txt something this module could be interested in or do you see it more fit to create a new module. My (fairly short) research didn't find any modules that do it.
A little background info on what an ai.txt file is. Taken from https://spawning.substack.com/p/aitxt-a-new-way-for-websites-to-set
Ai.txt is a file placed at the root of a website, which selectively restricts or permits access to the site’s content and media–mirroring the widely adopted robots.txt standard. Unlike robots.txt, which is commonly read when a website is crawled, ai.txt is read when a site’s media is downloaded. With ai.txt, website owners can control whether or not their work is used to train new AI models and can continue to use robots.txt to manage permissions for popular search engines.
https://site.spawning.ai/spawning-ai-txt
I get that AI miners easily could ignore this.
I hope this feature requests is OK to post here. Otherwise, I'm sorry. :)
Active
1.0
Miscellaneous
Similar issue ✨ Disallow AI bots by default in robots.txt Active
Related module available now :- https://www.drupal.org/project/aitxt →