Blog
FAQ
Discussions
Search
Projects, issues, users, and merge requests.
Project ID, name, and description.
User nickname, name, and org.
Issue ID, title, and summary.
Merge request titles.
Contrib
.social
Feed
Live feed
Builds
Live builds
Core
Tags
Tags and Initiatives
RobotsTxt
Open on Drupal.org →
Open on Drupal GitLab →
Created on 11 March 2006,
almost 19 years ago
Maintained by
🇺🇸
United States
ccjjmartin
🇺🇸
United States
david strauss
🇺🇸
United States
mikeegoulding
🇺🇸
United States
todd nienkerk
Clone
Clone with SSH
Clone with HTTPS
Clone with
doGit
🇺🇸
United States
82%
🏴☠️
9%
🇺🇦
Ukraine
5%
🇪🇸
Spain
5%
Top 4 contributors
Velir
59%
🇺🇸
@kevinquillen
Redfin Solutions, LLC
18%
🇺🇸
@leslieg
Drupal Ukraine Community
5%
🇺🇦
@rollins
Lemberg Solutions
🇺🇦
@rollins
and 4 individuals
( 18% )
@cilefen
🇺🇸
@kentr
🇪🇸
@alvarodemendoza
@project update bot
Follow
Sign in to follow projects
Merge Requests
More
!15
Add X-Content-Type-Options header
Open
Show issue
Unnamed author
updated
3 months ago
!6
Add cache context url.site to robots.txt response
Merged
Show issue
🇧🇪
Belgium
JeroenT
updated
4 months ago
!10
Integration with Gitlab CI
Merged
Show issue
🇷🇺
Russia
zniki.ru
updated
4 months ago
!11
Automated Drupal 11 compatibility fixes for robotstxt
Merged
Show issue
project update bot
updated
4 months ago
!14
Robots.txt file not changed
Open
Show issue
🇬🇧
United Kingdom
stefank
updated
6 months ago
!2
Create hook_robotstxt_alter()
Open
Show issue
🇺🇸
United States
ccjjmartin
updated
8 months ago
More Merge Requests
Issues
✨
Disallow GPTBot by default
Active
Code
Created
about 1 year ago
v1.5
🇺🇸
United States
kevinquillen
about 1 month ago
📌
Update categories on project page for compatibility with Project Browser
Active
Miscellaneous
Created
3 months ago
v1.0
🇺🇸
United States
leslieg
3 months ago
📌
Update summary on project page for compatibility with Project Browser
Active
Miscellaneous
Created
3 months ago
v1.0
🇺🇸
United States
leslieg
3 months ago
📌
Update logo for compatibility with Project Browser
Active
Miscellaneous
Created
3 months ago
v1.0
🇺🇸
United States
leslieg
3 months ago
🐛
Add X-Content-Type-Options header
Needs review
Code
Created
9 months ago
v1.0
🇰🇿
Kazakhstan
Dmitrii_Zadorozhnyi
3 months ago
✨
Support for ai.txt?
Active
Miscellaneous
Created
about 1 year ago
v1.0
🇩🇰
Denmark
blymemikkel
3 months ago
📌
Add cache context url.site to robots.txt response
Fixed
Code
Created
over 2 years ago
v1.0
🇧🇪
Belgium
JeroenT
4 months ago
💬
Coding Standards
Fixed
Code
Created
4 months ago
v1.5
🇨🇴
Colombia
andresalvarez
4 months ago
📌
Integration with Gitlab CI
Fixed
Code
Created
about 1 year ago
v1.0
🇷🇺
Russia
zniki.ru
4 months ago
📌
Automated Drupal 11 compatibility fixes for robotstxt
Fixed
Code
Created
9 months ago
v1.5
project update bot
4 months ago
✨
Multisite support (another approach)
Postponed
Code
Created
over 4 years ago
v1.0
🇺🇸
United States
euk
4 months ago
🐛
LogicException: The controller result claims to be providing relevant cache metadata, but leaked metadata was detected
RTBC
Code
Created
almost 5 years ago
v1.0
🇷🇸
Serbia
Vladimir Tanovic
4 months ago
✨
Support semantic versioning
Postponed
Code
Created
over 4 years ago
v1.0
🇺🇸
United States
ccjjmartin
4 months ago
✨
Provide options to add Simple Sitemap files to robot.txt
RTBC
Code
Created
over 3 years ago
v1.0
🇺🇸
United States
DamienMcKenna
5 months ago
✨
Allow using the Drupal core robots.txt file
Needs work
Code
Created
almost 6 years ago
v1.0
🇨🇭
Switzerland
drikc
6 months ago
🐛
Robots.txt file not changed
Needs review
Code
Created
about 2 years ago
v1.4
🇲🇩
Moldova
nick.murza
6 months ago
🐛
Symfony\Component\Routing\Exception\RouteNotFoundException: Route "robotstxt.admin_settings_form" does not exist. in Drupal\Core\Routing\RouteProvider->getRouteByName() (line 206 of core/lib/Drupal/Core/Routing/RouteProvider.php).
Postponed: needs info
Code
Created
8 months ago
v1.5
🇵🇰
Pakistan
isalmanhaider
7 months ago
✨
Create hook_robotstxt_alter()
Needs work
Code
Created
about 7 years ago
v1.0
🇺🇸
United States
bappa.sarkar
8 months ago
✨
Integrate with the Dark Visitors API
Active
Code
Created
8 months ago
v1.0
🇨🇦
Canada
sillygwailo
8 months ago
✨
Enable usage of tokens
Needs work
Code
Created
almost 5 years ago
v1.0
🇳🇱
Netherlands
Ruuds
9 months ago
📌
Add Unit tests for Robots Txt
Needs review
Code
Created
almost 4 years ago
v1.0
🇺🇸
United States
mikelutz
9 months ago
📌
Update README.md as per README.md format
Fixed
Documentation
Created
almost 2 years ago
v1.0
🇮🇳
India
jay jangid
about 1 year ago
💬
How to use this module with auto scaffold robots.txt?
Fixed
Documentation
Created
over 4 years ago
v1.0
🇷🇺
Russia
vvs
about 1 year ago
contrib
.social
Blog
FAQ
Discussions
Production build 0.71.5
2024