Include sitemap in robots.txt via robotstxt module

Created on 27 October 2023, about 1 year ago
Updated 19 July 2024, 5 months ago

Problem/Motivation

Robots can be instructed where to find the sitemap via a line in robots.txt, which is currently a missed opportunity. The XMLsitemap module does provide this feature.

Steps to reproduce

Install the robotstxt module, the sitemap is not mentioned in robots.txt.

Proposed resolution

Implement hook_robotstxt() to provide the necessary line.

Remaining tasks

Review merge request !77

User interface changes

None

API changes

None

Data model changes

None

Feature request
Status

Closed: works as designed

Version

4.0

Component

Code

Created by

🇬🇧United Kingdom james.williams

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.71.5 2024