Output noindex HTTP header

Created on 17 September 2025, 20 days ago

Problem/Motivation

Markdown content output should not be indexed by traditional search engines. It is a duplicate of the HTML output and would entail a penalty from the search engines.

Proposed resolution

To indicate to traditional search engines that the Markdown version of the content should not be indexed, output a X-Robots-Tag: noindex HTTP header with the 200 response. See https://developers.google.com/search/docs/crawling-indexing/block-indexi...

Remaining tasks

User interface changes

none

API changes

none

Data model changes

none

Note that Drupal already outputs a canonical URL with the HTML output, and Markdownify outputs a rel alternate header with the HTML when it is enabled, which in theory should suffice. But better be sure...

✨ Feature request
Status

Active

Version

1.0

Component

Code

Created by

πŸ‡ΊπŸ‡ΈUnited States christophweber

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

Production build 0.71.5 2024