- 🇦🇺Australia mstrelan
Is there a reason why the default robots.txt file doesn't include lines like this:
Disallow: /user/login
Disallow: /index.php/user/login
where the trailing slash is omitted? Apparently some bots will still index the /user/login path unless the trailing slashes are also omitted.
In our particular Drupal site, the only people who have accounts are a handful of people who contribute content to the site. Unfortunately, Google at some point has found our /user/login and it's now indexed in Google. So website users at our institution are confusing our Drupal login page with the login page for another system we have that many of those patrons use.
Closed: duplicate
9.5
Last updated
Not all content is available!
It's likely this issue predates Contrib.social: some issue and comment data are missing.