Prevent search engines to index /media/oembed URLs

Search engines (specifically Google) will still show the pages in the index, but because it can longer crawl because of the change in #3271222 it won't even know that it should not add the pages to the index. I think this ticket still holds value, especially given that the idea was to keep the oembed nodes *out of the index*.

Interesting, I'm no SEO expert but it looks like you're right.
If I understand correctly, Disallow via robots.txt doesn't prevent the page to be indexed, only the noindex meta does.
And if the "noindex, nofollow" meta is present, I believe there is no point in disallowing in robots.txt in this case.

Which then means that #3271222's implementation could be replaced by the one in this issue?
I'm reopening then, just to be sure.
Any opinions @phenaproxima, @alexpott

Thanks