All geek questions in one place

How can robots.txt ignore anything with action = history in it?

I have a MediaWiki, and I don’t think I want Google to index the history of any page. How robots.txtto ban urls with action=historyin query string?

+3
source share
1 answer

HTML to represent the story (and several others, such as magazines, etc.) contains the noindex, nofollow metadata. Relevant user agents such as Googlebot will abide by this advice, rather than indexing the page.

+5
source

Source: https://habr.com/ru/post/1727161/

More articles:


All Articles