Hello, I have a multi-line multi-domain pre-installation with the main domain example.com, and I want to block all bots from bypassing the subdomain of subdomain.example.com, made for resellers, where they can buy at lower prices, because the content is duplicated from the original site, and I'm not sure how to do it. Usually, if I want to block bots for a site, I would use
User-agent: *
Disallow: /
But how can I use it without damaging the entire store? and is it also possible to block bots from htacces?
source
share