All geek questions in one place

How to block mp3 scanners from my site under Apache?

Is there a way to block access from the referrer using a .htaccess file or similar? My bandwidth is consumed by people linking to http://www.dizzler.com , which is a flash site that allows you to browse the crawl library of public mp3s.

Edit: Dizzler still got there (maybe I didn’t specify referrer in all cases), so instead I moved all my mp3 files to a new folder, turned off directory browsing and created a robots.txt file (I hope) it will not allow it to be indexed again. The accepted answer has changed to reflect the futility of my previous attempt: P

+4
source share
4 answers

As if you want to stop spam bots from collecting emails on your public page - it’s very difficult to tell the difference between users and bots without forcing your viewers to log in to confirm their identity.

You can use robots.txt to prevent spiders that really follow these rules, but this is on their side, not on your server. There's a page that explains how to catch those that violate the rules and explicitly forbid them: Using Apache to Stop Bad Robots [evolt.org]

If you need an easy way to stop Dizzler, in particular using .htaccess, you should open it and add:

<Directory /directoryName/subDirectory> Order Allow,Deny Allow from all Deny from 66.232.150.219 </Directory>
+3
source

From this site : (put this in your .htaccess file)

 RewriteEngine on RewriteCond %{HTTP_REFERER} ^http://((www\.)?dizzler\.com [NC] RewriteRule .* - [F]
+2
source

You can use something like

 SetEnvIfNoCase Referer dizzler.com spammer=yes Order allow,deny allow from all deny from env=spammer

Source: http://codex.wordpress.org/Combating_Comment_Spam/Denying_Access

+2
source

This is not a very elegant solution, but you can block the crawler bot site and then rename your mp3 files to break links already on the site.

0
source

Source: https://habr.com/ru/post/1276799/

More articles:


All Articles