Duplicate search phrase Magento

Question

We register an unusually large number of searches for a specific search term: - "biscru" or "Ticru" (63,000 times in the last 2 months). In the apache protocol, these requests come from Googles servers, but I find it hard to believe and suspect that the IP address is faked.

Apache Log Example: -

rawliving.eu:66.249.72.227 - - [06/Jul/2013:01:25:09 +0100] "GET /catalogsearch/result/index/?cat=47&dir=desc&limit=25&mode=list&order=event_date&p=6 &q=%22biscru%22+OR+%22Ticru%22 HTTP/1.1" 200 20587 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 

Obviously, blocking 66.249.72.227 is not an option, since it is a valid google address, so can anyone suggest which options we should prevent this corruption and possibly determine where these requests are coming from and why?

Any advice gratefully received. Lee

Answer 1

Add this to your layout-xml definition, for example. local.xml

 <catalogsearch_result_index translate="label"> <reference name="head"> <action method="setRobots"><value>NOINDEX,NOFOLLOW</value></action> </reference> </catalogsearch_result_index> <catalogsearch_advanced_index translate="label"> <reference name="head"> <action method="setRobots"><value>NOINDEX,NOFOLLOW</value></action> </reference> </catalogsearch_advanced_index> <catalogsearch_advanced_result translate="label"> <reference name="head"> <action method="setRobots"><value>NOINDEX,NOFOLLOW</value></action> </reference> </catalogsearch_advanced_result> 

Check if the problem persists after a few days ... or just use the robots.txt file to block the search cataloging URLs.