My website has a database search; Filling CAPTCHA gives you 5 minutes of search time. There is also special code to detect any automated scripts. I do this because I do not want anyone to mine data on my site.
The problem is that Google does not see the search results when crawling my site. If someone is looking for a string that appears as a result of a search, I would like them to find this page by Googling.
The obvious solution for me is to use a PHP variable $_SERVER['HTTP_USER_AGENT']to bypass CAPTCHA and a special security code for Google bots. My question is whether this is reasonable or not.
Users could then use Google’s cache to view search results without having to populate a CAPTCHA, but can Google use script discovery methods to prevent them from deleting data from these pages?
Or maybe there is some way to get people to $_SERVER['HTTP_USER_AGENT']appear like Google bypassing security measures?
Thanks in advance.
source
share