Blackhat SEO - Esrun

Scraping google

March 4, 2007 on 11:23 pm | In Blackhat SEO |

Just to be clear, this blog will still offer scripts, tips and ideas. It’s just that it will also include a few personal posts!

Lately I have been working on some new systems and I really wanted to concentrate on the scraping side of things since this is ultimately the only limit to your spamming! I have picked up several tricks along the way and I’m going to share one of them with you now. At some point in our scraping we have all come across the following:

We’re sorry…

… but your query looks similar to automated requests from a computer virus or spyware application. To protect our users, we can’t process your request right now.

We’ll restore your access as quickly as possible, so try again soon. In the meantime, if you suspect that your computer or network has been infected, you might want to run a virus checker or spyware remover to make sure that your systems are free of viruses and other spurious software.

We apologize for the inconvenience, and hope we’ll see you again on Google.

If you havn’t seen this error before then try searching google for “powered by phpbb”. After a few pages you should see this error. After awhile you will also start being presented with a captcha. You can change your preferences to display 100 results per page which obviously is a start and the chances are if you’re scraping then your script is doing this anyway.

Now go over to the google labs project Google Accessible Search . Google describe this service as “Google Web Search With Results Optimized For Visually Impaired And Blind Users.“. Perform the same search on here and you will not hit the aforementioned error!