6

What kind of software allows you to list all businesses located in a specific suburb? I am thinking of a web scraper that will scrape a google search (of businesses in a suburb) but maybe there is another option I am not aware of?

I am looking to find out the following information:

  • Business Name
  • Business Type/Industry
  • Business email contact

I am considering using Scrapy to crawl a google search results page. The problem is determining the business name, industry. Email addresses can easily be found by using regular expressions but industry and business name is harder. I could use Google's Prediction API to 'learn' where this information is generally located (in HTML tags - eg. <h1>, etc.) but I am hoping there could be existing software or even websites that can already do this. Having a website like Yelp could be another way of scraping because the business name is always located in the same location of the page.

  • 1
    Isn't that tool called "Yellow Pages", and searchable itself? Companies usually have phone numbers, and want to be found – so they're usually listed there. – Izzy Mar 14 '15 at 12:23
  • Are you aware of our sister site, Open Data ? – Mawg Oct 22 '18 at 9:45
0

Having a website like Yelp could be another way of scraping because the business name is always located in the same location of the page.

You are close to the deal. I recommend you to get any scraping software (some of them have free options), plug in a proxy service and scrape against business directories (yellow pages, white pages, etc.). See tips and tricks.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.