How do I "obtain" data for all bars/clubs in US to a database. Yelp API?

What I am trying to do is create a database of all bars in the united states. I need this database to be updated semi-regularly (every week or so) to include newly opened bars.

The开发者_运维问答 problem with the yelp api is they will only return 20 results. There are over 800 bars within a 5 mile radius of me. How can I realistically achieve my goal?

you need to write a crawler that will spider the site to get the link structure than visit each page and scrape the listings. Alternatively you can use the API and just make as many requests as you need to get all of the results.

If you can access the data from web pages, then you can use IRobotSoft Web Scraper to extract the data and save them to database. Check if demos here http://irobotsoft.com/help/ are similar to what you want.