Brought to you by Linode - Build your next big idea @

Episode #50: Web scraping at scale with Scrapy and ScrapingHub

Published Tues, Mar 15, 2016, recorded Tues, Feb 16, 2016.

What do you do when you are working with an amazing web application that, for whatever reason, doesn't have an API? One option is to say I wish that site had an API and give up. Or, you could use scrapy, an open source web scraping framework from Pablo Hoffman and and create your own API!

On episode 50 of Talk Python To Me, we'll talk about how to do this, when it makes sense, and even when it's allowed.

Links from the show:

Pablo Hoffman
Pablo Hoffman
Click to show comments

Individuals: Support this podcast via Patreon or one-time via Square Cash or . Corporate sponsorship opportunities available here.
Become a friend of the show
Stay in the know and get a chance to win our contests.
See our privacy statement about email communications.