Quantcast
Channel: Planet Python
Viewing all articles
Browse latest Browse all 22462

Talk Python to Me: #50 Web scraping at scale with Scrapy and ScrapingHub

$
0
0
What do you do when you are working with an amazing web application that, for whatever reason, doesn't have an API? One option is to say I wish that site had an API and give up. Or, you could use scrapy, an open source web scraping framework from Pablo Hoffman and <a href='scrapinghub.com'>scrapinghub.com</a> and create your own API! <br/> <br/> On episode 50 of Talk Python To Me, we'll talk about how to do this, when it makes sense, and even when it's allowed. <br/> <br/> Links from the show: <br/> <div style="font-size: .85em;"> <br/> <b>Scrapy Project</b>: <a href='http://scrapy.org/' target='_blank'>scrapy.org</a> <br/> <b>Scraping Hub</b>: <a href='http://scrapinghub.com/' target='_blank'>scrapinghub.com</a> <br/> <b>Pablo on Twitter</b>: <a href='https://twitter.com/PabloHoffman' target='_blank'>@PabloHoffman</a> <br/> <b>Pablo' site</b>: <a href='http://pablohoffman.com/' target='_blank'>pablohoffman.com</a> <br/> <br/> <b>Michael's Video Project</b>: <br/> <a href='https://blog.michaelckennedy.net/2016/02/16/im-building-20-online-python-courses-and-i-need-your-help-video-course-library-announced/' target='_blank'>blog.michaelckennedy.net/2016/02/16/im-building-20-online-python-courses-and-i-need-your-help-video-course-library-announced</a> <br/> </div>

Viewing all articles
Browse latest Browse all 22462

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>