So, you want to download information from the Web? Great — but if the data isn’t available via an API, then you’re going to need to scrape it. That means retrieving the HTML, parsing it, and turning into data you can really use. A popular way to do so in Python is scrapy, an open-source framework for crawling and downloading data. In this talk, Karthik Ananth introduces scrapy, and demonstrates why it’s a powerful tool for creating your own crawlers, either for widespread scraping purposes for specific, single-use projects.
The post [Video 389] Karthik Ananth: Scrapy Workshop appeared first on Daily Tech Video.