Python + Livestream.com

[Guest]

Hi. Does anyone have any experience with scraping video descriptions from Livestream.com? I'd like to automate my workflow so i don't have to manually copy all the descriptions to a Google Sheet for each video i upload.

Im not asking for any finished code but a few examples how to do it would be great.

[espurritado]

scrapy will most likely be the solution you need.

[vorticalbox]

3 hours ago, espurritado said:

scrapy will most likely be the solution you need.

I like robobrowser better, it's the joining of requests and beautofulsoup. Team that with gevent for async threads and you get a pretty fast web scraper.