Engineer Man has a great video demonstrating the power of Python and Beautiful Soup when applied to web scraping. Long time readers will know that I have long been a fan of web scraping, often employing in apps. I’ve even written a C# library and a “Screen Scrapers Manifesto” that implored content creators to create APIs and if they didn’t, we’d just grab the data anyways. 😉
Unfortunately, said manifesto was wiped out last year.
In any case, enjoy the video and browse the source code to learn how to be a lean, mean screen scraping machine.