Tonight I gave a demonstration of basic web crawling and scraping in Python, using PhantomJS and Selenium. The slides are brief, and are in PPTX and PDF.
Note: These pages are still being written, and so the examples are currently incomplete.
Want to see what search terms get your site on the first page of Yahoo results? Here's a basic example for doing this.
Want to crawl the web by finding and following links on web pages? Here's a simple web crawler example.
How to Fix a Transparent Background in a PhantomJS Screenshot (Python 3, Selenium)
Leave a comment