Web Scraping
- Buy now
- Learn more
Welcome

Welcome to Web Scraping
What is scraping?
Scraping is a competitive advantage
Non-marketing use cases for scraping
[BONUS] Real world scraping case studies
Deciding what to scrape

Using the browser to find datapoints
Finding more specific elements
Summarizing data extraction challenges
Setting up your environment

Installing Ruby, Watir, and Webdrivers
Building our web scraper

Scraping and web development terminology
Scraping an app listing (Part 1)
Scraping an app listing (Part 2)
Fixing our Rating lookup
Using regex to sanitize results
Finding all app store listings
Scraping a sitemap with Nokogiri
Scraper upgrades

Upgrading to OOP (objected oriented programming)
Handling errors and anti-scraper workarounds
Using our scraper

Saving data to a spreadsheet
Scraping in a headless browser
Scraping effortlessly from the command line
[BONUS] Autosaving our results
Next steps

Three more performance improvement ideas
Request and thank you

Scraper upgrades

Web Scraping
- Buy now
- Learn more
Welcome
- Welcome to Web Scraping
- What is scraping?
- Scraping is a competitive advantage
- Non-marketing use cases for scraping
- [BONUS] Real world scraping case studies
Deciding what to scrape
- Using the browser to find datapoints
- Finding more specific elements
- Summarizing data extraction challenges
Setting up your environment
- Installing Ruby, Watir, and Webdrivers
Building our web scraper
- Scraping and web development terminology
- Scraping an app listing (Part 1)
- Scraping an app listing (Part 2)
- Fixing our Rating lookup
- Using regex to sanitize results
- Finding all app store listings
- Scraping a sitemap with Nokogiri
Scraper upgrades
- Upgrading to OOP (objected oriented programming)
- Handling errors and anti-scraper workarounds
Using our scraper
- Saving data to a spreadsheet
- Scraping in a headless browser
- Scraping effortlessly from the command line
- [BONUS] Autosaving our results
Next steps
- Three more performance improvement ideas
- Request and thank you

Performance improvements to handle errors and other things that can go wrong while scraping 1000's of websites.

2 Lessons