Python Web Scraping

Learning PathSkills: Web Scraping, HTTP Requests, Data Parsing

Python Web Scraping Category Artwork

Web scraping is about downloading structured data from the web, selecting some of that data, and passing along what you selected to another process. With this learning path you’ll learn the core Python technologies and skills you need to build your own web scraper.

Additional Resources

Python Web Scraping

Learning Path ⋅ 6 Resources

Python’s Requests Library (Guide)

Course

Making HTTP Requests With Python

The "requests" library is the de facto standard for making HTTP requests in Python. It abstracts the complexities of making requests behind a beautiful, simple API so that you can focus on interacting with services and consuming data in your application. This course shows you how to work effectively with "requests", from start to finish.

Beautiful Soup: Build a Web Scraper With Python

Course

Web Scraping With Beautiful Soup and Python

In this course, you'll walk through the main steps of the web scraping process. You'll learn how to write a script that uses Python's requests library to scrape data from a website. You'll also use Beautiful Soup to extract the specific pieces of information that you're interested in.

Web Scraping in Python

Tutorial

A Practical Introduction to Web Scraping in Python

Learn all about web scraping in Python. You'll see how to parse data from websites and interact with HTML forms using tools such as Beautiful Soup and MechanicalSoup.

Working With JSON Data in Python

Course

Working With JSON Data in Python

Learn how to work with Python's built-in "json" module to serialize the data in your programs into JSON format. Then, you'll deserialize some JSON from an online API and convert it into Python objects.

Python CSV Parsing

Course

Reading and Writing CSV Files

This short course covers how to read and write data to CSV files using Python's built in "csv" module and the "pandas" library. You'll learn how to handle standard and non-standard data such as CSV files without headers, or files containing delimeters in the data.

Modern Web Automation with Python and Selenium

Tutorial

Modern Web Automation With Python and Selenium

Your guide to learning advanced Python web automation techniques: Selenium, headless browsing, exporting scraped data to CSV, and wrapping your scraping code in a Python class.

Got feedback on this learning path?

Looking for real-time conversation? Visit the Real Python Community Chat or join the next “Office Hours” Live Q&A Session. Happy Pythoning!

« Browse All Learning Paths