Start Here
Learn Python

Start Learning
Your Learning Plan →Your personalized Python learning plan Python Tutorials →In-depth articles and video courses Learning Paths →Guided study plans for accelerated learning

Practice
Quizzes & Exercises →Check your learning progress Browse Topics →Focus on a specific area or skill level Reference →Concise definitions for common Python terms

Get Help
Code Mentor →BetaPersonalized code assistance & learning tools Office Hours →Live Q&A calls with Python experts Community Chat →Learn with other Pythonistas

Go Deeper
Live Courses →Live, instructor-led Python courses Books →Round out your knowledge and learn offline Podcast →Hear what’s new in the world of Python

Unlock All Content and Become a Python Expert →Get unlimited access to all Real Python has to offer

Unlock All Content →Become a Python Expert
More
Learner Stories Python Newsletter Python Job Board Meet the Team Become a Contributor

Search

/

Join
Sign‑In

Loading exercise...

Exercise: Build the Job Pipeline

Martin Breuss

Web Scraping With Beautiful Soup and Python Martin Breuss 11:30

Recommended Tutorial Course Slides (.pdf) Sample Code (.zip) Ask a Question

Discussion

Become a Member to join the conversation.

Course Contents

Overview

90%

Web Scraping With Beautiful Soup and Python (Overview) 02:45

Introduction to Web Scraping 02:53

The Challenge of Variety 01:17

The Challenge of Durability 01:55

APIs: An Alternative to Web Scraping 04:54

A Message From the Future 02:57

Inspect Your Data Source (Introduction) 01:11

Explore the Website 03:48

Decipher the Information in URLs 06:29

Inspect the Site Using Developer Tools 05:43

Inspect Your Data Source (Recap) 02:11

Scrape HTML Content From a Page (Introduction) 02:01

Static Websites 07:07

Hidden Websites 02:38

Dynamic Websites 05:21

Scrape HTML Content From a Page (Recap) 03:07

Exercise: Fetch the Jobs Page 08:00

Parse HTML Code With Beautiful Soup (Introduction) 01:52

Make a Soup 03:03

Find Elements by ID 02:53

Find Elements by HTML Class Name 04:53

Extract Text From HTML Elements 04:37

Exercise: Find Jobs in the Soup 08:00

Extract Attributes From HTML Elements 08:16

Exercise: Get the Posting Dates 08:00

Parse HTML Code With Beautiful Soup (Recap) 06:20

Your Turn: Build a Pipeline 05:33

Exercise: Build the Job Pipeline 11:30

Web Scraping With Beautiful Soup and Python (Quiz) 14:30

Web Scraping With Beautiful Soup and Python (Summary) 08:39

© 2012–2026 Real Python ⋅ Privacy Policy