Skip to Main Content

Python in Digital Scholarship

This guide will provide an introduction to using Python in research and instruction and what resources are available in the Freedman Center.

Web-Scraping Tutorials

Real Python – Web Scraping With BeautifulSoup and Requests

  • A comprehensive tutorial demonstrating how to retrieve web pages using the requests library and parse HTML with BeautifulSoup. Covers element selection, data extraction, pagination handling, and best practices.

DigitalOcean – How to Scrape Websites With BeautifulSoup and Python

  • A step-by-step guide focused on parsing strategies with BeautifulSoup. Shows how to iterate through multiple pages, manage exceptions, and extract structured data from HTML.

Python Web Scraping Tutorial – GeeksforGeeks

  • An in-depth tutorial that surveys several Python scraping tools—such as requests, BeautifulSoup, Selenium, Scrapy, and urllib—and provides sample code for extracting HTML content and navigating site structures.

Web Scraping Tutorial Using Selenium & Python – ScrapingBee Blog

  • A detailed guide to scraping dynamic, JavaScript-heavy websites using Selenium and Python. Includes setup of WebDriver, browser automation techniques (clicking, scrolling), and integration with BeautifulSoup for parsing.

Modern Web Scraping with Python – John Watson Rooney (YouTube)

  • A YouTube playlist by John Watson Rooney covering practical scraping workflows: using requests and BeautifulSoup for static sites, and Selenium for dynamic content, pagination, and authentication.