Search icon Close icon
Search icon
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Pandas 1.x Cookbook - Second Edition

You're reading from  Pandas 1.x Cookbook - Second Edition

Product type Book
Published in Feb 2020
Publisher Packt
ISBN-13 9781839213106
Pages 626 pages
Edition 2nd Edition
Languages
Concepts
Authors (2):
Matt Harrison Matt Harrison
Profile icon Matt Harrison
LinkedIn
Matt Harrison is an author, speaker, corporate trainer, and consultant. He authored the popular Learning the Pandas Library and Illustrated Guide to Python 3. He runs MetaSnake, which provides corporate and online training on Python and Data Science. In addition, he offers consulting services. He has worked on search engines, configuration management, storage, BI, predictive modeling, and in a variety of domains.
See other products by Matt Harrison
Theodore Petrou Theodore Petrou
Profile icon Theodore Petrou
LinkedIn
Theodore Petrou is the founder of Dunder Data, a training company dedicated to helping teach the Python data science ecosystem effectively to individuals and corporations. Read his tutorials and attempt his data science challenges at the Dunder Data website.
See other products by Theodore Petrou
View More author details

Table of Contents (17) Chapters

Preface Pandas Foundations Essential DataFrame Operations Creating and Persisting DataFrames Beginning Data Analysis Exploratory Data Analysis Selecting Subsets of Data Filtering Rows Index Alignment Grouping for Aggregation, Filtration, and Transformation Restructuring Data into a Tidy Form Combining Pandas Objects Time Series Analysis Visualization with Matplotlib, Pandas, and Seaborn Debugging and Testing Pandas Other Books You May Enjoy
Index

Reading HTML tables

You can use pandas to read HTML tables from websites. This makes it easy to ingest tables such as those found on Wikipedia or other websites.

In this recipe, we will scrape tables from the Wikipedia entry for The Beatles Discography. In particular, we want to scrape the table in the image that was in Wikipedia during 2019:

Wikipedia table for studio albums

Wikipedia table for studio albums

How to do it...

  1. Use the read_html function to load all of the tables from https://en.wikipedia.org/wiki/The_Beatles_discography: 
    >>> url = https://en.wikipedia.org/wiki/The_Beatles_discography
>>> dfs = pd.read_html(url)
>>> len(dfs)
51
  2. Inspect the first DataFrame: 
    >>> dfs[0]
  The Beatles discography The Beatles discography.1
0  The Beat...             The Beat...
1  Studio a...                      23
2  Live albums                       5
3  Compilat...                      53
4  Video al...                 ...
lock icon The rest of the chapter is locked
arrow left Previous Chapter
Chapter 1 of 17
Next Chapter arrow right
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Sign up now
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Start free trial
Renews at $15.99/month. Cancel anytime}

Authors (2)

Left arrow icon
Profile icon Matt Harrison
LinkedIn
Matt Harrison is an author, speaker, corporate trainer, and consultant. He authored the popular Learning the Pandas Library and Illustrated Guide to Python 3. He runs MetaSnake, which provides corporate and online training on Python and Data Science. In addition, he offers consulting services. He has worked on search engines, configuration management, storage, BI, predictive modeling, and in a variety of domains.
See other products by Matt Harrison
Profile icon Theodore Petrou
LinkedIn
Theodore Petrou is the founder of Dunder Data, a training company dedicated to helping teach the Python data science ecosystem effectively to individuals and corporations. Read his tutorials and attempt his data science challenges at the Dunder Data website.
See other products by Theodore Petrou
Right arrow icon

Other recommended products

Related to this chapter
Left arrow icon
Mastering Exploratory Analysis with pandas
Mastering Exploratory Analysis with pandas
Exploratory data analysis exploits the visual properties of the datasets that are commonly used by data scientists. It helps you build custom data pipelines to address data analysis tasks. This book uses pandas, the most popular Python library for data analysis, and helps you build end-to-end exploratory data-analysis solutions
Sep 2018 4 hours 40 minutes
Python Data Cleaning Cookbook
Python Data Cleaning Cookbook
The book shows you how to view data from multiple perspectives, including data frame and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations. You will learn to manipulate data and get them down to a form that can be useful for making the right decisions.
Dec 2020 14 hours 32 minutes
Learning pandas
Learning pandas
Pandas is a popular Python package used for practical, real world data analysis. It provides efficient fast, high-performance data structures that makes data exploration and analysis very easy. This learner's guide will help you through a comprehensive set of features provided by the pandas library to perform efficient data manipulation and analysis.
Jun 2017 14 hours 52 minutes
Hands-On Data Analysis with NumPy and Pandas
Hands-On Data Analysis with NumPy and Pandas
In this book, you will explore two important Python packages used by Data Analysts, NumPy & pandas. You will dive into different concepts such as reading, sorting, grouping of data, and also learn how to work with different data formats for your data analysis projects.
Jun 2018 5 hours 36 minutes
Mastering pandas
Mastering pandas
pandas is a popular Python library used by data scientists and analysts worldwide to manipulate and analyze their data. This book presents useful techniques and real-world examples on getting the most out of pandas for expert-level data manipulation, analysis and visualization.
Oct 2019 22 hours 28 minutes
Hands-On Data Analysis with Pandas
Hands-On Data Analysis with Pandas
This book will be a handy guide to quickly learn pandas and understand how it can empower you in the exciting world of data manipulation, analysis, and data science. You will learn how to use pandas to perform numeric and statistical analysis using real-world examples. You will also visualize statistical data and apply pandas to different domains.
Jul 2019 24 hours 40 minutes
Hands-On Data Analysis with Pandas
Hands-On Data Analysis with Pandas
Knowing how to work with data to extract insights generates significant value. This book will help you to develop data analysis skills using a hands-on approach and real-world data. You’ll get up to speed with pandas 1.x in no time and build some software engineering skills in the process, vastly expanding your data science toolbox.
Apr 2021 26 hours 16 minutes
Right arrow icon

Personalised recommendations for you

Based on your interests and search pattern
Left arrow icon
C++ Programming for Linux Systems
C++ Programming for Linux Systems
This book covers the essential system programming tools and helps you explore the features of C++20. It emphasizes important details to maintain code quality and tackle everyday challenges of developing software for high performance, optimization, and more.
Sep 2023 9 hours 36 minutes
Expert C++
Expert C++
Discover advanced programming techniques, the latest features of C++17 and C++20, and best practices for memory management, debugging, testing, and large-scale application design with Expert C++. Ideal for experienced developers advancing to proficient programmers and building professional-grade C++ applications.
Aug 2023 20 hours 8 minutes
iOS 17 Programming for Beginners
iOS 17 Programming for Beginners
iOS 17 Programming for Beginners, Eighth Edition is your comprehensive guide to learning the art of iOS app development. Whether you dream of creating the next chart-topping app or simply want to enhance your programming skills, this book is your trusted companion on this exciting journey.
Oct 2023 20 hours 8 minutes
Developer Career Masterplan
Developer Career Masterplan
Written by industry experts that have spent the last 20+ years helping developers grow their career path towards senior developer positions and beyond. This book provides a comprehensive guide, sharing examples and stories from their global careers. By the end, you’ll have the knowledge to create a clear career progression plan as a technical professional.
Sep 2023 10 hours 20 minutes
Refactoring with C#
Refactoring with C#
In Refactoring with C#, you’ll explore the process of safely refactoring modern .NET code using Visual Studio features, advanced unit tests, AI assistance, and custom Roslyn analyzers.
Nov 2023 14 hours 28 minutes
Python Real-World Projects
Python Real-World Projects
Amplify your developer journey by curating a dynamic project portfolio that outshines traditional resumes. Delve into the Python realm through immersive projects, mastering core concepts while constructing comprehensive modules and applications. From data acquisition prowess to impactful data visualization, Python Real-World Projects arms you with essential skills to beat the competition.
Sep 2023 15 hours 56 minutes
The MVVM Pattern in .NET MAUI
The MVVM Pattern in .NET MAUI
The MVVM Pattern in .NET MAUI enables developers to master MVVM principles and effectively apply them to .NET MAUI. This book uses real-life examples and covers complex problems to help you successfully apply MVVM with .NET MAUI to confidently develop robust and high-performing cross-platform apps.
Nov 2023 12 hours 52 minutes
Extending Microsoft Business Central with Power Platform
Extending Microsoft Business Central with Power Platform
Extending Business Central with the Power Platform is a step-by-step guide for Business Central professionals to create solutions that automate business processes, explain complex workflow approvals, and integrate with hundreds of other systems, without traditional development. It’ll guide you in customizing Business Central with Power Platform.
Aug 2023 15 hours 16 minutes
Extending Microsoft Business Central with Power Platform
Extending Microsoft Business Central with Power Platform
Extending Business Central with the Power Platform is a step-by-step guide for Business Central professionals to create solutions that automate business processes, explain complex workflow approvals, and integrate with hundreds of other systems, without traditional development. It’ll guide you in customizing Business Central with Power Platform.
Aug 2023 15 hours 16 minutes
Quantum Computing Algorithms
Quantum Computing Algorithms
The book emphasizes intuitive ideas behind quantum algorithms in ways that other books don’t cover, striking a careful balance between no math and too much math. To get the most from this book, you should be comfortable with basic algebra and writing simple computer code. No prior understanding of quantum physics is needed to get started.
Sep 2023 11 hours 24 minutes
Python – Complete Python, Django, Data Science and ML Guide
Python – Complete Python, Django, Data Science and ML Guide
Unlock Python's full potential with this 50+ hour course! From programming to web and game development, data manipulation, and machine learning, gain the skills required to succeed in various Python-related careers. With practical tasks, hands-on experience, and a strong foundation in Python, you'll be ready to tackle real-world challenges and take advantage of the many opportunities this versatile language offers.
Nov 2023 50 hours 30 minutes
Python – Complete Python, Django, Data Science and ML Guide
Python – Complete Python, Django, Data Science and ML Guide
Unlock Python's full potential with this 50+ hour course! From programming to web and game development, data manipulation, and machine learning, gain the skills required to succeed in various Python-related careers. With practical tasks, hands-on experience, and a strong foundation in Python, you'll be ready to tackle real-world challenges and take advantage of the many opportunities this versatile language offers.
Nov 2023 50 hours 30 minutes
Right arrow icon