Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Data Engineering with Google Cloud Platform - Second Edition

You're reading from  Data Engineering with Google Cloud Platform - Second Edition

Product type Book
Published in Apr 2024
Publisher Packt
ISBN-13 9781835080115
Pages 476 pages
Edition 2nd Edition
Languages
Author (1):
Adi Wijaya Adi Wijaya
Profile icon Adi Wijaya

Table of Contents (19) Chapters

Preface Part 1: Getting Started with Data Engineering with GCP
Chapter 1: Fundamentals of Data Engineering Chapter 2: Big Data Capabilities on GCP Part 2: Build Solutions with GCP Components
Chapter 3: Building a Data Warehouse in BigQuery Chapter 4: Building Workflows for Batch Data Loading Using Cloud Composer Chapter 5: Building a Data Lake Using Dataproc Chapter 6: Processing Streaming Data with Pub/Sub and Dataflow Chapter 7: Visualizing Data to Make Data-Driven Decisions with Looker Studio Chapter 8: Building Machine Learning Solutions on GCP Part 3: Key Strategies for Architecting Top-Notch Solutions
Chapter 9: User and Project Management in GCP Chapter 10: Data Governance in GCP Chapter 11: Cost Strategy in GCP Chapter 12: CI/CD on GCP for Data Engineers Chapter 13: Boosting Your Confidence as a Data Engineer Index Other Books You May Enjoy

Introduction to Pub/Sub

Pub/Sub is a messaging system. What messaging systems do is receive messages from multiple systems and distribute them to multiple systems. The key here is multiple systems. A messaging system needs to be able to act as a bridge or middleware to many different systems.

The following diagram provides a high-level picture of Pub/Sub:

Figure 6.4 – Pub/Sub terminologies and flows

Figure 6.4 – Pub/Sub terminologies and flows

To understand how to use Pub/Sub, we need to understand the four main terminologies inside Pub/Sub, as follows:

  • Publisher

    The entry point of Pub/Sub is the publisher. Pub/Sub uses the publisher to control incoming messages. Users can write code to publish messages from their applications using programming languages such as Java, Python, Go, C++, C#, Hypertext Preprocessor (PHP), and Ruby. Pub/Sub will store the messages in topics.

  • Topic

    The central point of Pub/Sub is the topic. Pub/Sub stores messages in its internal storage. The sets of...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}