Reading Time Series Data from Databases
Time series data can be stored in a variety of formats, including flat files (such as CSV, Excel, or Parquet) or database systems. In Chapter 1, we explored reading data from different file types, whether stored locally (on-premise) or remotely in a cloud service such as AWS S3. In this chapter, we will focus on how to retrieve time series data from different database systems.
Databases extend storage capabilities beyond flat files, supporting structured, semi-structured, and unstructured data—including text, images, and media files. They are optimized for efficient read-and-write operations at scale, making them ideal for handling terabytes or even petabytes of data with efficient and optimized data retrieval capabilities.
Modern data architectures typically distinguish between several database paradigms:
- Transactional (OLTP) databases are optimized for handling day-to-day business operations with many small, concurrent...
