Reader small image

You're reading from  Artificial Intelligence for IoT Cookbook

Product typeBook
Published inMar 2021
Reading LevelIntermediate
PublisherPackt
ISBN-139781838981983
Edition1st Edition
Languages
Right arrow
Author (1)
Michael Roshak
Michael Roshak
author image
Michael Roshak

Michael Roshak is a cloud architect and strategist with extensive subject matter expertise in enterprise cloud transformation programs and infrastructure modernization through designing, and deploying cloud-oriented solutions and architectures. He is responsible for providing strategic advisory for cloud adoption, consultative technical sales, and driving broad cloud services consumption with highly strategic accounts across multiple industries.
Read more about Michael Roshak

Right arrow

Enriching data using Kafka's KStreams and KTables

Often, in IoT, there are external data sources that must be included. This could be weather data that affects the performance of the device or data from other nearby devices. An easy way of doing this is to use Kafka KSQL Server. Like we did in the previous recipe, we are going to use Confluent Cloud's KSQL Server, which you can get if you have a Confluent Cloud subscription.

In this recipe, we are going to get data from a weather service topic and put it into a KTable. A KTable is similar to a database table. All data coming into Kafka comes in key-value pairs. With KTable, when data comes in with a new key, we insert it into our KTable. If it contains a key that already exists in our KTable, we update it. We are also going to convert our topic into a KStream. This allows us to run standard SQL-like queries over our table and stream. By doing this, we can, for example, query the current weather and join it to the engine data...

lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Artificial Intelligence for IoT Cookbook
Published in: Mar 2021Publisher: PacktISBN-13: 9781838981983

Author (1)

author image
Michael Roshak

Michael Roshak is a cloud architect and strategist with extensive subject matter expertise in enterprise cloud transformation programs and infrastructure modernization through designing, and deploying cloud-oriented solutions and architectures. He is responsible for providing strategic advisory for cloud adoption, consultative technical sales, and driving broad cloud services consumption with highly strategic accounts across multiple industries.
Read more about Michael Roshak