Processing real-time data using Kinesis data streams
Kinesis is Amazon's streaming service and can be scaled based on requirements. It is highly available in a region. It has a level of persistence that retains data for 24 hours by default or optionally up to 365 days. Kinesis data streams are used for large-scale data ingestion, analytics, and monitoring:
- Kinesis can be ingested by multiple producers and multiple consumers can also read data from the stream. Let's understand this by means of an example in real time. Suppose you have a producer ingesting data to a Kinesis stream and the default retention period is 24 hours, which means the data ingested at 05:00:00 A.M. today will be available in the stream until 04:59:59 A.M. tomorrow. This data won't be available beyond that point and ideally, this should be consumed before it expires or can be stored somewhere if it's critical. The retention period can be extended to a maximum of 365 days at an extra...
