The usability of infrastructure in the cloud has been increasing at a rapid speed. The companies who were worrying about adopting the cloud for its computing and storage needs due to security and availability now have enough confidence as there have been lots of improvements on the architecture and features being made by different cloud service providers. Apache Hadoop started with on premises deployment and during the initial years of the Hadoop foundation, the Hadoop infrastructure was mainly set up using self-managed infrastructure. But over the last few years, cloud service providers have given focus to the Hadoop infrastructure and now we have everything that's needed for a big data/Hadoop setup. Today, almost every company moving to big data adaptability is using the cloud for their data storage and infrastructure needs. In this section, we will talk about how the logical architecture for Hadoop looks over the cloud:
- Ingestion layer: Data ingestion...
