Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Analytics for the Internet of Things (IoT)

You're reading from  Analytics for the Internet of Things (IoT)

Product type Book
Published in Jul 2017
Publisher Packt
ISBN-13 9781787120730
Pages 378 pages
Edition 1st Edition
Languages
Author (1):
Andrew Minteer Andrew Minteer
Profile icon Andrew Minteer

Table of Contents (20) Chapters

Title Page
Credits
About the Author
About the Reviewer
www.PacktPub.com
Customer Feedback
Preface
Defining IoT Analytics and Challenges IoT Devices and Networking Protocols IoT Analytics for the Cloud Creating an AWS Cloud Analytics Environment Collecting All That Data - Strategies and Techniques Getting to Know Your Data - Exploring IoT Data Decorating Your Data - Adding External Datasets to Innovate Communicating with Others - Visualization and Dashboarding Applying Geospatial Analytics to IoT Data Data Science for IoT Analytics Strategies to Organize Data for Analytics The Economics of IoT Analytics Bringing It All Together

Managing data lakes


Data lakes are places used to dump tons of potentially valuable data from multiple sources. Some sources will be IoT devices, while some sources will be internal company data such as production, purchasing, or customer service records. The concept is to put all of this variety of data in one place so it can be accessible through a unified interface. In the case of Hadoop, the data lake would be stored in HDFS and probably accessed through Hive or Spark.

When data lakes turn into data swamps

Swamps are formed when water flows into an area where it collects and stagnates. Algae covers over the water. When a data lake has a mass of raw data flowing in but no organization and little usage of it to mix up the waters, it becomes what is facetiously referred to as a data swamp.

This often happens when the decision is made to copy data from many systems into one area, such as HDFS, without any changes to it. Analysts can find it difficult to access due to security restrictions....

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}