Analyze large volumes of data effectively by combining the power of big data processing tools such as Hadoop and Spark Streaming
Work with different kinds of data and perform real-life data operations
Explore best use cases, identify problem areas, and solve them with the best open source tools
Description
This course is your guide to performing real-time data analytics and stream processing with Spark. Use different components and tools such as HDFS, HBase, and Hive to process raw data. Learn how tools such as Hive and Pig aid in this process.
In this course, you will start off by learning data analysis techniques with Hadoop using tools such as Hive. Furthermore, you will learn to apply these techniques in real-world big data applications. Also, you will delve into Spark and its related tools to perform real-time data analytics, streaming, and batch processing on your application.
Finally, you'll learn how to extend your analytics solutions to the cloud.
Please note that this course is based on Hadoop 3.0 but the code used in the course is compatible with Hadoop 3.2.
The code bundle for this video course is available at -
https://github.com/PacktPublishing/Hands-On-Big-Data-Analysis-with-Hadoop-3
What you will learn
Store data with HDFS and learn in detail about HBase
Share and access data in a SQL-like interface for HDFS
Analyze real-time events using Spark Streaming
Perform complex big data analytics using MapReduce
Analyze data to perform complex processing with Hive and Pig
Explore functional programming using Spark
Learn to import data using Sqoop
What do you get with a video?
Download this video in MP4 format
Access this title in our online reader with advanced features
DRM FREE - Read whenever, wherever and however you want
Tomasz Lelek is a Software Engineer who programs mostly in Java and Scala. He is a fan of microservice architectures and functional programming. He dedicates considerable time and effort to being better every day. Recently, he's been delving into big data technologies such as Apache Spark and Hadoop. He is passionate about nearly everything associated with software development.
Tomasz thinks that we should always try to consider different solutions and approaches before solving a problem. Recently, he was a speaker at several conferences in Poland - Confitura and JDD (Java Developer's Day) and also at Krakow Scala User Group. You can find the JDD video here: https://www.youtube.com/watch?v=BnORjQbnZNQ&t - ML Spark talk.
He also conducted a live coding session at Geecon Conference. He is currently working on this website using ML: http://www.allegro.pl
How can I download a video package for offline viewing?
Login to your account at Packtpub.com.
Click on "My Account" and then click on the "My Videos" tab to access your videos.
Click on the "Download Now" link to start your video download.
How can I extract my video file?
All modern operating systems ship with ZIP file extraction built in. If you'd prefer to use a dedicated compression application, we've tested WinRAR / 7-Zip for Windows, Zipeg / iZip / UnRarX for Mac and 7-Zip / PeaZip for Linux. These applications support all extension files.
How can I get help and support around my video package?
If your video course doesn't give you what you were expecting, either because of functionality problems or because the content isn't up to scratch, please mail customercare@packt.com with details of the problem. In addition, so that we can best provide the support you need, please include the following information for our support team.
Video
Format watched (HTML, MP4, streaming)
Chapter or section that issue relates to (if relevant)
System being played on
Browser used (if relevant)
Details of support
Why can’t I download my video package?
In the even that you are having issues downloading your video package then please follow these instructions:
Disable all your browser plugins and extensions: Some security and download manager extensions can cause issues during the download.
Download the video course using a different browser: We've tested downloads operate correctly in current versions of Chrome, Firefox, Internet Explorer, and Safari.