Free Sample
+ Collection

Instant Apache Hive Essentials How-to

Darren Lee

Leverage your knowledge of SQL to easily write distributed data processing applications on Hadoop using Apache Hive
RRP $14.99

Want this title & more?

$12.99 p/month

Subscribe to PacktLib

Enjoy full and instant access to over 2000 books and videos – you’ll find everything you need to stay ahead of the curve and make sure you can always get the job done.

Book Details

ISBN 139781782169475
Paperback76 pages

About This Book

  • Learn something new in an Instant! A short, fast, focused guide delivering immediate results
  • Learn to use SQL to write Hadoop jobs
  • Add support for data to Hive in your own file formats
  • Understand how the Hive query processor works to optimize common queries

Who This Book Is For

This book is written for data analysts and developers who want to use their current knowledge of SQL to be more productive with Hadoop. It assumes that readers are comfortable writing SQL queries and are familiar with Hadoop at the level of the classic WordCount example.

Table of Contents

Chapter 1: Instant Apache Hive Essentials How-to
Tables and queries (Simple)
Understanding complex data types (Simple)
Using Hive non-interactively (Simple)
Join optimizations (Medium)
Setting the file format (Simple)
Writing a custom SerDe (Intermediate)
Using static partitions (Intermediate)
Using dynamic partitions (Intermediate)
Using functions (Simple)
Adding custom logic with streaming (Intermediate)
Simple user-defined functions (Intermediate)
Advanced user-defined functions (Advanced)
User-defined table-generating functions (Advanced)
User-defined aggregation functions (Advanced)

What You Will Learn

  • Start with the basics of loading data and writing your first query
  • Use de-normalized data efficiently by manipulating complex data types
  • Structure your data and queries to take advantage of Hive’s optimizations
  • Bring your own data files to Hive and teach Hive how to understand them
  • Access the specialized functions built-in to Hive to manipulate your data
  • Use Hive streaming to integrate code written in any language into your Extend Hive with user-defined functions

In Detail

Hadoop provides a robust framework for building distributed applications, but working directly with Hadoop requires writing a lot of code. Adding structure to data and using a higher-level language such as SQL makes working with Hadoop both easier and faster.

"Instant Apache Hive Essentials How-to" contains a series of practical recipes that introduce the power and flexibility of Hive. Starting with your first query, this book will provide step-by-step instructions and behind-the-scenes explanations for how to effectively write MapReduce jobs with SQL.

This book looks at how Hive transforms SQL statements into MapReduce jobs and demonstrates how you can extend Hive to support your own use cases. Its recipes will teach you how to leverage the scale of Hadoop while retaining the benefits of using a structured query language.You will learn how Hive translates a query into MapReduce jobs and explore how to structure your queries for better performance. You will extend Hive to understand your own file formats, simplifying the loading of data into the warehouse. You will finally add your own custom functions to Hive to support whatever use cases you may have.

"Instant Apache Hive Essentials How-to" is a quick introduction for adding Hive to your data toolkit. It is packed with high-level instructions for making Hive work as well as drawing connections to the underlying Hadoop framework to explain how things happen.


Read More