YARN Essentials

A comprehensive, hands-on guide to install, administer, and configure settings in YARN

YARN Essentials

Amol Fasale, Nirmal Kumar

A comprehensive, hands-on guide to install, administer, and configure settings in YARN
Mapt Subscription
FREE
$29.99/m after trial
eBook
$12.60
RRP $17.99
Save 29%
Print + eBook
$29.99
RRP $29.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$12.60
$29.99
$29.99p/m after trial
RRP $17.99
RRP $29.99
Subscription
eBook
Print + eBook
Start 30 Day Trial
Subscribe and access every Packt eBook & Video.
 
  • 5,000+ eBooks & Videos
  • 50+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 
Preview in Mapt

Book Details

ISBN 139781784391737
Paperback176 pages

Book Description

YARN is the next generation generic resource platform used to manage resources in a typical cluster and is designed to support multitenancy in its core architecture. As optimal resource utilization is central to the design of YARN, learning how to fully utilize the available fine-grained resources (RAM, CPU cycles, and so on) in the cluster becomes vital.

This book is an easy-to-follow, self-learning guide to help you start working with YARN. Beginning with an overview of YARN and Hadoop, you will dive into the pitfalls of Hadoop 1.x and how YARN takes us to the next level. You will learn the concepts, terminology, architecture, core components, and key interactions, and cover the installation and administration of a YARN cluster as well as learning about YARN application development with new and emerging data processing frameworks.

Table of Contents

Chapter 1: Need for YARN
The redesign idea
Summary
Chapter 2: YARN Architecture
Core components of YARN architecture
YARN scheduler policies
Recent developments in YARN architecture
Summary
Chapter 3: YARN Installation
Single-node installation
The fully-distributed mode
Operating Hadoop and YARN clusters
Web interfaces of the Ecosystem
Summary
Chapter 4: YARN and Hadoop Ecosystems
The Hadoop 2 release
A short introduction to Hadoop 1.x and MRv1
MRv1 versus MRv2
Understanding where YARN fits into Hadoop
Old and new MapReduce APIs
Backward compatibility of MRv2 APIs
Practical examples of MRv1 and MRv2
Summary
Chapter 5: YARN Administration
Container allocation
Container configurations
YARN scheduling policies
YARN multitenancy application support
Administration of YARN
Summary
Chapter 6: Developing and Running a Simple YARN Application
Running sample examples on YARN
Monitoring YARN applications with web GUI
YARN's MapReduce support
The YARN application workflow
Summary
Chapter 7: YARN Frameworks
Apache Samza
Storm-YARN
Apache Spark
Apache Tez
Apache Giraph
HOYA (HBase on YARN)
KOYA (Kafka on YARN)
Summary
Chapter 8: Failures in YARN
ResourceManager failures
ApplicationMaster failures
NodeManager failures
Container failures
Hardware Failures
Summary
Chapter 9: YARN – Alternative Solutions
Mesos
Omega
Corona
Summary
Chapter 10: YARN – Future and Support
What YARN means to the big data industry
Journey – present and future
YARN-supported frameworks
Summary

What You Will Learn

  • Understand how existing MapReduce applications can run on top of YARN and how they are backward compatible
  • Explore the YARN concepts, terminologies, architecture, key components, and interaction between the components
  • Set up a standalone and multi-node clustered YARN environment
  • Design, develop, and run different frameworks such as MapReduce, Apache Storm, Apache Tez, and Giraffe on top of YARN
  • Get to grips with the built-in support for multitenancy in YARN
  • Discover the motivation behind YARN's architecture design, implementations, and why YARN was needed
  • Learn how failures at each level are gracefully handled by the new framework to achieve fault tolerance and scalability

Authors

Table of Contents

Chapter 1: Need for YARN
The redesign idea
Summary
Chapter 2: YARN Architecture
Core components of YARN architecture
YARN scheduler policies
Recent developments in YARN architecture
Summary
Chapter 3: YARN Installation
Single-node installation
The fully-distributed mode
Operating Hadoop and YARN clusters
Web interfaces of the Ecosystem
Summary
Chapter 4: YARN and Hadoop Ecosystems
The Hadoop 2 release
A short introduction to Hadoop 1.x and MRv1
MRv1 versus MRv2
Understanding where YARN fits into Hadoop
Old and new MapReduce APIs
Backward compatibility of MRv2 APIs
Practical examples of MRv1 and MRv2
Summary
Chapter 5: YARN Administration
Container allocation
Container configurations
YARN scheduling policies
YARN multitenancy application support
Administration of YARN
Summary
Chapter 6: Developing and Running a Simple YARN Application
Running sample examples on YARN
Monitoring YARN applications with web GUI
YARN's MapReduce support
The YARN application workflow
Summary
Chapter 7: YARN Frameworks
Apache Samza
Storm-YARN
Apache Spark
Apache Tez
Apache Giraph
HOYA (HBase on YARN)
KOYA (Kafka on YARN)
Summary
Chapter 8: Failures in YARN
ResourceManager failures
ApplicationMaster failures
NodeManager failures
Container failures
Hardware Failures
Summary
Chapter 9: YARN – Alternative Solutions
Mesos
Omega
Corona
Summary
Chapter 10: YARN – Future and Support
What YARN means to the big data industry
Journey – present and future
YARN-supported frameworks
Summary

Book Details

ISBN 139781784391737
Paperback176 pages
Read More

Read More Reviews

Recommended for You

Machine Learning with Spark Book Cover
Machine Learning with Spark
$ 29.99
$ 3.00
Learning Hadoop 2 Book Cover
Learning Hadoop 2
$ 29.99
$ 21.00
Spark Cookbook Book Cover
Spark Cookbook
$ 35.99
$ 25.20
Practical Data Analysis Book Cover
Practical Data Analysis
$ 29.99
$ 21.00
Hadoop MapReduce Cookbook Book Cover
Hadoop MapReduce Cookbook
$ 29.99
$ 21.00
Hadoop Real-World Solutions Cookbook Book Cover
Hadoop Real-World Solutions Cookbook
$ 29.99
$ 21.00