Reader small image

You're reading from  Apache Oozie Essentials

Product typeBook
Published inDec 2015
Reading LevelIntermediate
Publisher
ISBN-139781785880384
Edition1st Edition
Languages
Right arrow
Author (1)
Jagat Singh
Jagat Singh
author image
Jagat Singh

Contacted on 12/01/18 by Davis Anto
Read more about Jagat Singh

Right arrow

Pig Coordinator job v2


We will improve our Coordinator using the concept of Datasets. The code for this section is available at BOOK_CODE_HOME/learn_oozie/ch05/rainfall/v2.

The goal of this section is very simple. We need to learn which dataset instance should be used for processing using the Coordinator dataset parameterization function. We will see them shortly.

The Coordinator for our problem statement is shown in the upcoming screenshot. We are using the Dataset by declaring the definition in line 5 of the screenshot. The corresponding Dataset is defined in the datasets.xml file, as shown in the following code:

<datasets>
  <dataset name="rainfall" frequency="${coord:months(1)}" initial-instance="2015-01-01T00:00Z" timezone="Australia/Sydney">
    <uri-template>${nameNode}/user/hue/learn_oozie/ch05/input/rainfall/${YEAR}/${MONTH}/
    </uri-template>
    <done-flag>_SUCCESS</done-flag>
  </dataset>
  <dataset name="max_rainfall" frequency="$...
lock icon
The rest of the page is locked
Previous PageNext Page
You have been reading a chapter from
Apache Oozie Essentials
Published in: Dec 2015Publisher: ISBN-13: 9781785880384

Author (1)

author image
Jagat Singh

Contacted on 12/01/18 by Davis Anto
Read more about Jagat Singh