Pentaho 3.2 Data Integration: Beginner's Guide
|Also available on:|
- Get started with Pentaho Data Integration from scratch.
- Create a simple but complete Datamart Project that will cover all key features of PDI.
- Part of Packt's Beginner's Guide series: Each task gradually develops from the previous task with an organized sequence of instructions accompanied with relevant explanation and a set of challenging tasks that the reader will be able to accomplish.
Book DetailsLanguage : English
Paperback : 492 pages [ 235mm x 191mm ]
Release Date : April 2010
ISBN : 1847199542
ISBN 13 : 9781847199546
Author(s) : María Carina Roldán
Topics and Technologies : All Books, Big Data and Business Intelligence, Data, Beginner's Guides, Open Source
Table of Contents
Chapter 1: Getting started with Pentaho Data Integration
Chapter 2: Getting Started with Transformations
Chapter 3: Basic data manipulation
Chapter 4: Controlling the Flow of Data
Chapter 6: Transforming the Row Set
Chapter 7: Validating Data and Handling Errors
Chapter 8: Working with Databases
Chapter 9: Performing Advanced Operations with Databases
Chapter 10: Creating Basic Task Flows
Chapter 11: Creating Advanced Transformations and Jobs
Chapter 12: Developing and Implementing a Simple Datamart
Chapter 13: Taking it Further
Appendix A: Working with Repositories
Appendix B: Pan and Kitchen: Launching Transformations and Jobs from the Command Line
Appendix C: Quick Reference: Steps and Job Entries
Appendix D: Spoon Shortcuts
Appendix E: Introducing PDI 4 Features
Appendix F: Pop Quiz Answers
Download the code and support files for this book.
Please let us know if you have found any errors not listed on this list by completing our errata submission form. Our editors will check them and add them to this list. Thank you.
Errata- 6 submitted: last submission 25 Oct 2013
Errata type: Technical | Page number: 55 |
In Chapter 2, p55, there is something missing at step 19 (Double-click the text file output step icon and give it a name). In fact, we first have to go to Content to check Append. So, after the item 20, it should be the following “In the Content tab check the Append option and uncheck the Header option.”
Errata type: Technical | Page number: 77
In chapter 3, page 77, the step 9 is wrong (Create a hop from the Text file input step to the Calculator step). It should be: Create a hop from the Select Values step to the Calculator step.
Errata type: Technical | Page number: 91 |
In chapter 3, page 91, the step 12 (Select the Dummy and the Group by steps)is wrong. It should be: Select the Dummy and the Sort rows steps.
Errata type: Technical | Page number: 181 |
In chapter 6, page 181, the figure in step 6 doesn't show the reality. The error is the text inside the “Type field” option. Instead of type it should be “class”.
Errata type: Technical | Page number: 210 |
In Chapter 7, page 211, step 14. There is something missing to make it work. We should also uncheck the "Null Allowed?" checkbox. Otherwise it doesn't work.
Errata type: Typo | Page number: 53 |
Step 5 "drag the "Get system info" icon to the canvas" should be drag the "Get system info" steps in the flow.
Errata type: Technical | Page number: 55 |
In Chapter 2, step 15 states to click the Content tab and then the Get fields button. However since the file inputs were defined as a command line argument in step 9, this causes an error.
To solve it: If the reader has the PDI Cookbook, he/she can read the tip on page 76, which basically states that: When you don't specify the name and location you will not be able to use the Get Fields button. The trick is: uncheck the options in "Accept filenames from previous steps", fill the File tab with the name of a sample, real file, then click the Get Fields button. Finally restore the settings in the File tab.
What you will learn from this book
- Install Penataho Data Integration and get familiar with the graphical designer—Spoon
- Work with files to get data from simple input sources, preview, and send it back in any of the common output formats
- Perform basic transformation operations on data such as performing calculations, adding constants, counting, filtering, ordering, and searching data
- Solve real-world problems by manipulating the flow of data by combining or splitting it
- Solve sophisticated problems such as normalizing data from pivoted tables with ease
- Explore the various PDI options to validate data and to handle errors
- Connect to a database engine of your choice to get and store information coming from any source
- Perform advanced operations with databases such as loading data dimensions
- Create advanced processes such as nesting jobs, iterating on jobs and transformations, and creating subtransformations
- Implement business processes by scheduling tasks, checking conditions, organizing files and folders, sending emails with alerts, and treating errors in a way that meets your requirements
Pentaho Data Integration (a.k.a. Kettle) is a full-featured open source ETL (Extract, Transform, and Load) solution. Although PDI is a feature-rich tool, effectively capturing, manipulating, cleansing, transferring, and loading data can get complicated.
This book is full of practical examples that will help you to take advantage of Pentaho Data Integration's graphical, drag-and-drop design environment. You will quickly get started with Pentaho Data Integration by following the step-by-step guidance in this book. The useful tips in this book will encourage you to exploit powerful features of Pentaho Data Integration and perform ETL operations with ease.
Starting with the installation of the PDI software, this book will teach you all the key PDI concepts. Each chapter introduces new features, allowing you to gradually get involved with the tool. First, you will learn to work with plain files, and to do all kinds of data manipulation. Then, the book gives you a primer on databases and teaches you how to work with databases inside PDI. Not only that, you'll be given an introduction to data warehouse concepts and you will learn to load data in a data warehouse. After that, you will learn to implement simple and complex processes.
Once you've learned all the basics, you will build a simple datamart that will serve to reinforce all the concepts learned through the book.
A practical, easy-to-read guide that gives you full understanding of the Pentaho Data Integration tool and shows you how to use it to your advantage to manipulate data
As part of Packt's Beginner's Guide, this book focuses on teaching by example. The book walks you through every aspect of PDI, giving step-by-step instructions in a friendly style, allowing you to learn in front of your computer, playing with the tool. The extensive use of drawings and screenshots make the process of learning PDI easy. Throughout the book numerous tips and helpful hints are provided that you will not find anywhere else.
The book provides short, practical examples and also builds from scratch a small datamart intended to reinforce the learned concepts and to teach you the basics of data warehousing.
Who this book is for
This book is for software developers, database administrators, IT students, and everyone involved or interested in developing ETL solutions, or, more generally, doing any kind of data manipulation. If you have never used PDI before, this will be a perfect book to start with.
You will find this book is a good starting point if you are a database administrator, data warehouse designer, architect, or any person who is responsible for data warehouse projects and need to load data into them.
You don't need to have any prior data warehouse or database experience to read this book. Fundamental database and data warehouse technical terms and concepts are explained in easy-to-understand language.