Search icon
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Pentaho Data Integration Cookbook - Second Edition - Second Edition

You're reading from  Pentaho Data Integration Cookbook - Second Edition - Second Edition

Product type Book
Published in Dec 2013
Publisher Packt
ISBN-13 9781783280674
Pages 462 pages
Edition 2nd Edition
Languages

Table of Contents (21) Chapters

Pentaho Data Integration Cookbook Second Edition
Credits
About the Author
About the Reviewers
www.PacktPub.com
Preface
Working with Databases Reading and Writing Files Working with Big Data and Cloud Sources Manipulating XML Structures File Management Looking for Data Understanding and Optimizing Data Flows Executing and Re-using Jobs and Transformations Integrating Kettle and the Pentaho Suite Getting the Most Out of Kettle Utilizing Visualization Tools in Kettle Data Analytics Data Structures References Index

Merging rows of two streams with the same or different structures


It's a common requirement to combine two or more streams into a single stream that includes the union of all rows. In these cases, the streams come from different sources and don't always have the same structure. Consequently, combining the streams is not as easy as just putting in a step that freely joins the streams. Issues can quickly arise if row formats and column orders are mixed between streams. This recipe gives you the tips to make it easier.

Suppose that you received data about roller coasters from two different sources. The data in one of those sources looks like the following:

roller_coaster|speed|park|location|country|Year
Top Thrill Dragster|120 mph|Cedar Point|Sandusky, Ohio||2003
Dodonpa|106.8 mph|Fuji-Q Highland|FujiYoshida-shi|Japan|2001
Steel Dragon 2000|95 mph|Nagashima Spa Land|Mie|Japan|2000
Millennium Force|93 mph|Cedar Point|Sandusky, Ohio||2000
Intimidator 305|90 mph|Kings Dominion|Doswell, Virginia...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}