Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Learning Apache Apex

You're reading from  Learning Apache Apex

Product type Book
Published in Nov 2017
Publisher
ISBN-13 9781788296403
Pages 290 pages
Edition 1st Edition
Languages
Authors (5):
Thomas Weise Thomas Weise
Profile icon Thomas Weise
Ananth Gundabattula Ananth Gundabattula
Profile icon Ananth Gundabattula
Munagala V. Ramanath Munagala V. Ramanath
Profile icon Munagala V. Ramanath
David Yan David Yan
Profile icon David Yan
Kenneth Knowles Kenneth Knowles
Profile icon Kenneth Knowles
View More author details

Table of Contents (17) Chapters

Title Page
Credits
About the Authors
About the Reviewer
www.PacktPub.com
Customer Feedback
Preface
1. Introduction to Apex 2. Getting Started with Application Development 3. The Apex Library 4. Scalability, Low Latency, and Performance 5. Fault Tolerance and Reliability 6. Example Project – Real-Time Aggregation and Visualization 7. Example Project – Real-Time Ride Service Data Processing 8. Example Project – ETL Using SQL 9. Introduction to Apache Beam 10. The Future of Stream Processing

Parsing the data


NycTaxiCsvParser takes in the data from NycTaxiDataReader. It simply splits each line by a comma and outputs Map<String, String> containing individual fields. This is the definition of the input port of the NycTaxiCsvParser operator:

public final transient DefaultInputPort<String> input = new DefaultInputPort<String>() 
{ 
 @Override 
 public void process(String tuple) 
 { 
   String[] values = tuple.split(","); 
   Map<String, String> outputTuple = new HashMap<>(); 
   if (values.length > 18 && StringUtils.isNumeric(values[0])) { 
     outputTuple.put("pickup_time", values[1]); 
     outputTuple.put("pickup_lon", values[5]); 
     outputTuple.put("pickup_lat", values[6]); 
     outputTuple.put("total_fare", values[18]); 
     output.emit(outputTuple); 
   } 
 } 
}; 

As mentioned previously, we are only interested in the pickup time (Key pickup time), pickup lat-lon coordinate (Keys pickup lon and pickup lat), and total payment (Key...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}