Search icon
Subscription
0
Cart icon
Close icon
You have no products in your basket yet
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
MySQL 8 for Big Data

You're reading from  MySQL 8 for Big Data

Product type Book
Published in Oct 2017
Publisher Packt
ISBN-13 9781788397186
Pages 296 pages
Edition 1st Edition
Languages
Concepts
Authors (4):
Shabbir Challawala Shabbir Challawala
Profile icon Shabbir Challawala
Chintan Mehta Chintan Mehta
Profile icon Chintan Mehta
Kandarp Patel Kandarp Patel
Profile icon Kandarp Patel
Jaydip Lakhatariya Jaydip Lakhatariya
Profile icon Jaydip Lakhatariya
View More author details

Table of Contents (17) Chapters

Title Page
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Customer Feedback
Preface
1. Introduction to Big Data and MySQL 8 2. Data Query Techniques in MySQL 8 3. Indexing your data for High-Performing Queries 4. Using Memcached with MySQL 8 5. Partitioning High Volume Data 6. Replication for building highly available solutions 7. MySQL 8 Best Practices 8. NoSQL API for Integrating with Big Data Solutions 9. Case study: Part I - Apache Sqoop for exchanging data between MySQL and Hadoop 10. Case study: Part II - Real time event processing using MySQL applier

Real-time integration with MySQL Applier


There are many MySQL applier packages available on GitHub. We can use any of them which provides framework for replication and an example of real-time replication:

  • Flipkart/MySQL-replication-listener
  • SponsorPay/MySQL-replication-listener
  • bullsoft/MySQL-replication-listener

For our configuration, let's use Flipkart/MySQL-replication-listener. You can clone the Git library using the following command:

$ git clone https://github.com/Flipkart/MySQL-replication-listener.git

Here are some environment variables required by the package. Make sure that all are set properly.

  • HADOOP_HOME: The Hadoop root directory path
  • CMAKE_MODULE_PATH: The path of the root directory where FindHDFS.cmake and FindJNI.cmake files are located in HDFS
  • HDFS_LIB_PATHS: The path of the libhdfs.so file available in HADOOP
  • JAVA_HOME: You need to set the Java home path for this variable

Now build and compile all the libraries using the following command:

$ cd src
$ cmake . -DCMAKE_MODULE_PATH:String...
lock icon The rest of the chapter is locked
arrow left Previous Chapter
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime}