Scaling Big Data with Hadoop and Solr

By combining Apache Hadoop and Solr you can build super-efficient, high-speed enterprise search engines, and this book takes you through every stage of the process with a practical tutorial. Written specifically for Java programmers.

Scaling Big Data with Hadoop and Solr

Hrishikesh Vijay Karambelkar

By combining Apache Hadoop and Solr you can build super-efficient, high-speed enterprise search engines, and this book takes you through every stage of the process with a practical tutorial. Written specifically for Java programmers.
Mapt Subscription
FREE
$29.99/m after trial
eBook
$18.90
RRP $26.99
Save 29%
Print + eBook
$44.99
RRP $44.99
What do I get with a Mapt Pro subscription?
  • Unlimited access to all Packt’s 5,000+ eBooks and Videos
  • Early Access content, Progress Tracking, and Assessments
  • 1 Free eBook or Video to download and keep every month after trial
What do I get with an eBook?
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with Print & eBook?
  • Get a paperback copy of the book delivered to you
  • Download this book in EPUB, PDF, MOBI formats
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
What do I get with a Video?
  • Download this Video course in MP4 format
  • DRM FREE - read and interact with your content when you want, where you want, and how you want
  • Access this title in the Mapt reader
$0.00
$18.90
$44.99
$29.99p/m after trial
RRP $26.99
RRP $44.99
Subscription
eBook
Print + eBook
Start 30 Day Trial
Subscribe and access every Packt eBook & Video.
 
  • 5,000+ eBooks & Videos
  • 50+ New titles a month
  • 1 Free eBook/Video to keep every month
Start Free Trial
 
Preview in Mapt

Book Details

ISBN 139781783281374
Paperback144 pages

Book Description

As data grows exponentially day-by-day, extracting information becomes a tedious activity in itself. Technologies like Hadoop are trying to address some of the concerns, while Solr provides high-speed faceted search. Bringing these two technologies together is helping organizations resolve the problem of information extraction from Big Data by providing excellent distributed faceted search capabilities.

Scaling Big Data with Hadoop and Solr is a step-by-step guide that helps you build high performance enterprise search engines while scaling data. Starting with the basics of Apache Hadoop and Solr, this book then dives into advanced topics of optimizing search with some interesting real-world use cases and sample Java code.

Scaling Big Data with Hadoop and Solr starts by teaching you the basics of Big Data technologies including Hadoop and its ecosystem and Apache Solr. It explains the different approaches of scaling Big Data with Hadoop and Solr, with discussion regarding the applicability, benefits, and drawbacks of each approach. It then walks readers through how sharding and indexing can be performed on Big Data followed by the performance optimization of Big Data search. Finally, it covers some real-world use cases for Big Data scaling.

With this book, you will learn everything you need to know to build a distributed enterprise search platform as well as how to optimize this search to a greater extent resulting in maximum utilization of available resources.

Table of Contents

Chapter 1: Processing Big Data Using Hadoop and MapReduce
Understanding Apache Hadoop and its ecosystem
Storing large data in HDFS
Creating MapReduce to analyze Hadoop data
Installing and running Hadoop
Managing a Hadoop cluster
Summary
Chapter 2: Understanding Solr
Installing Solr
Apache Solr architecture
Configuring Apache Solr search
Loading your data for search
Summary
Chapter 3: Making Big Data Work for Hadoop and Solr
The problem
Understanding data-processing workflows
Using Solr 1045 patch – map-side indexing
Using Solr 1301 patch – reduce-side indexing
Using SolrCloud for distributed search
Using Katta for Big Data search (Solr-1395 patch)
Summary
Chapter 4: Using Big Data to Build Your Large Indexing
Understanding the concept of NOSQL
The CAP theorem
Understanding the concepts of distributed search
Lily – running Solr and Hadoop together
Deep dive – shards and indexing data of Apache Solr
Configuring SolrCloud to work with large indexes
Summary
Chapter 5: Improving Performance of Search while Scaling with Big Data
Understanding the limits
Optimizing the search schema
Index optimization
Optimization the search runtime
Monitoring the Solr instance
Summary

What You Will Learn

  • Understand Apache Hadoop, its ecosystem, and Apache Solr
  • Learn different industry-based architectures while designing Big Data enterprise search and understand their applicability and benefits
  • Write map/reduce tasks for indexing your data
  • Fine-tune the performance of your Big Data search while scaling your data
  • Increase your awareness of new technologies available today in the market that provide you with Hadoop and Solr
  • Use Solr as a NOSQL database
  • Configure your Big Data instance to perform in the real world
  • Address the key features of a distributed Big Data system such as ensuring high availability and reliability of your instances
  • Integrate Hadoop and Solr together in your industry by means of use cases

Authors

Table of Contents

Chapter 1: Processing Big Data Using Hadoop and MapReduce
Understanding Apache Hadoop and its ecosystem
Storing large data in HDFS
Creating MapReduce to analyze Hadoop data
Installing and running Hadoop
Managing a Hadoop cluster
Summary
Chapter 2: Understanding Solr
Installing Solr
Apache Solr architecture
Configuring Apache Solr search
Loading your data for search
Summary
Chapter 3: Making Big Data Work for Hadoop and Solr
The problem
Understanding data-processing workflows
Using Solr 1045 patch – map-side indexing
Using Solr 1301 patch – reduce-side indexing
Using SolrCloud for distributed search
Using Katta for Big Data search (Solr-1395 patch)
Summary
Chapter 4: Using Big Data to Build Your Large Indexing
Understanding the concept of NOSQL
The CAP theorem
Understanding the concepts of distributed search
Lily – running Solr and Hadoop together
Deep dive – shards and indexing data of Apache Solr
Configuring SolrCloud to work with large indexes
Summary
Chapter 5: Improving Performance of Search while Scaling with Big Data
Understanding the limits
Optimizing the search schema
Index optimization
Optimization the search runtime
Monitoring the Solr instance
Summary

Book Details

ISBN 139781783281374
Paperback144 pages
Read More

Read More Reviews

Recommended for You

Big Data Analytics with R and Hadoop Book Cover
Big Data Analytics with R and Hadoop
$ 29.99
$ 21.00
Hadoop Real-World Solutions Cookbook Book Cover
Hadoop Real-World Solutions Cookbook
$ 29.99
$ 21.00
Apache Solr 4 Cookbook Book Cover
Apache Solr 4 Cookbook
$ 26.99
$ 18.90
Practical Data Analysis Book Cover
Practical Data Analysis
$ 29.99
$ 21.00
Machine Learning with Spark Book Cover
Machine Learning with Spark
$ 29.99
$ 3.00
Building Machine Learning Systems with Python Book Cover
Building Machine Learning Systems with Python
$ 29.99
$ 6.00