Microsoft SQL Server 2012 with Hadoop: Getting SQL Server talking to Hadoop is a smooth process when you follow this tutorial. Learn all the tools and techniques you need integrate the data and then extract powerful business insights from the merged result.

Debarchan Sarkar

$43.99

2 (1 Ratings)

Paperback Aug 2013 96 pages 1st Edition

Debarchan Sarkar

$43.99

2 (1 Ratings)

Paperback Aug 2013 96 pages 1st Edition

What do you get with Print?

Instant access to your digital copy whilst your Print order is Shipped

Paperback book shipped to your preferred address

Redeem a companion digital copy on all Print orders

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

View table of contents

Preview Book

Microsoft SQL Server 2012 with Hadoop

Chapter 2. Using Sqoop – The SQL Server Hadoop Connector

Sqoop is an open source Apache project, which facilitates data exchange between Hadoop and any traditional Relational Database Management System (RDBMS). It uses the MapReduce framework under the hood to perform the import/export operations and often is a common choice for integrating data from relational and non-relational data stores.

Microsoft SQL Server Connector for Apache Hadoop (SQL Server-Hadoop Connector) is a Sqoop-based connector that is specifically designed for efficient data transfer between SQL Server and Hadoop. This connector is optimized for bulk transfer of the data bi-directionally, it does not support extensive formatting or transformation on the data while being imported or exported on the fly. After reading this chapter, you will be able to:

Install and configure the Sqoop connector
Import data from SQL Server to Hadoop
Export data from Hadoop to SQL Server

The SQL Server-Hadoop Connector

Sqoop is implemented using JDBC and so it also conforms to the standard JDBC features. The schema or the structure of the data is provided by the data source, and Sqoop generates and executes SQL statements using JDBC. The following table summarizes a few important commands that are available with the SQL Server connector and their functionalities:

Command

Function

sqoop import

The import command lets you import SQL Server data into HDFS. You can opt to import an entire table using the --table switch or selected records based on criteria using the --query switch. The data, once imported to the Hadoop file system, are stored as delimited text files or as SequenceFiles for further processing. You can also use the import command to move SQL Server data into Hive tables, which are like logical schemas on top of HDFS.

sqoop export

You can use the export command to move data from HDFS into SQL Server tables. Much like the import command, the export command...

Downloading the SQL Server-Hadoop Connector

If you have reached this point, finally, you are ready to download, install, and configure the SQL Server-Hadoop Connector on the NameNode of your cluster.

The Microsoft SQL Server SQOOP Connector for Hadoop is now part of Apache SQOOP 1.4.x series of projects, and Microsoft no longer provides a separate download from their site. The connector is now downloadable from Apache's website: http://sqoop.apache.org/

The following table summarizes the different files that are deployed to the NameNode once the connector is downloaded. The table contains the SQL Server-Hadoop Connector installer archive:

File/Directory

Description

install.sh

This is a shell script that has commands to copy the necessary files and directory structure for the SQL Server-Hadoop Connector.

Microsoft SQL

Server-Hadoop

Connector User

Guide.pdf

User guide to deploy and execute SQL Server-Hadoop Connector commands.

lib/

This directory contains the sqoop-sqlserver...

Key benefits

Integrate data from unstructured (Hadoop) and structured (SQL Server 2012) sources
Configure and install connectors for a bi-directional transfer of data
Full of illustrations, diagrams, and tips with clear, step-by-step instructions and practical examples

Description

With the explosion of data, the open source Apache Hadoop ecosystem is gaining traction, thanks to its huge ecosystem that has arisen around the core functionalities of its distributed file system (HDFS) and Map Reduce. As of today, being able to have SQL Server talking to Hadoop has become increasingly important because the two are indeed complementary. While petabytes of unstructured data can be stored in Hadoop taking hours to be queried, terabytes of structured data can be stored in SQL Server 2012 and queried in seconds. This leads to the need to transfer and integrate data between Hadoop and SQL Server. Microsoft SQL Server 2012 with Hadoop is aimed at SQL Server developers. It will quickly show you how to get Hadoop activated on SQL Server 2012 (it ships with this version). Once this is done, the book will focus on how to manage big data with Hadoop and use Hadoop Hive to query the data. It will also cover topics such as using in-memory functions by SQL Server and using tools for BI with big data. Microsoft SQL Server 2012 with Hadoop focuses on data integration techniques between relational (SQL Server 2012) and non-relational (Hadoop) worlds. It will walk you through different tools for the bi-directional movement of data with practical examples. You will learn to use open source connectors like SQOOP to import and export data between SQL Server 2012 and Hadoop, and to work with leading in-memory BI tools to create ETL solutions using the Hive ODBC driver for developing your data movement projects. Finally, this book will give you a glimpse of the present day self-service BI tools such as Excel and PowerView to consume Hadoop data and provide powerful insights on the data.

Who is this book for?

Microsoft SQL Server 2012 with Hadoop is specifically targeted at readers who want to cross-pollinate their Hadoop skills with SQL Server 2012 business intelligence and data analytics. A basic understanding of traditional RDBMS technologies and query processing techniques is essential.

What you will learn

Use the Native SQOOP Connector for data movement between SQL Server 2012 and Hadoop
Configure and use the Hive ODBC driver to enable any ODBC compliant client to consume Hadoop data
Create ETL solutions and automate data movement jobs between SQL Server 2012 and Hadoop using SQL Server Integration Services
Provide powerful reporting on the integrated data with just a matter of a few clicks using Microsoft self-service BI tools
Merge structured and unstructured data together in a common warehouse for analysis, which is essential

Estimated delivery fee Deliver to United States

Economy delivery 10 - 13 business days

Free ~~$6.95~~

Premium delivery 6 - 9 business days

$21.95

(Includes tracking information)

What do you get with Print?

Instant access to your digital copy whilst your Print order is Shipped

Paperback book shipped to your preferred address

Redeem a companion digital copy on all Print orders

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

Frequently bought together

SQL Server Analysis Services 2012 Cube Development Cookbook

$65.99

Microsoft SQL Server 2012 Performance Tuning Cookbook

$65.99

$43.99

Total $ 175.97

FAQs

What is the digital copy I get with my Print order?

When you buy any Print edition of our Books, you can redeem (for free) the eBook edition of the Print Book you’ve purchased. This gives you instant access to your book when you make an order via PDF, EPUB or our online Reader experience.

What is the delivery time and cost of print book?

Shipping Details

USA:

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

Economy: Can deliver to P. O. Boxes and private residences.
Trackable service with delivery to addresses in Australia only.
Delivery time ranges from 7-9 business days for VIC and 8-10 business days for Interstate metro
Delivery time is up to 15 business days for remote areas of WA, NT & QLD.

Premium: Delivery to addresses in Australia only
Trackable delivery to most P. O. Boxes and private residences in Australia within 4-5 days based on the distance to a destination following dispatch.

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Disclaimer:
All orders received before 5 PM U.K time would start printing from the next business day. So the estimated delivery times start from the next day as well. Orders received after 5 PM U.K time (in our internal systems) on a business day or anytime on the weekend will begin printing the second to next business day. For example, an order placed at 11 AM today will begin printing tomorrow, whereas an order placed at 9 PM tonight will begin printing the day after tomorrow.

Unfortunately, due to several restrictions, we are unable to ship to the following countries:

Afghanistan
American Samoa
Belarus
Brunei Darussalam
Central African Republic
The Democratic Republic of Congo
Eritrea
Guinea-bissau
Iran
Lebanon
Libiya Arab Jamahriya
Somalia
Sudan
Russian Federation
Syrian Arab Republic
Ukraine
Venezuela

What is custom duty/charge?

Customs duty are charges levied on goods when they cross international borders. It is a tax that is imposed on imported goods. These duties are charged by special authorities and bodies created by local governments and are meant to protect local industries, economies, and businesses.

Do I have to pay customs charges for the print book order?

The orders shipped to the countries that are listed under EU27 will not bear custom charges. They are paid by Packt as part of the order.

List of EU27 countries: www.gov.uk/eu-eea:

A custom duty or localized taxes may be applicable on the shipment and would be charged by the recipient country outside of the EU27 which should be paid by the customer and these duties are not included in the shipping charges been charged on the order.

How do I know my custom duty charges?

The amount of duty payable varies greatly depending on the imported goods, the country of origin and several other factors like the total invoice amount or dimensions like weight, and other such criteria applicable in your country.

For example:

If you live in Mexico, and the declared value of your ordered items is over $ 50, for you to receive a package, you will have to pay additional import tax of 19% which will be $ 9.50 to the courier service.
Whereas if you live in Turkey, and the declared value of your ordered items is over € 22, for you to receive a package, you will have to pay additional import tax of 18% which will be € 3.96 to the courier service.

How can I cancel my order?

Cancellation Policy for Published Printed Books:

You can cancel any order within 1 hour of placing the order. Simply contact customercare@packt.com with your order details or payment transaction id. If your order has already started the shipment process, we will do our best to stop it. However, if it is already on the way to you then when you receive it, you can contact us at customercare@packt.com using the returns and refund process.

Please understand that Packt Publishing cannot provide refunds or cancel any order except for the cases described in our Return Policy (i.e. Packt Publishing agrees to replace your printed book because it arrives damaged or material defect in book), Packt Publishing will not accept returns.

What is your returns and refunds policy?

Return Policy:

We want you to be happy with your purchase from Packtpub.com. We will not hassle you with returning print books to us. If the print book you receive from us is incorrect, damaged, doesn't work or is unacceptably late, please contact Customer Relations Team on customercare@packt.com with the order number and issue details as explained below:

If you ordered (eBook, Video or Print Book) incorrectly or accidentally, please contact Customer Relations Team on customercare@packt.com within one hour of placing the order and we will replace/refund you the item cost.
Sadly, if your eBook or Video file is faulty or a fault occurs during the eBook or Video being made available to you, i.e. during download then you should contact Customer Relations Team within 14 days of purchase on customercare@packt.com who will be able to resolve this issue for you.
You will have a choice of replacement or refund of the problem items.(damaged, defective or incorrect)
Once Customer Care Team confirms that you will be refunded, you should receive the refund within 10 to 12 working days.
If you are only requesting a refund of one book from a multiple order, then we will refund you the appropriate single item.
Where the items were shipped under a free shipping offer, there will be no shipping costs to refund.

On the off chance your printed book arrives damaged, with book material defect, contact our Customer Relation Team on customercare@packt.com within 14 days of receipt of the book with appropriate evidence of damage and we will work with you to secure a replacement copy, if necessary. Please note that each printed book you order from us is individually made by Packt's professional book-printing partner which is on a print-on-demand basis.

What tax is charged?

Currently, no tax is charged on the purchase of any print book (subject to change based on the laws and regulations). A localized VAT fee is charged only to our European and UK customers on eBooks, Video and subscriptions that they buy. GST is charged to Indian customers for eBooks and video purchases.

What payment methods can I use?

You can pay with the following card types:

Visa Debit
Visa Credit
MasterCard
PayPal

What is the delivery time and cost of print books?

Shipping Details

USA:

Economy: Delivery to most addresses in the US within 10-15 business days

Premium: Trackable Delivery to most addresses in the US within 3-8 business days

UK:

Economy: Delivery to most addresses in the U.K. within 7-9 business days.
Shipments are not trackable

Premium: Trackable delivery to most addresses in the U.K. within 3-4 business days!
Add one extra business day for deliveries to Northern Ireland and Scottish Highlands and islands

EU:

Premium: Trackable delivery to most EU destinations within 4-9 business days.

Australia:

India:

Premium: Delivery to most Indian addresses within 5-6 business days

Rest of the World:

Premium: Countries in the American continent: Trackable delivery to most countries within 4-7 business days

Asia:

Premium: Delivery to most Asian addresses within 5-9 business days

Unfortunately, due to several restrictions, we are unable to ship to the following countries:

Afghanistan
American Samoa
Belarus
Brunei Darussalam
Central African Republic
The Democratic Republic of Congo
Eritrea
Guinea-bissau
Iran
Lebanon
Libiya Arab Jamahriya
Somalia
Sudan
Russian Federation
Syrian Arab Republic
Ukraine
Venezuela

dingopole Sep 28, 2013

This book's content, just as the whole industry mesmerization with Big Data is just a fad. I bought it just today and skimmed through the content. Ten dollars is the maximum you would want to pay as I feel I could spend equivalent amount of time looking up blogs and official documentation to get more insight. Don't bother and wait for proper publications.

Amazon Verified review

Microsoft SQL Server 2012 with Hadoop: Getting SQL Server talking to Hadoop is a smooth process when you follow this tutorial. Learn all the tools and techniques you need integrate the data and then extract powerful business insights from the merged result.

What do you get with Print?

Microsoft SQL Server 2012 with Hadoop

Chapter 2. Using Sqoop – The SQL Server Hadoop Connector

The SQL Server-Hadoop Connector

Downloading the SQL Server-Hadoop Connector

Installing the SQL Server-Hadoop Connector

The Sqoop import tool

Note

The Sqoop export tool

Summary

Page 1 of 7

Key benefits

Description

Who is this book for?

What you will learn

Product Details

What do you get with Print?

Product Details

Frequently bought together

Table of Contents

Recommendations for you

Customer reviews

People who bought this also bought

About the author

FAQs

Microsoft SQL Server 2012 with Hadoop: Getting SQL Server talking to Hadoop is a smooth process when you follow this tutorial. Learn all the tools and techniques you need integrate the data and then extract powerful business insights from the merged result.

What do you get with Print?

Contact Details

Shipping Address

Billing Address

Key benefits

Description

Who is this book for?

What you will learn

Product Details

What do you get with Print?

Contact Details

Shipping Address

Billing Address

Product Details

Packt Subscriptions

Frequently bought together

Table of Contents

Recommendations for you

Customer reviews

People who bought this also bought

About the author

FAQs

Create a Free Account To Continue Reading

Sign in to activate your 7-day free access