SQL Server 2017 Integration Services Cookbook

Harness the power of SQL Server 2017 Integration Services to build your data integration solutions with ease

SQL Server 2017 Integration Services Cookbook

This ebook is included in a Mapt subscription
Christian Cote, Matija Lah, Dejan Sarka

Harness the power of SQL Server 2017 Integration Services to build your data integration solutions with ease
$10.00
$59.99
RRP $47.99
RRP $59.99
eBook
Print + eBook
Access every Packt eBook & Video for just $100
 
  • 4,000+ eBooks & Videos
  • 40+ New titles a month
  • 1 Free eBook/Video to keep every month
Find Out More
 
Preview in Mapt

Book Details

ISBN 139781786461827
Paperback558 pages

Book Description

SQL Server Integration Services is a tool that facilitates data extraction, consolidation, and loading options (ETL), SQL Server coding enhancements, data warehousing, and customizations. With the help of the recipes in this book, you’ll gain complete hands-on experience of SSIS 2017 as well as the 2016 new features, design and development improvements including SCD, Tuning, and Customizations.

At the start, you’ll learn to install and set up SSIS as well other SQL Server resources to make optimal use of this Business Intelligence tools. We’ll begin by taking you through the new features in SSIS 2016/2017 and implementing the necessary features to get a modern scalable ETL solution that fits the modern data warehouse.

Through the course of chapters, you will learn how to design and build SSIS data warehouses packages using SQL Server Data Tools. Additionally, you’ll learn to develop SSIS packages designed to maintain a data warehouse using the Data Flow and other control flow tasks. You’ll also be demonstrated many recipes on cleansing data and how to get the end result after applying different transformations. Some real-world scenarios that you might face are also covered and how to handle various issues that you might face when designing your packages.

At the end of this book, you’ll get to know all the key concepts to perform data integration and transformation. You’ll have explored on-premises Big Data integration processes to create a classic data warehouse, and will know how to extend the toolbox with custom tasks and transforms.

Table of Contents

Chapter 1: SSIS Setup
Introduction
SQL Server 2016 download
Installing JRE for PolyBase
Installing SQL Server 2016
SQL Server Management Studio installation
SQL Server Data Tools installation
Testing SQL Server connectivity
Chapter 2: What Is New in SSIS 2016
Introduction
Creating SSIS Catalog
Custom logging
Azure tasks and transforms
Incremental package deployment
Multiple version support
Error column name
Control Flow templates
Chapter 3: Key Components of a Modern ETL Solution
Introduction
Installing the sample solution
Deploying the source database with its data
Deploying the target database
SSIS projects
Framework calls in EP_Staging.dtsx
Chapter 4: Data Warehouse Loading Techniques
Introduction
Designing patterns to load dimensions of a data warehouse
Loading the data warehouse using the framework
Near real-time and on-demand loads
Using parallelism
Chapter 5: Dealing with Data Quality
Introduction
Profiling data with SSIS
Creating a DQS knowledge base
Data cleansing with DQS
Creating a MDS model
Matching with DQS
Using SSIS fuzzy components
Chapter 6: SSIS Performance and Scalability
Introduction
Using SQL Server Management Studio to execute an SSIS package
Using T-SQL to execute an SSIS package
Using the DTExec command-line utility to execute an SSIS package
Scheduling an SSIS package execution
Using the cascading lookup pattern
Using the lookup cache
Using lookup expressions
Determining the maximum number of worker threads in a data flow
Using the master package concept
Requesting an execution tree in SSDT
Monitoring SSIS performance
Establishing a performance monitor session
Configuring a performance monitor data collector set
Chapter 7: Unleash the Power of SSIS Script Task and Component
Introduction
Using variables in SSIS Script task
Execute complex filesystem operations with the Script task
Reading data profiling XML results with the Script task
Correcting data with the Script component
Validating data using regular expressions in a Script component
Using the Script component as a source
Using the Script component as a destination
Chapter 8: SSIS and Advanced Analytics
Introduction
Splitting a dataset into a training and test set
Testing the randomness of the split with a SSAS decision trees model
Preparing a Naive Bayes SSAS data mining model
Querying the SSAS data mining model with the data mining query transformation
Creating an R data mining model
Using the R data mining model in SSIS
Text mining with term extraction and term lookup transformations
Chapter 9: On-Premises and Azure Big Data Integration
Introduction
Azure Blob storage data management
Installing a Hortonworks cluster
Copying data to an on-premises cluster
Using Hive – creating a database
Transforming the data with Hive
Transferring data between Hadoop and Azure
Leveraging a HDInsight big data cluster
Managing data with Pig Latin
Importing Azure Blob storage data
Chapter 10: Extending SSIS Custom Tasks and Transformations
Introduction
Designing a custom task
Designing a custom transformation
Managing custom component versions
Chapter 11: Scale Out with SSIS 2017
Introduction
SQL Server 2017 download and setup
SQL Server client tools setup
Configuring SSIS for scale out executions
Executing a package using scale out functionality

What You Will Learn

  • Understand the key components of an ETL solution using SQL Server 2016-2017 Integration Services
  • Design the architecture of a modern ETL solution
  • Have a good knowledge of the new capabilities and features added to Integration Services
  • Implement ETL solutions using Integration Services for both on-premises and Azure data
  • Improve the performance and scalability of an ETL solution
  • Enhance the ETL solution using a custom framework
  • Be able to work on the ETL solution with many other developers and have common design paradigms or techniques
  • Effectively use scripting to solve complex data issues

Authors

Table of Contents

Chapter 1: SSIS Setup
Introduction
SQL Server 2016 download
Installing JRE for PolyBase
Installing SQL Server 2016
SQL Server Management Studio installation
SQL Server Data Tools installation
Testing SQL Server connectivity
Chapter 2: What Is New in SSIS 2016
Introduction
Creating SSIS Catalog
Custom logging
Azure tasks and transforms
Incremental package deployment
Multiple version support
Error column name
Control Flow templates
Chapter 3: Key Components of a Modern ETL Solution
Introduction
Installing the sample solution
Deploying the source database with its data
Deploying the target database
SSIS projects
Framework calls in EP_Staging.dtsx
Chapter 4: Data Warehouse Loading Techniques
Introduction
Designing patterns to load dimensions of a data warehouse
Loading the data warehouse using the framework
Near real-time and on-demand loads
Using parallelism
Chapter 5: Dealing with Data Quality
Introduction
Profiling data with SSIS
Creating a DQS knowledge base
Data cleansing with DQS
Creating a MDS model
Matching with DQS
Using SSIS fuzzy components
Chapter 6: SSIS Performance and Scalability
Introduction
Using SQL Server Management Studio to execute an SSIS package
Using T-SQL to execute an SSIS package
Using the DTExec command-line utility to execute an SSIS package
Scheduling an SSIS package execution
Using the cascading lookup pattern
Using the lookup cache
Using lookup expressions
Determining the maximum number of worker threads in a data flow
Using the master package concept
Requesting an execution tree in SSDT
Monitoring SSIS performance
Establishing a performance monitor session
Configuring a performance monitor data collector set
Chapter 7: Unleash the Power of SSIS Script Task and Component
Introduction
Using variables in SSIS Script task
Execute complex filesystem operations with the Script task
Reading data profiling XML results with the Script task
Correcting data with the Script component
Validating data using regular expressions in a Script component
Using the Script component as a source
Using the Script component as a destination
Chapter 8: SSIS and Advanced Analytics
Introduction
Splitting a dataset into a training and test set
Testing the randomness of the split with a SSAS decision trees model
Preparing a Naive Bayes SSAS data mining model
Querying the SSAS data mining model with the data mining query transformation
Creating an R data mining model
Using the R data mining model in SSIS
Text mining with term extraction and term lookup transformations
Chapter 9: On-Premises and Azure Big Data Integration
Introduction
Azure Blob storage data management
Installing a Hortonworks cluster
Copying data to an on-premises cluster
Using Hive – creating a database
Transforming the data with Hive
Transferring data between Hadoop and Azure
Leveraging a HDInsight big data cluster
Managing data with Pig Latin
Importing Azure Blob storage data
Chapter 10: Extending SSIS Custom Tasks and Transformations
Introduction
Designing a custom task
Designing a custom transformation
Managing custom component versions
Chapter 11: Scale Out with SSIS 2017
Introduction
SQL Server 2017 download and setup
SQL Server client tools setup
Configuring SSIS for scale out executions
Executing a package using scale out functionality

Book Details

ISBN 139781786461827
Paperback558 pages
Read More

Read More Reviews