Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial
eBook:
$35.99
Formats:
Formats:
$30.59
save 15%!
save 15%!
Print + free eBook + free PacktLib access to the book:
$95.98
Print cover: $59.99
$59.99
save 37%!
save 37%!
Free Shipping!
UK, US, Europe and selected countries in Asia.
| Also available on: |
|
- Discover the comprehensive and sophisticated orchestration of data integration tasks made possible with ODI, including monitoring and error-management
- Get to grips with the product architecture and building data integration processes with technologies including Oracle, Microsoft SQL Server and XML files
- A comprehensive tutorial packed with tips, images and best practices
Book Details
Language : EnglishPaperback : 384 pages [ 235mm x 191mm ]
Release Date : May 2012
ISBN : 184968068X
ISBN 13 : 9781849680684
Author(s) : David Hecksel, Bernard Wheeler, Peter C. Boyd-Bowman, Julien Testut, Denis Gray, Christophe Dupupet
Topics and Technologies : All Books, Oracle Database, Enterprise, Oracle
Table of Contents
PrefaceChapter 1: Product Overview
Chapter 2: Product Installation
Chapter 3: Using Variables
Chapter 4: ODI Sources, Targets, and Knowledge Modules
Chapter 5: Working with Databases
Chapter 6: Working with MySQL
Chapter 7: Working with Microsoft SQL Server
Chapter 8: Integrating File Data
Chapter 9: Working with XML Files
Chapter 10: Creating Workflows—Packages and Load Plans
Chapter 11: Error Management
Chapter 12: Managing and Monitoring ODI Components
Chapter 13: Concluding Remarks
Index
- Chapter 1: Product Overview
- ODI product architecture
- ODI repository
- Repository overview
- Repository location
- Master repository
- Work repository
- Execution repository
- Lifecycle management and repositories
- Studio
- Agent
- Console
- Oracle Enterprise Manager
- ODI key concepts
- Execution Contexts
- Knowledge Modules
- Models
- Interfaces
- Interface descriptions
- Interface mappings
- Interface flow tab
- Interface controls
- Packages and Scenarios
- Summary
- Chapter 2: Product Installation
- Prerequisites
- Prerequisites for the repository
- Prerequisites for the Oracle Universal Installer
- Prerequisites for the Studio
- Prerequisites for the Standalone Agent
- Installing ODI 11g
- Two installation modes
- Creating the repository with RCU
- Installing the ODI Studio and the ODI Agent
- Starting the ODI Studio for the first time
- Post installation—parameter files review
- Summary
- Chapter 3: Using Variables
- Defining variables
- Variable location and scope
- Variable definitions
- Refreshing variables
- Variable history
- Using variables for dynamic information
- Assigning a value to a variable
- Setting a hardcoded value
- Refresh Variable
- Passed as a parameter (Declare Variable)
- Referencing variables
- Variables in interfaces
- Variables in models
- Variables in topology
- Using variables to alter workflows
- Packages
- Load Plans
- Summary
- Chapter 4: ODI Sources, Targets, and Knowledge Modules
- Defining Physical Schemas, Logical Schemas, and Contexts
- Defining physical data servers
- Defining Physical Schemas
- Data schemas and work schemas
- Defining Logical Schemas and Contexts
- Non-database technologies
- Reverse-engineering metadata into ODI models
- Standard reverse-engineering
- Custom reverse-engineering
- File reverse-engineering
- XML reverse-engineering
- Examining the anatomy of the interface flow
- Example 1: Database and file to database
- Example 2: File and database to second file
- Example 3: File to Enterprise Application
- Importing and choosing Knowledge Modules
- Choosing Knowledge Modules
- Importing a Knowledge Module
- KMs—A quick look under the hood
- Configuring behavior with KM options
- Examining ODI Interfaces
- Overview tab
- Mapping tab
- Flow tab
- Quick-Edit tab
- Summary
- Chapter 5: Working with Databases
- Sample scenario description
- Integration target
- Integration source
- Integration mappings
- Data flow logistics
- Exercise 1: Building the Load_Customer interface
- Building the topology
- Reverse-engineering the model metadata
- Moving the data using an ODI interface
- Checking the execution with the Operator Navigator
- Summary
- Chapter 6: Working with MySQL
- What you can and can't do with MySQL
- Working with MySQL
- Obtaining and installing the software
- Overview of the task
- Integrating the product data
- Product data target, sources, and mappings
- Product interface flow logistics
- Integrating inventory data
- Inventory target, sources, and mappings
- Inventory interface flow logistics
- Using MySql with ODI
- Adding the MySQL JDBC driver
- Expanding the topology
- Reverse-engineering revisited
- Preparing to move the product data
- Using simulation and execution
- Moving the inventory data
- Summary
- Chapter 7: Working with Microsoft SQL Server
- Example: Working with SQL Server
- Overview of the task
- Integrating the Sales data
- Source
- Target
- Integrations
- Sample scenario
- Expanding the ODI topology
- Setting up the topology
- Reverse-engineering the Model metadata
- Creating interfaces and mappings
- Load Sales Person interface
- Load Sales Person mapping
- Automatic Temporary Index Management
- Load Sales Region interface
- Checking the execution with the Operator Navigator
- Execute the Load Sales Person interface
- Verify and examine the Load Sales Person results
- Verify and examine Load Sales Region results
- Summary
- Chapter 8: Integrating File Data
- Working with flat files
- Scope
- Prerequisites for flat files
- Integrate the file data into an Oracle table
- Partner data target, source, and mappings
- Partner interface flow logistics
- Step-by-step example
- Expanding the topology for file handling
- Integrating the Partner data
- Creating and preparing the project
- Creating the interface to integrate the Partner data
- Running the interface
- Summary
- Chapter 9: Working with XML Files
- Introduction to XML
- Introducing the ODI JDBC driver for XML
- ODI and its XML driver—basic concepts
- Example: Working with XML files
- Requirements and background
- Scope
- Overview of the task
- Integrating a Purchase Order from an XML file
- Creating models from XML files
- Integrating the data from a single Purchase Order
- Single order interface flow logistics
- Sample scenario: Integrating a simple Purchase Order file
- Expanding the Topology
- Reverse-engineering the metadata
- Creating the Interface
- Creating procedures
- Summary
- Chapter 10: Creating Workflows—Packages and Load Plans
- Packages
- Creating a package
- Adding steps into a package
- Adding tools in a package
- Changed Data Capture
- Event Detection
- Files
- Internet
- Metadata
- ODI Objects
- Plugins
- SAP
- Utilities
- Adding tools to a package
- Using ODI Tools
- Retry versus fail
- Best practice: No infinite loop
- Generating a scenario from a package
- Load Plans
- Serial and parallel steps
- Objects that can be used in a Load Plan
- Exception handling
- Using Packages and Load Plans
- Summary
- Chapter 11: Error Management
- Managing data errors
- Detecting and diverting data errors
- Data quality with ODI constraints
- ODI error table prefix
- Contents of an error table
- Using flow control and static control
- Using error thresholds
- Correcting and recycling data errors
- Recycling errors and ODI update keys
- Managing execution errors
- Handling anticipated errors
- Causing a deliberate benign error with OdiBeep
- Handling unexpected design-time errors
- More detailed error investigation in Operator Navigator
- Handling unexpected runtime errors
- Handling operational errors
- Summary
- Chapter 12: Managing and Monitoring ODI Components
- Scheduling with Oracle Data Integrator
- Overview
- Illustrating the schedule management user interface
- Using third-party schedulers
- Fusion Middleware Console Control
- Launching and accessing the FMCC
- Domain
- Agent
- Starting and stopping
- Performance summary
- Log file visibility and aggregation
- Visibility
- Aggregation
- Repository visibility
- Session statistics
- Oracle Data Integrator Console
- Launching and accessing ODI Console
- Data Lineage
- Flow Map
- Summary
David Hecksel
Bernard Wheeler
Peter C. Boyd-Bowman
Julien Testut
Denis Gray
Christophe Dupupet
I recommend reading through this book will give a clear understanding of Oracle Data Integrator: Senthilkumar Rajendran
Code Downloads
Download the code and support files for this book.
Submit Errata
Please let us know if you have found any errors not listed on this list by completing our errata submission form. Our editors will check them and add them to this list. Thank you.
Errata
- 5 submitted: last submission 23 Jan 2013Errata type: Typo | Page number: 89
Do no use "localhost" in the JDBC URL
Should be: Do not use "localhost" in the JDBC URL
Errata type: Typo | Page number: 335
Section header: "Fusion Middleware Console Control"
Should be: Fusion Middleware Control Console
Errata type: Technical | Page number: 221
Under "Load Sales Person interface", we should insert these steps after "we follow these steps":
- We create a project called Chapter 7 SQL Server
- We right-click on the project name to import the following Knowledge Modules: IKM Oracle Incremental Update and LKM SQL to Oracle.
The existing steps in page 221 and 222 will have to be re-numbered starting at 3.
Errata type: Technical | Page number: 228
Execute on: Target
Should be Execute on: Staging Area
Errata type: Code | Page number: 230
In the code bundle, consider the files create_SALESSYSTEM_schema.sql and create_SALESSYSTEM_schemaMS2008.sql. At the end of the file, there is a series of insert statements that start with the following line:
INSERT INTO REGIONS VALUES (1,'West');
An additional parameter must be added to all of these, like this:
INSERT INTO REGIONS VALUES (1,'West',1);
The file create_DATAMART_schema.sql needs to have an additional table definition:
CREATE TABLE SALES_REGION
( REGION_ID NUMBER NOT NULL,
REGION VARCHAR2(20),
COUNTRY VARCHAR2(50),
LAST_UPDATE DATE NOT NULL,
CONSTRAINT SALES_REGION_PK PRIMARY KEY (REGION_ID)
);
Sample chapters
You can view our sample chapters and prefaces of this title on PacktLib or download sample chapters in PDF format.
Frequently bought together
+
=
50% Off
the eBooks
the eBooks
Buy both these recommended eBooks together and get 50% off the total price
- Get to grips with the various components of the Oracle Data Integrator architecture
- Learn how to install ODI quickly and effectively using recommended best practices
- Orchestrate your data integration processing by designing ODI packages and scenarios
- Discover how to develop ODI interfaces in order to effortlessly move data between servers and files
- Get the full lowdown on both Error Processing and Management and Monitoring
- Give your knowledge a boost with in-depth coverage of various data sources and targets including Oracle, Microsoft SQL Server and XML files
- Master key ODI concepts like Physical and Logical Architectures or the Knowledge Modules
- Take advantage of expert advice from the authors’ combined 15 years of ODI experience
Oracle Data Integrator (ODI) is Oracle's strategic data integration platform for high-speed data transformation and movement between different systems. From high-volume, SOA-enabled data services, to trickle operations – ODI is a cutting-edge platform that offers heterogeneous connectivity, enterprise-level deployment, and strong administrative, diagnostic, and management capabilities.
"Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial" provides you with everything you to get up and running with Oracle Data Integrator, and more! Following an example scenario, the book covers essential information about the ODI architecture and using ODI across different databases (Oracle, Microsoft SQL Server and MySQL), and file types such as XML, before covering Orchestrating Data Integration Workflows, Error Management, Operational Management and Monitoring, and beyond.
"Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial" begins by describing the Oracle Data Integrator architecture and teaching you to install the product following best practices. You’ll then be introduced to some of the key concepts of ODI such as the Knowledge Modules.
Later topics include moving and transforming data from sources to targets including the Oracle Database, Microsoft SQL Server, MySQL, Flat files, and XML files, each with illustrated hands-on examples for the different technologies. Your learning experience will be made all the more rich with chapters introducing, explaining and leveraging additional ODI functionality such as variables, reusable procedures, temporary indexes and more.
Finally ODI's workflow and task orchestration capabilities are explained before introducing you to Error Management with ODI's built-in 'error hospital' and 'error recycling' capabilities for non-compliant data, not to mention tackling ODI Studio, ODI Console and Enterprise Manager Fusion Middleware Control.
"Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial" is a practical tutorial bursting with tips, illustrations and real-world best practices to get you on your way with ODI.
If you are a software/ETL developer or database administrator who is new to Oracle Data Integrator but want to get hands-on with the product quickly, then "Getting Started with Oracle Data Integrator 11g: A Hands-On Tutorial" is for you. You should have some experience with databases, SQL and ETL technologies.
