Oracle Data Integrator 11g Cookbook

This book is all you need to take your understanding of Oracle Data Integrator to the next level. From initial deployment right through to esoteric techniques, the task-based approach will enhance your expertise effortlessly

Oracle Data Integrator 11g Cookbook

Cookbook
Christophe Dupupet, Denis Gray, Peter C. Boyd-Bowman, Julien Testut

This book is all you need to take your understanding of Oracle Data Integrator to the next level. From initial deployment right through to esoteric techniques, the task-based approach will enhance your expertise effortlessly
$32.99
$54.99
RRP $32.99
RRP $54.99
eBook
Print + eBook
$12.99 p/month

Want this title & more? Subscribe to PacktLib

Enjoy full and instant access to over 2000 books and videos – you’ll find everything you need to stay ahead of the curve and make sure you can always get the job done.
+ Collection
Free sample

Book Details

ISBN 139781849681742
Paperback352 pages

About This Book

  • Clear, step-by-step recipes to walk you through some of the most advanced features of Oracle Data Integrator
  • Covers everything from administration, to development, to deployment, including advanced coding techniques using the Oracle Data Integrator SDK
  • Numerous code samples, screenshots, diagrams, and best practice recommendations

Who This Book Is For

This book is meant for people who already possess a basic understanding of Oracle Data Integrator and want to take it to the next level by learning how to better leverage advanced ODI features and functionality as they continue to develop and manage their data integration projects.

Table of Contents

Chapter 1: Installation, Deployment, and Configuration
Introduction
Deploying and configuring a standalone agent manually
Deploying a JEE ODI Agent
Configuring a standalone agent with OPMN
Deploying JDBC drivers with a JEE ODI Agent
Chapter 2: Defining the Oracle Data Integrator Security
Introduction
Setting up LDAP security for Oracle Data Integrator
Setting external authentication with Oracle Data Integrator
Creating users using generic profiles
Creating users using non-generic profiles
Creating new custom profiles in the Security navigator
Chapter 3: Advanced Topology
Introduction
Creating a new technology
Modifying actions to get more from your diagrams
Modifying and expanding datatypes
Changing the case sensitivity for code generation
Best practice – using the Staging Area User to access your target schema
Chapter 4: Using Variables
Introduction
Passing start-up parameters to a scenario using variables
Using table names that run in all contexts using getObjectName
Using variables to filter data based on a timestamp
Using variables in KM options (and reusing the variables in an interface, package, and so on)
Using variables in topology
Using variables to control loops inside packages
Chapter 5: Knowledge Module Internals
Introduction
Using the substitution passes
Using Java variables in KMs
Using Java for condition code generation
Invoking Java from the KMs
Using substitution methods in Java
Combining substitution methods in a KM
Chapter 6: Inside Knowledge Modules – SCD and CDC
Introduction
Implementing Slowly Changing Dimensions (SCD) using ODI
Modifying a Slowly Changing Dimension KM to allow undefined behaviors
Using Changed Data Capture (CDC) - simple
Using Changed Data Capture (CDC) - consistent set
Using one single interface to load changes that occur in any dimensions
Chapter 7: Advanced Coding Techniques
Introduction
Using diagrams to develop and maintain models
Generating DDL from data models
Generating interfaces from data models or diagrams
Creating a temporary interface (subquery)
Loading data from an SQL query
Performing a pivot
Loading data using partition exchange
Chapter 8: Package Loops and File Processing
Introduction
Defining packages and loops for near real-time execution using a hybrid loop
Using a file from a parameter variable
Detecting files with a variable name
Processing all files in a directory
Processing a large number of files in parallel
Chapter 9: XML and Web Services
Introduction
Defining a connection to XML within ODI
Processing complex files with ODI
Processing XML data within an RDBMS not in memory
Invoking web services from ODI
Invoking asynchronous ODI web services with callbacks
Configuring container-based authentication with ODI web services
Chapter 10: Advanced Coding Techniques Using the ODI SDK
Introduction
Creating the Master and Work repositories using the SDK
Creating a project using the SDK
Automating the import of artifacts using the SDK
Creating models and datastores using the SDK
Creating an interface using the SDK
Invoking and monitoring a scenario using the SDK
Chapter 11: More on ODI
Introduction
Invoking an external program that requires a password
Tuning a standalone ODI agent
Loading a file containing a LOB
Using ODI versioning
Performing a Smart Export/Smart Import
Accessing an Excel spreadsheet
Impacting the data flow by changing the staging area location
Automating Smart Export/Smart Import with the ODI SDK

What You Will Learn

  • Understand how to install, secure, and deploy Oracle Data Integrator
  • Explore the advanced features of ODI Topology, including creating new technologies and data types
  • Learn many new ways to use variables in the product, including in Topology and Knowledge Modules
  • Discover the inner workings of the code substitution in ODI to become more proficient with Knowledge Modules
  • Get to grips with reusable coding best practices for interfaces and packages
  • Find out more more about using XML and web services in ODI
  • Leverage the SDK to expand your solutions
  • Review many of the key concepts and best practices of ODI

In Detail

Oracle Data Integrator (ODI) is Oracle's strategic data integration platform for high-speed data transformation and movement between different systems. From high-volume batches, to SOA-enabled data services, to trickle operations, ODI is a cutting-edge platform that offers heterogeneous connectivity, enterprise-level deployment, and strong administrative, diagnostic, and management capabilities.

"Oracle Data Integrator 11g Cookbook" will take you on a journey past your first steps with ODI to a new level of proficiency, lifting the cover on many of the internals of the product to help you better leverage the most advanced features.

The first part of this book will focus on the administrative tasks required for a successful deployment, moving on to showing you how to best leverage Knowledge Modules with explanations of their internals and focus on specific examples. Next we will look into some advanced coding techniques for interfaces, packages, models, and a focus on XML. Finally the book will lift the cover on web services as well as the ODI SDK, along with additional advanced techniques that may be unknown to many users.

Throughout "Oracle Data Integrator 11g Cookbook", the authors convey real-world advice and best practices learned from their extensive hands-on experience.

Authors

Table of Contents

Chapter 1: Installation, Deployment, and Configuration
Introduction
Deploying and configuring a standalone agent manually
Deploying a JEE ODI Agent
Configuring a standalone agent with OPMN
Deploying JDBC drivers with a JEE ODI Agent
Chapter 2: Defining the Oracle Data Integrator Security
Introduction
Setting up LDAP security for Oracle Data Integrator
Setting external authentication with Oracle Data Integrator
Creating users using generic profiles
Creating users using non-generic profiles
Creating new custom profiles in the Security navigator
Chapter 3: Advanced Topology
Introduction
Creating a new technology
Modifying actions to get more from your diagrams
Modifying and expanding datatypes
Changing the case sensitivity for code generation
Best practice – using the Staging Area User to access your target schema
Chapter 4: Using Variables
Introduction
Passing start-up parameters to a scenario using variables
Using table names that run in all contexts using getObjectName
Using variables to filter data based on a timestamp
Using variables in KM options (and reusing the variables in an interface, package, and so on)
Using variables in topology
Using variables to control loops inside packages
Chapter 5: Knowledge Module Internals
Introduction
Using the substitution passes
Using Java variables in KMs
Using Java for condition code generation
Invoking Java from the KMs
Using substitution methods in Java
Combining substitution methods in a KM
Chapter 6: Inside Knowledge Modules – SCD and CDC
Introduction
Implementing Slowly Changing Dimensions (SCD) using ODI
Modifying a Slowly Changing Dimension KM to allow undefined behaviors
Using Changed Data Capture (CDC) - simple
Using Changed Data Capture (CDC) - consistent set
Using one single interface to load changes that occur in any dimensions
Chapter 7: Advanced Coding Techniques
Introduction
Using diagrams to develop and maintain models
Generating DDL from data models
Generating interfaces from data models or diagrams
Creating a temporary interface (subquery)
Loading data from an SQL query
Performing a pivot
Loading data using partition exchange
Chapter 8: Package Loops and File Processing
Introduction
Defining packages and loops for near real-time execution using a hybrid loop
Using a file from a parameter variable
Detecting files with a variable name
Processing all files in a directory
Processing a large number of files in parallel
Chapter 9: XML and Web Services
Introduction
Defining a connection to XML within ODI
Processing complex files with ODI
Processing XML data within an RDBMS not in memory
Invoking web services from ODI
Invoking asynchronous ODI web services with callbacks
Configuring container-based authentication with ODI web services
Chapter 10: Advanced Coding Techniques Using the ODI SDK
Introduction
Creating the Master and Work repositories using the SDK
Creating a project using the SDK
Automating the import of artifacts using the SDK
Creating models and datastores using the SDK
Creating an interface using the SDK
Invoking and monitoring a scenario using the SDK
Chapter 11: More on ODI
Introduction
Invoking an external program that requires a password
Tuning a standalone ODI agent
Loading a file containing a LOB
Using ODI versioning
Performing a Smart Export/Smart Import
Accessing an Excel spreadsheet
Impacting the data flow by changing the staging area location
Automating Smart Export/Smart Import with the ODI SDK

Book Details

ISBN 139781849681742
Paperback352 pages
Read More

Recommended for You

Oracle Information Integration, Migration, and Consolidation
$ 32.99