Index

A

• ActiveMQ
  • about / Introduction
  • starting / Getting ready
• append method
  • used, for concatenating files / Concatenating files using the append method
• auto increment keys
  • about / Auto increment keys
• auto increment procedure
  • about / Auto increment procedure

B

• batches / Batches
• benefits, repository schemas / Repository schemas
• binary error codes
  • creating, for multiple test results storage / Creating binary error codes to store multiple test results, How to do it…, How it works…, There's more…
  • decrypting / Decrypting the error code
• built-in schema
  • hand-cranking / Hand-cranking a built-in schema, How to do it…
• bulk loading facility / Bulk loading

C

• capabilities, tMap component / The tMap component
• child job
  • sessions, passing to / Passing a session to a child job, How it works…
• child jobs
  • parameters, passing to / Passing parameters to a child job, There's more
• child tables
  • surrogate keys, managing for / Managing surrogate keys for parent and child tables, How it works…
• code
  • documenting / Before you begin
• code routine
  • finding / Finding the code routine, How to do it…
• code routines
  • about / Creating custom functions using code routines
  • used, for creating custom functions / How to do it…, How it works…
• codes
  • returning, from child job without tDie / Returning codes from a child job without tDie, How to do it…, There's more…
• code utilities, XMLUtils
  • createDomFromString / Code utilities
  • addChildAtPath / Code utilities
  • DOMToString / Code utilities
• column
  • checking, against list of allowed values / Checking a column against a list of allowed values
  • checking, against lookup / Checking a column against a lookup, How to do it…, How it works…
• command line context parameters
  • adding / Adding command-line context parameters, There's more…
• command line parameters
  • passing, to job / Passing command line parameters
• compilation errors
  • location, searching with problems tab / Find the location of compilation errors using the Problems tab, How to do it..., How it works...
• compiled executables
  • creating / How to do it..., How it works…
• complex date formats
  • about / Some complex date formats
  • ISO 8601 with offset standard / Some complex date formats
  • Mtime pattern / Some complex date formats
• complex hierarchical XML
  • reading / Getting ready, How to do it..., How it works...
  • relationships, managing / Managing the relationships
  • file information / File information
  • XML, to database mapping / XML to database mapping
  • XPATH / XPATH
  • web service XML / Web service XML
• complex logic
  • adding, into flow / Adding complex logic into a flow using tJavaRow, How to do it…, How it works…
• complex queries / Multiple tables and complex queries
• complex test data
  • creating, tRowGenerator component used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
  • creating, tFlowToIterate component used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
  • creating, tMap component used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
  • creating, sequences used / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
• complex XML
  • writing / Writing complex XML, Method, How to do it..., How it works...
• component globalMap variables
  • dragging / Dragging component globalMap variables
• conditional logic
  • ternary operator, using for / Using the ternary operator for conditional logic, How it works…, There's more…
• considerations, databases
  • efficiency versus readability / Efficiency versus readability
  • SQL string / SQL string
  • SQL style / SQL style
• console output
  • execution errors, locating from / How to do it...
• context
  • using, in SQL queries / Using context and globalMap variables in SQL queries
  • printing out / How to do it...
• context file location
  • setting, in operating system / Setting the context file location in the operating system, How to do it..., There’s more…
• context group
  • about / Creating a context group
  • creating / How to do it..., How it works...
  • variable values, updaing in / Prompt for variable values using the tree mode
  • adding, to job / How to do it..., How it works…
  • contexts, adding to / How to do it..., There’s more…
• contexts
  • common values / Common values in contexts
  • adding, to context group / How to do it..., There’s more…
  • loading, tContextLoad used / How to do it..., There’s more…
  • loading, implicit context load used / Using implicit context loading to load contexts, How to do it...
• context types / Context types
• context variable
  • finding / Finding a new context variable
• context variables
  • about / Before you begin, Introduction, Context variables, Context Variables
  • setting, tJava component used / Setting the context and globalMap variables using tJava, How to do it…
  • setting, in code / Setting context variables in the code
  • manipulating / Manipulating contexts in Talend Open Studio
  • manipulating, pros / Manipulating contexts in Talend Open Studio
  • manipulating, cons / Manipulating contexts in Talend Open Studio
  • checking / Manually checking and setting contexts
  • setting / Manually checking and setting contexts
  • setting, pros / Manually checking and setting contexts
  • checking, cons / Manually checking and setting contexts
  • setting, cons / Manually checking and setting contexts
  • checking, pros / Manually checking and setting contexts
• control files
  • processing / Processing control/validation files, How to do it..., How it works...
• custom functions
  • creating, code routines used / How to do it…, How it works…

D

• data
  • joining, tMap component used / Joining data using tMap, How to do it..., How it works…
• database connection
  • setting up, Talend supplied wizard used / Setting up a database connection, How to do it..., How it works...
  • using / Using the connection
  • considerations / Always create database connections, Context
• database context variables / Database context variables
• database management
  • executing / Database and table management, How it works…
• databases
  • considerations / There's more…
• database sessions
  • managing / Managing database sessions, How to do it…, How it works…
• database tables
  • reading from / Reading from database tables, How to do it…
  • writing to / Writing to a database table, How it works…
• data formats, Talend
  • about / There’s more...
  • date patterns / Date patterns
  • nullable elements / Nullable elements
  • field lengths / Nullable elements
  • keys / Nullable elements
• data integration
  • about / Introduction
• data tables
  • selected rows, filtering / Selected rows and columns
  • selected columns, filtering / Selected rows and columns
• debugging
  • about / Debugging
• Die on error option / Die on error

E

• enterprise scheduling tool
  • about / Executable code
• errors
  • capturing, for individual rows / Capturing individual rejects and errors, How it works…
• Excel
  • used, for creating test data / Creating test data using Excel, How it works...
• executable code
  • about / Executable code
• execution errors
  • locating, from console output / How to do it...

F

• features, job / How it works…
• features, tMap component / tMap
• fields
  • selecting / Selecting different fields and keys for insert, update, and delete, How to do it…, There's more...
• file
  • records, appending to / Appending records to a file, How it works...
  • header, adding to / Adding a header and trailer to a file, How it works...
  • trailer, adding to / Adding a header and trailer to a file, How it works...
  • copying, to different directory / Copying a file to another directory
  • copying, to different name / Copying file to a different name
  • renaming / Renaming a file
  • moving / Moving a file
  • deleting / Deleting a file
  • logging data, dumping to / Dumping the console output to a file from within a job, How it works...
• file information
  • capturing / Capturing file information, How to do it..., How it works...
• file management components / Moving, copying, renaming, and deleting files and folders
• files
  • concatenating, append method used / Concatenating files using the append method
  • creating, depending on input data / How to do it..., How it works...
  • writing, depending on input data / How to do it..., How it works...
• fixed schemas
  • about / Fixed schemas and columns
• flow
  • complex logic, adding into / Adding complex logic into a flow using tJavaRow, How to do it…, How it works…

G

• generic schemas
  • about / Generic schemas
  • shared schemas / Shared schemas
  • generated data sources / Generated data sources
  • creating, from existing metadata / Creating a generic schema from the existing metadata, How to do it…, How it works…
• globalMap
  • about / Before you begin
• globalMap variables
  • setting, tJava component used / Setting the context and globalMap variables using tJava, How to do it…
  • using, in SQL queries / Using context and globalMap variables in SQL queries
  • about / The globalMap variables

H

• hashMap key table
  • used, for adding efficiency / Added efficiency using hashMap key table
• hashMaps / How it works…
• header
  • information, using in / Using the information in the header and trailer
  • adding, to file / Adding a header and trailer to a file, How it works...
• header information
  • using, in detail / Using the header information in the detail
• header information subjob
  • using / Use the header information subjob
• headers
  • reading, tMap component used / Reading headers and trailers using tMap, How to do it..., There's more…
  • reading, with no identifiers / Reading headers and trailers with no identifiers, How to do it...

I

• implicit context load
  • used, for loading contexts / Using implicit context loading to load contexts, How to do it...
  • about / Turning implicit context loading on and off in a job
  • turning off, in job / How to do it...
  • turning on, in job / How to do it...
• implicit context load method / Implicit context load
  • about / Understanding implicit context loading
  • pros / Understanding implicit context loading
  • cons / Understanding implicit context loading
• in-process database
  • using / Background, How to do it…
• information
  • using, in header / Using the information in the header and trailer
  • using, in trailer / Using the information in the header and trailer
• input query
  • printing / Printing your input query, How it works…
• input row
  • splitting, into multiple outputs / Splitting an input row into multiple outputs based on input conditions, How to do it..., How it works…, There's more…
• input rows
  • filtering / Filtering input rows, How it works…
• installation, Talend Open Studio / Installing the software, How to do it…
• intermediate data
  • storing, in memory / Storing intermediate data in the memory using tHashMap, How it works...
• intermediate variables
  • using, in tMap component / Using intermediate variables in tMap, How to do it…, How it works…

J

• JAR files
  • importing / Importing JAR files to allow use of external Java classes, How to do it…
• Java / Before you begin
• Java debugger
  • used, for debugging Talend jobs / Using the Java debugger to debug Talend jobs, How to do it..., How it works...
• Java Document format / How to do it...
• Java Document object
  • about / Document objects
• Java DOM / Java DOM
• JDBC
  • about / Introduction
• job
  • context group, adding to / How to do it..., How it works…
  • features / How it works…
  • killing, from within tJavaRow component / Killing a job from within tJavaRow, How it works...
  • values, adding / Adding job name, project name, and other job specific information
• job dependencies
  • managing, within Talend / Managing job dependencies within Talend
  • managing / Managing job dependencies, How it works…
  • Die on error option / Die on error
  • error checks, adding to schedule / Adding error checks to the schedule
  • restartability, adding to job / Restartability

K

• keys
  • updating / Update and delete keys
  • deleting / Update and delete keys
  • selecting / Selecting different fields and keys for insert, update, and delete, How to do it…, There's more...

L

• LastInsertId component / The LastInsertId component
• lists
  • schemas, creating from / Creating schemas from lists, How to do it..., How it works…
• logging
  • about / Logging
• logging data
  • dumping, to file / Dumping the console output to a file from within a job, How it works...
• logic
  • testing / Testing logic – the most-used pattern, How to do it..., There's more…
• lookup
  • columns, checking against / Checking a column against a lookup, How to do it…, How it works…
• lookups
  • used, for creating random test / Creating random test data using lookups, How it works...
• lossless queue
  • ensuring, sessions used / Ensuring lossless queues using sessions, How it works...

M

• memory
  • intermediate data, storing in / Storing intermediate data in the memory using tHashMap, How it works...
• memory errors, stopping in Talend
  • memory allocated, increasing of job / Increasing the memory allocated to a job
  • lookup data, reducing / Reducing lookup data
  • hashMap, using / Using hashMap/in-memory tables
  • in-memory tables, using / Using hashMap/in-memory tables
  • job, splitting / Splitting the job
  • data, dropping to disk / Dropping data to disk
  • files, splitting / Split the files
  • hardware solutions / Hardware solutions
• message
  • writing, to queue / How to do it...
• message queues
  • about / Introduction
• metadata
  • generic schema, creating from / Creating a generic schema from the existing metadata, How to do it…, How it works…
• missing tab
  • restoring / Show view:
• MSDelimited component / There's more…
• multiple contexts
  • using / Using a different context
• multiple files
  • processing, at once / Processing multiple files at once, How it works...
• multiple outputs
  • input rows, splitting into / Splitting an input row into multiple outputs based on input conditions, How to do it..., How it works…, There's more…
• multiple tables / Multiple tables and complex queries
• MySQL
  • about / Introduction

N

• node / Node
• non-Talend objects
  • executing / Executing non-Talend objects and operating system commands, How it works…

O

• ODS (Operational Data Store) / Introduction
• one-off logic
  • adding, to job / How to do it…
• operating system
  • context file location, setting in / Setting the context file location in the operating system, How to do it..., There’s more…
• operating system commands
  • executing / Executing non-Talend objects and operating system commands, How it works…
• output query
  • printing / Printing your output query, How it works…

P

• parameters
  • passing, to child jobs / Passing parameters to a child job, There's more
• parent tables
  • surrogate keys, managing for / Managing surrogate keys for parent and child tables, How it works…
• problems tab
  • used, for searching location of compilation errors / Find the location of compilation errors using the Problems tab, How to do it..., How it works...
• pseudo components
  • creating, tJavaFlex component used / How to do it…, How it works…

Q

• Quartz
  • about / Executable code
• query
  • developing / Developing the query
• queue
  • message, writing to / How to do it...

R

• random test data
  • creating, lookups used / Creating random test data using lookups, How it works...
• ranges / Ranges
• records
  • appending, to file / Appending records to a file, How it works...
• regular expression (regex)
  • about / Reading rows using a regular expression
  • used, for reading rows / Reading rows using a regular expression, How it works..., There's more…
• rejected data
  • about / Enabling and disabling reject flows
• reject flows
  • about / Enabling and disabling reject flows
  • enabling / How to do it…, How it works…
  • disbaling / How to do it…, How it works…
  • gathering / Gathering all rejects prior to killing a job, How to do it…, There's more...
• reject row facility
  • erros, capturing for individual rows / Capturing individual rejects and errors, How it works…
• reload
  • used, at each row for processing real-time data / Using reload at each row to process real-time / near real-time data, How to do it..., The result
  • missing, at each row global variable / Reloads going missing at each row global variable, How to do it...
• reload at each row option / Batch versus real time
• repository schemas
  • benefits / Repository schemas
• RESTful web service
  • about / Introduction
  • calling / Calling a RESTful web service, How it works...
• return codes
  • capturing / Capturing and acting on different return codes, How to do it…, How it works…
  • acting on / Capturing and acting on different return codes, How to do it…, How it works…
• rewritable lookups
  • in-process database, using / Background, How to do it…
• row information
  • displaying, tJavaRow component used / Using tJavaRow to display row information, How it works...
• rows
  • components, rejecting / How to do it…
  • rejecting, tMap used / Rejecting rows using tMap, How to do it…
  • reading, regular expression used / Reading rows using a regular expression, How it works..., There's more…

S

• schema changes
  • propagating / Propagating schema changes, How to do it…, How it works…
• schema information
  • cutting / Cutting and pasting schema information
  • psting / Cutting and pasting schema information
• schema metadata
  • about / Schema metadata
• schemas
  • about / Schemas
  • repository schemas / Repository schemas
  • generic schemas / Generic schemas
  • fixed schemas / Fixed schemas and columns
  • dropping / Dropping schemas to empty components, How it works…
  • creating, from lists / Creating schemas from lists, How to do it..., How it works…
• sequences
  • about / Sequences
  • used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
• sessions
  • commit strategy, confirming / There's more…, Committing but not closing
  • passing, to child job / Passing a session to a child job, How it works…
  • used, for ensuring lossless queue / Ensuring lossless queues using sessions, How it works...
• shared schemas
  • about / Shared schemas
• show view method / Show view:
• simple mapping
  • about / Simple mapping and tMap time savers
• single ternary expression / Single ternary expression: if-then-else
• SOAP web service
  • about / Introduction
  • calling / Calling a SOAP web service, How to do it..., There’s more…
  • response, decoding / Decoding the response
• SQL queries
  • context variables, using / Using context and globalMap variables in SQL queries
  • globalMap variables, using / Using context and globalMap variables in SQL queries
• SQL string / SQL string
• SQL style / SQL style
• status messages
  • displaying, tJava component used / How to do it...
• subjob component tab / Job "shape"
• surrogate keys
  • managing, for parent tables / Managing surrogate keys for parent and child tables, How it works…
  • managing, for child tables / Managing surrogate keys for parent and child tables, How it works…
• System.exit command / How it works...

T

• table related commands
  • executing / Database and table management, How it works…
• tables
  • creating / Creating tables
• table schemas
  • importing / Importing the table schemas, How it works...
• Talend
  • job dependencies, managing within / Managing job dependencies within Talend
• Talend 5.2.3
  • about / Enabling tHashInput and tHashOutput
• Talend debug mode
  • about / Using the Talend debug mode – row-by-row execution
  • using, steps / How to do it..., How it works...
• Talend jobs
  • about / Introduction
  • debugging, Java debugger used / Using the Java debugger to debug Talend jobs, How to do it..., How it works...
• Talend Open Studio
  • key concepts / Before you begin
  • installing / Installing the software, How to do it…
  • URL, for downloading / How to do it…
  • context variables, manipulating / Manipulating contexts in Talend Open Studio
• Talend supplied wizard
  • used, for setting up database connection / Setting up a database connection, How to do it..., How it works...
• tContextDump component
  • about / How to do it...
• tContextLoad
  • used, for loading contexts / How to do it..., There’s more…
  • print operations / Print operations
  • variations, of warnings / Warnings
  • context file location / Context file location
• tContextLoad method
  • about / Understanding tContextLoad
  • pros / Understanding tContextLoad
  • cons / Understanding tContextLoad
• tCreateFileTemporary component / How to do it...
• tCreateTemporaryFile component / How it works...
• tDie component / How to do it…, Validation subjob, Killing a job from within tJavaRow
• temporary files
  • using / Using temporary files, How it works...
• ternary in ternary expression / Ternary in ternary: if-then-elsif-then-else
• ternary operator
  • using, for conditional logic / Using the ternary operator for conditional logic, How it works…, There's more…
• tESBConsumer component
  • about / How to do it...
• test data
  • creating, tRowGenerator component used / How to do it..., How it works...
  • creating, Excel used / Creating test data using Excel, How it works...
• testing
  • about / Testing
• tFileCopy component / There's more…
• tFileDelete component / There's more…
• tFileInputDelimited component / How to do it…, There's more..., How it works…
  • about / How to do it...
• tFileInputFullRow / How it works...
• tFileInputRegex / How to do it...
• tFileInputXML component
  • about / How to do it...
• tFileList component / Concatenating files using the append method
• tFileOutputDelimited / How to do it...
• tFileOutputDelimited component / tJavaRow code explained
• tFileOutputMSDelimited / There's more…
• tFileProperties component / How to do it..., How it works...
• tFileRowCount component / How it works..., How it works...
• tFixedFlowInputs / How it works...
• tFlowToIterate / So here we go…
• tFlowToIterate component / How it works...
  • about / tFlowToIterate
  • used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
• tHash components / So here we go…
  • about / tHash components
• tHashInput
  • enabling / Enabling tHashInput and tHashOutput
• tHashMap component
  • used, for storing intermediate data in memory / Storing intermediate data in the memory using tHashMap, How it works...
• tHashOutput
  • enabling / Enabling tHashInput and tHashOutput
• three-tier XML structure
  • building / Method
• time servers, tMap component / Simple mapping and tMap time savers, How to do it..., How it works...
• tJava component / There's more…
  • about / Performing one-off pieces of logic using tJava, Using tJava to display status messages and variables
  • one-off logic, adding to job / How to do it…
  • used, for setting globalMap variables / Setting the context and globalMap variables using tJava, How to do it…
  • used, for setting context variables / Setting the context and globalMap variables using tJava, How to do it…
  • used, for displaying status messages / How to do it...
  • used, for displaying variables / How to do it...
• tJavaFlex component
  • about / Creating pseudo components using tJavaFlex
  • used, for creating pseudo components / How to do it…, How it works…
• tJavaRow component
  • about / Adding complex logic into a flow using tJavaRow
  • used, for adding complex logic into flow / Adding complex logic into a flow using tJavaRow, How to do it…, How it works…
  • used, for displaying row information / Using tJavaRow to display row information, How it works...
  • job, killing from within / Killing a job from within tJavaRow, How it works...
• tLogRow component
  • used, for displaying data in row / Using tLogRow to show data in a row, How it works...
• tMap
  • used, for rejecting rows / Rejecting rows using tMap, How to do it…
• tMap component
  • about / The tMap component, Introduction
  • capabilities / The tMap component
  • flexibility feature / The tMap component
  • single line of code / Single line of code
  • batch versus real time / Batch versus real time
  • time servers / Simple mapping and tMap time savers, How to do it..., How it works...
  • espression editors / Expression editor
  • intermediate variables, using / Using intermediate variables in tMap, How to do it…, How it works…
  • input rows, filtering / Filtering input rows, How it works…
  • used, for joining data / Joining data using tMap, How to do it..., How it works…
  • data, joining in hierarchical fashion / Hierarchical joins using tMap
  • reload, used at each row for processing real-time data / Using reload at each row to process real-time / near real-time data, How to do it..., The result
  • features / tMap
  • used, for reading headers / Reading headers and trailers using tMap, How to do it..., There's more…
  • used, for reading trailers / Reading headers and trailers using tMap, How to do it..., There's more…
  • used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
  • rejects, capturing / Capturing tMap rejects
  • variables, printing / Printing tMap variables
• tMap expressions
  • creating / Creating tMap expressions, How to do it..., How it works...
  • testing / Testing expressions
• tMomCommit component
  • about / There's more…
• tMomInput component
  • about / There's more…
• tMysqlCommit component / Committing but not closing
• tMysqlConnection component
  • about / How it works…
  / How it works…
• tMysqlOutput component
  • about / How it works…
• tMysqlRow component / How it works…
• trailer
  • information, using in / Using the information in the header and trailer
  • adding, to file / Adding a header and trailer to a file, How it works...
• trailer information
  • used, for validation / Validating using the trailer information
• trailers
  • reading, tMap component used / Reading headers and trailers using tMap, How to do it..., There's more…
  • reading, with no identifiers / Reading headers and trailers with no identifiers, How to do it..., How it works...
• tRestClient component / How it works...
• tRowGenerator component
  • about / Creating simple test data using tRowGenerator
  • test data, creating / How to do it..., How it works...
  • used, for creating complex test data / Creating complex test data using tRowGenerator, tFlowToIterate, tMap, and sequences, How it works...
• tRunjob component
  • about / How it works…
• tSchemaComplianceCheck component / Validating against the schema, How it works…
• tSystem component
  • about / How to do it…, How it works…
• tWriteXMLField / So here we go…, tWriteXMLField
• tWriteXMLField component
  • about / Introduction
• tXMLMap component
  • about / Introduction
  • used, for reading XML / Using tXMLMap to read XML, How to do it..., How it works...
  • used, for creating XML document / Using tXMLMap to create an XML document, There's more…
• tXMLOutput component
  • about / Introduction

U

• UI
  • resetting, to original format / Reset the perspective

V

• validateCustomerAge method / How it works…
• validation files
  • processing / Processing control/validation files, How to do it..., How it works...
• validation rules
  • creating / Creating validation rules for more complex requirements, How to do it…, There's more…
• validation subjob / Validation subjob
• variables
  • displaying, tJava component used / How to do it...
• variable values
  • updating, in context group / Prompt for variable values using the tree mode

W

• web service calls in-flow
  • using / Using web service calls in-flow
• web services
  • about / Introduction
• web service XML / Web service XML

X

• XML
  • reading, tXMLMap component used / Using tXMLMap to read XML, How to do it..., How it works...
• XML document
  • creating, tXMLMap component used / Using tXMLMap to create an XML document, There's more…
• XML Schema Definition (XSD) / XML Structure
• XML Structure
  • about / XML Structure
• XML structure
  • about / Understanding the XML structure
• XPATH
  • about / Introduction, XPATH
• XPATH Condition / XPATH Condition