Limit search to available items
Book Cover
E-book
Author Barton, Richard Daniel

Title Talend Open Studio cookbook : over 100 recipes to help you master Talend Open Studio and become a more effective data integration developer / Rick Barton
Published Birmingham, UK : Packt Publishing, ©2013

Copies

Description 1 online resource (270 pages)
Contents Cover; Copyright; Credits; About the Author; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Introduction and General Principles; Before you begin; Installing the software; Enabling tHashInput and tHashOutput; Chapter 2: Metadata and Schemas; Introduction; Hand-cranking a built-in schema; Propagating schema changes; Creating a generic schema from the existing metadata; Cutting and pasting schema information; Dropping schemas to empty components; Creating schemas from lists; Chapter 3: Validating Data; Introduction; Enabling and disabling reject flows
Gathering all rejects prior to killing a jobValidating against the schema; Rejecting rows using tMap; Checking a column against a list of allowed values; Checking a column against a lookup; Creating validation rules for more complex requirements; Creating binary error codes to store multiple test results; Chapter 4: Mapping Data; Introduction; Simple mapping and tMap time savers; Creating tMap expressions; Using the ternary operator for conditional logic; Using intermediate variables in tMap; Filtering input rows; Splitting an input row into multiple outputs based on input conditions
Joining data using tMapHierarchical joins using tMap; Using reload at each row to process real-time / near real-time data; Chapter 5: Using Java in Talend; Introduction; Performing one-off pieces of logic using tJava; Setting the context and globalMap variables using tJava; Adding complex logic into a flow using tJavaRow; Creating pseudo components using tJavaFlex; Creating custom functions using code routines; Importing JAR files to allow use of external Java classes; Chapter 6: Managing Context Variables; Introduction; Creating a context group; Adding a context group to your job
Adding contexts to a context groupUsing tContextLoad to load contexts; Using implicit context loading to load contexts; Turning implicit context loading on and off in a job; Setting the context file location in the operating system; Chapter 7: Working with Databases; Introduction; Setting up a database connection; Importing the table schemas; Reading from database tables; Using context and globalMap variables in SQL queries; Printing your input query; Writing to a database table; Printing your output query; Managing database sessions; Passing a session to a child job
Selecting different fields and keys for insert, update, and deleteCapturing individual rejects and errors; Database and table management; Managing surrogate keys for parent and child tables; Rewritable lookups using an in-process database; Chapter 8: Managing Files; Introduction; Appending records to a file; Reading rows using a regular expression; Using temporary files; Storing intermediate data in the memory using tHashMap; Reading headers and trailers using tMap; Reading headers and trailers with no identifiers; Using the information in the header and trailer
Summary Primarily designed as a reference book, simple and effective exercises based upon genuine real-world tasks enable the developer to reduce the time to deliver the results. Presentation of the activities in a recipe format will enable the readers to grasp even the complex concepts with consummate ease. Talend Open Studio Cookbook is principally aimed at relative beginners and intermediate Talend Developers who have used the product to perform some simple integration tasks, possibly via a training course or beginner's tutorials
Notes Print version record
Subject Data integration (Computer science)
Database management.
COMPUTERS -- Database Management -- General.
Data integration (Computer science)
Database management
Form Electronic book
ISBN 9781461949503
1461949505
9781782167273
1782167277