Talend Framework 1.7 Release Notes

What’s new in Talend Framework 1.7

Job: TemplateTask

Introduction of a new Template Job, which replaces Job: TemplateChild.

These two Jobs are functionally equivalent, however, Job: TemplateTask has additional documentation for improved Exception handling, as well as having a more meaningful name.

Job: TemplateChild has been deprecated.

Job: TemplateOrchestrate, TemplateOrchestrateCP

Introduction of two new Template Jobs, which allow you to orchestrate your task Jobs.

Job: TemplateOrchestrate is now called by Job: TemplateProcess (the default). Job: TemplateOrchestrateCP (recommend) includes checkpointing; however, is will be necessary for you to install the custom component (also by the authors of the Talend Framework) tCheckpoint.

It is permissible for an orchestration Job to call another orchestration Job, or Job: TemplateTask directly.

For an example of orchestration, take a look at the template Job: TMigrate.

Job: TMigrate

Job: TMigrate is a new template Job that is built for Data Migration and other similar activities.

Job: GenSampleData

Introduction of a new example Job that demonstrates many of the features of the Talend Framework 1.7.

Class: Framework (Routines)

The static Framework class now includes some additional features.

sharedMap

The Framework class now supports a Concurrent Hash Map that is available to all Jobs. A number of setters and getters are provided, for convenience. This new, globally accessible, object simplifies the passing of certain parameters from a Job to its parent and sibling Jobs.

A number of standard sharedMap objects are made available for interacting with the Framework.

Framework.Orchestration.Execute.Next

Determines if the next orchestration Job should be executed. Allows a graceful end to orchestration, when set to false.

Framework.Last.Error.Message

Allows an error message to be set prior to Job termination, in the event of an error. This message may be used during Framework exception handling and reporting. This value may be set by the Framework as well as being set or appended to by developer-generated code.

context.documentationURL

Allows a documentation URL to be specified, which may be incorporated within error messages.

context.logDirRetentionDays

Allows the retention period of aged log files, to be specified.

Job: LibPruneFileSystem

Added the ability to prune statsDir, using the same retention policy as logDir.

Routines

Improvements and bug fixing to the following routines.

  • StringUtils
  • FieldHelper
  • QualityHelper
  • LookupHelper

Installation

If you are installing the Talend Framework version 1.7 in to a project where a previous version of the Talend Framework has not been installed, please follow these instructions.

If you are upgrading from a previous version of the Talend Framework, you should follow these same instructions; but you should also take note of the recommendations under Upgrading, below.

Upgrading

If you’re upgrading your project from a version of the Talend Framework prior to version 1.4, then should should follow the usual installation instructions; however, you should note the following.

Context Groups

If you have made your own changes to the default values of any Framework Context Groups, then you will need to re-apply these changes. Prior to installation, you should ensure that you have made a note of what these changes are.

It is not, normally, expected that that you will be changing these values; however, there may be some circumstances where you have chosen to modify default values within the following two Context Groups.

  • Framework
  • FileSystem

It is not recommended that you directly modify default values in any of the other Framework Context Groups. These values should always be modified using Context Files and the Context Loader.

File System Default Value Changes

Version 1.4 of the Talend Framework introduced some changes to the default File System locations. This was to simplify your file system structure and administration.

It is recommended that you use these new defaults; however, you may amend these to the previous values, if you choose.

Parameter1.31.4
inputDir#BASEDIR/input#BASEDIR/#JOBNAME/input
outputDir#BASEDIR/output#BASEDIR/#JOBNAME/output
workingDir#BASEDIR/working#BASEDIR/#JOBNAME/working
tmpDir#BASEDIR/tmp#BASEDIR/#JOBNAME/tmp
archiveDir#BASEDIR/archive#BASEDIR/archive
reportingDir#BASEDIR/reporting#BASEDIR/reporting
databaseDir#BASEDIR/database#BASEDIR/#JOBNAME/database
paramDir#BASEDIR/param#BASEDIR/#JOBNAME/param
logDir#BASEDIR/log#BASEDIR/#JOBNAME/log
binDir#BASEDIR/bin#BASEDIR/bin
libDir#BASEDIR/lib#BASEDIR/#JOBNAME/lib
gLibDir#HOME/project/talend/#CONTEXTSTR/lib#BASEDIR/lib
targetDir#BASEDIR/target#BASEDIR/#JOBNAME/target
lockDir#BASEDIR/lock#BASEDIR/lock
baseDir#HOME/project/talend/#CONTEXTSTR/#PROJECTNAME/#JOBNAME#HOME/project/talend/#CONTEXTSTR/#PROJECTNAME
statsDir#BASEDIR/stats#BASEDIR/#JOBNAME/stats
contextDir#BASEDIR/context#BASEDIR/context
checkpointDir#BASEDIR/checkpoint#BASEDIR/#JOBNAME/checkpoint