Project Configuration

Overview

Automatic Job Execution Reporting ensures that your execution statistics are always collected and reported, for the flows that you monitor. Information on execution row counts are comprehensively reported via a Spreadsheet, which may be, optionally, sent by Email.

Configuring your Project

Configuration for Job Execution Statistics is the same, whether you’re installing the Talend Framework into a new, or an existing Project. If you are installing into an existing Project, please also read Configuring for an Existing Project, before making changes.

As an alternative to making these project property changes manually you may download a pre-configured properties file that you can import in to your project; however, please note that if you have already made your own custom changes, these will need to be reapplied.

md5: 30293c38663802be58cb8e6a105892a7
sha1: 1575ac8409c6c6685b2e7164a9937aae84ec0917

Download Talend Framework v1.5

Manual Configuration

Talend allows you to record execution statistics on a number of targets, including a database and flat files. The Framework uses statistics that are collected in files.

Stats & Logs is accessed via the following Talend menu: –

File->Edit Project properties->Job Settings->Stats & Logs

Configure Stats & Logs, as shown in the screenshot below. You can copy and paste, the following value in to File Path.

Framework.getDefaultStatsDir(context.statsDir, context.baseDir, contextStr, projectName, jobName)

It is also recommended that you date-stamp your individual statistics files – Stats, Logs & Meter. This ensures that they do not become excessively large, and can be periodically pruned during File System Maintenance.

String.format("stats_file.%s.txt", TalendDate.formatDate("yyyyMMdd", TalendDate.getCurrentDate()))
String.format("logs_file.%s.txt", TalendDate.formatDate("yyyyMMdd", TalendDate.getCurrentDate()))
String.format("meter_file.%s.txt", TalendDate.formatDate("yyyyMMdd", TalendDate.getCurrentDate()))
Project Settings Stats & Logs
Project Settings Stats & Logs

Configuring an Existing Project

If you are installing the Talend Framework in to an existing Project, you may already be collecting statistics to files. If you are, then you may want to keep existing values for File Path and File Names. For more information on File Path, see Alternative File Path Settings, below.

Alternative File Path Settings

If you use the default Framework File Path value, statistics will be collected in a directory that is determined by the Framework.

Framework.getDefaultStatsDir(context.statsDir, context.baseDir, contextStr, projectName, jobName)

If context.statsDir is set, it will be used; otherwise, the value for File Path will be determined from the other parameters. You may pass a literal string, as shown in the example below; however, it is recommended that you always set your own value, by passing context.statsDir.

Framework.getDefaultStatsDir("#BASEDIR/talend_stats", context.baseDir, contextStr, projectName, jobName)

You will see that this allows you to take advantage of the Framework’s Token Substitution.

By default, the Talend Framework defines individual statistics directories, for each Job. If you collect statistics in a single File Path location, you may want to consider the size and fragmentation of these files.