Types of Jobs in DataStage

Server jobs

• Executed by the DataStage server engine
• Compiled into Basic
• Runtime monitoring in DataStage Director
• No parallel capability

Get Datastage Job Lock List by Script

** This script will fetch all locks currently on Datastage Server irrespective of Projects.
** We can modify this script to correct the data display format as per our need
** Can modify sort command as it changes its behavior in different Linux flavour

DataStage Warning - dsjob Command Returns Status code = 80011

Running dsjob utility with or without -domain option results in an error message: Status Code = 80011

Resolution -

The dsjob utility is unable to authenticate and validate against the DataStage Engine.

Use -domain NONE option.

Some DataStage Job design

Updating the Master Reports List (MRL) in Datastage

Create a Job which has a Row Generator stage linking to an ODBC or DB2 stage. Change the parameter in the Row Generator stage to output zero records. Write the SQL to update the MRL table as 'After SQL' in the output ODBC or DB2 stage.

DOS Batch Script to Export DataStage Jobs Automatically from a Project

Copy the following script into a text file and rename into ".bat" file.

 This batch script is used to Export all jobs from a Projects
 This script must be run from a DataStage client machine and the parameters below should be given

 Host is server name
 User is DataStage username
 Password is DataStage password
 Imp Location is the directory where the datastage dsx's are stored

DataStage BASIC functions

These functions can be used in a job control routine, which is defined as part of a jobs properties and allows other jobs to be run and controlled from the first job. Some of the functions can also be used for getting status information on the current job; these are useful in active stage expressions and before- and after-stage subroutines. 


Specify the job you want to control
DSAttachJob

When datastage file system becomes full, RT_LOGxxx files can become corrupted. Here is a manual procedure to recreate them

When many datastage jobs are running for long time, the RT_LOGxxx files can become very big. If the log files are not regularly purged, in some cases, a file system full on the datastage file system can occur. If the corruption of datastage system files is restricted to the RT_LOGxxx files, a procedure to delete and recreate the RT_LOGxxx files can be attempted in order to recover from the corruption.

Selecting DataStage job log results in error: Error Selecting from log file RT_LOG

When trying to view a job log in DataStage Director, an error similar to the following is received:

Error selecting from log file RT_LOGnn
Command was: SSELECT RT_LOGnn WITH @ID LIKE '1NON' COUNT.SU
Error was: Internal data error. File <path_to>/RT_LOGnn/<filename>':
Computed blink of 0xnnnn does not match expected blink of 0xnnnn! Detected within group starting at address 0xnnnnnn!
The error message received indicates that the log file for the job is corrupted.

datastage4you QAnT - April2013 - 1

 #1. Use the Data Set Management utility, which is available in the Tools menu of the DataStage Designer or the DataStage Manager, to examine the schema, look at row counts, and delete a Parallel Data Set. You can also view the data itself.

#2. Use Sort stages instead of Remove duplicate stages. Sort stage has got more grouping options and sort indicator options.

#3. for quick checking if DS job is running on Server or not from UNIX
ps -ef | grep 'DSD.RUN'

Know your DataStage Jobs Status without Director

Hi All
I am getting lot of comments abt a post in which I wrote a script for Monitoring the job without director, But I have removed that due to some code issue.

Here, I wrote a small script to check the job status without director...

InfoSphere DataStage Jobstatus returned Codes from dsjob

Equ DSJS.RUNNING To		0		This is the only status that means the job is actually running
Equ DSJS.RUNOK To		1		Job finished a normal run with no warnings
Equ DSJS.RUNWARN To		2		Job finished a normal run with warnings

DataStage job status log values

They show what values can be used when designing job sequencers when defining triggers or nested conditions. Values are also helpful when using DataStage "dsjob" utility from the operating system command line.

UNIX Script to execute DataStage job

By Kenneth Bland :

UNIX Script to execute DataStage job, you can access the same on here also