Something about DataStage, DataStage Administration, Job Designing,Developing, DataStage troubleshooting, DataStage Installation & Configuration, ETL, DataWareHousing, DB2, Teradata, Oracle and Scripting.
Tuesday, April 16, 2013
More Warnings causes Low Performance in DataStage. WHY ???
Warning messages are bad in any programming language; more so, in the case of DataStage.
This is because DataStage is typically used for large scale processing of data. Every time a warning message is encountered, the engine code has to encounter an exception handler, throw the warning message and resume its task.
If you think about this happening for 10-s of millions of records, you can understand why performance suffers.
In certain cases. DataStage Director is "smart" enough to not to throw the warning messages more than few times. Nevertheless, for best performance, we need to understand what the warning messages say and how to handle them.
till then.....
njoy the simplicity.......
Labels:
Concept
,
DataStage
,
design
,
Errors
,
Job
,
Logging
,
logs
,
performance
,
statistics
,
tips
,
Troubleshoot
,
warnings