Head Stage in DataStage

Welcome to Basic Intro with Stage Series, We are going to look into HEAD stage ( Developmet/Dubug Categoty).  It can have a single input link and a single output link. 

The Head Stage selects the first N rows from each partition of an input data set and copies the selected rows to an output data set. You determine which rows are copied by setting properties which allow you to specify:

• The number of rows to copy
• The partition from which the rows are copied
• The location of the rows to copy
• The number of rows to skip before the copying operation begins.

DataStage Scenario - Problem2

Goal : To get the Unique and Duplicates values from Input Data

 

Input :

There is a input file which contains duplicates data, Suppose :

DataStage Scenario - Problem1

Goal :

Process a text file which contains records arranged in blocks consisting of a header record, details (items, body) and a trailer. The aim is to normalize records and load them into a relational database structure.

Details :

Development/Debug Stage in DataStage

Head stage

The Head Stage is a Development/Debug stage. It can have a single input link and a single output link.

It is one of a number of stages that InfoSphere DataStage provides to help you sample data

The Head Stage selects the first N rows from each partition of an input data set and copies the selected

rows to an output data set. You determine which rows are copied by setting properties which allow you

to specify:

·         The number of rows to copy

·         The partition from which the rows are copied

·         The location of the rows to copy

·         The number of rows to skip before the copying operation begins

This stage is helpful in testing and debugging applications with large data sets. For example, the Partition

property lets you see data from a single partition to determine if the data is being partitioned as you

want it to be. The Skip property lets you access a certain portion of a data set.