We have moved to www.dataGenX.net, Keep Learning with us.

Saturday, April 27, 2013

Local and Shared Containers

As the name suggest local container (LC) contains the stages locally in the job and shared container (SC) contains stage in the job as well as allow its usage to other jobs. Differences or qualities between these two types of containers can be listed as follows:


Local Containers

1) Mainly used to ease the job design.
2) Piece of logic can be combined together and used inside a job.
3) Can only be used in the job after its creation.
4) Number of input and output links supported by local containers.
5) Availability throughout the job.


Shared Containers

1) Used to ease the job design as well as to be shared between the jobs.
2) Availability throughout the project.
3) Shared containers needs metadata mapping.
4) Shared containers can be saved independently.
5) Job needs to be recompiled once the definition of the shared container changed.
6) Shared container can not be compiled independently.
7) Once used inside the job the code for shared containers gets included into the code for the containing job.

Few interesting fatcs about the containers as well, we can use server container into the parallel job. Server container will not impact the parallelism of the job just because it has been used inside. But interesting thing is that the server container will be operated parallely just becase the parallel job can be executed in multiple copies.