Something about DataStage, DataStage Administration, Job Designing,Developing, DataStage troubleshooting, DataStage Installation & Configuration, ETL, DataWareHousing, DB2, Teradata, Oracle and Scripting.
Showing posts with label load. Show all posts
Showing posts with label load. Show all posts
Saturday, May 30, 2015
Data Warehouse Load Methods
A data warehouse is a warehouse that contains data. Sounds funny doesn't it? Imagine a warehouse as a storage structure that may be physical or logical. In the DW it's both...logical as in the data model representation and physical as to the hard disks and other computer equipment that support the data warehouse.
The first question should be "How does the data get there?" Here are three key areas to keep in mind....
Availability - will someone create a report with transactions completed 20 minutes ago or will it be with yesterday's data?
Friday, November 22, 2013
ETL Job Design Standards - 2
This section defines standards to manage job parameters
across environments. Jobs should use parameters liberally to avoid hard coding
as much as possible. Some categories of parameters include:
- Environmental parameters, such as directory names, file names, etc.
- Database connection parameters
- Notification email addresses
- Processing options, such as degree of parallelism
Labels:
Administration
,
Data
,
DataStage
,
design
,
ETL
,
exception
,
handling
,
Job
,
load
,
notification
,
Optimizing
,
parameter
,
performance
,
report
,
source
,
Standards
,
statistics
,
tips
Friday, May 24, 2013
Issuing commands to a Queue Manager (runmqsc)
Once we have created a Queue Manager, we will want to
perform administrative tasks, such as creating queues, among others. To enable
us to communicate with our Queue Manager, we use the RUNMQSC MQ command,
which opens the MQSC (MQ Script Center) environment.
After entering the MQSC environment, we can issue one of the following MQSC commands: ALTER, CLEAR, DEFINE, DELETE, DISPLAY, END, PING, REFRESH, RESET, RESOLVE, RESUME, START, STOP, or SUSPEND. Each of these commands has it's own options, which are shown in the following table:
Wednesday, May 08, 2013
Friday, May 03, 2013
Tuesday, April 23, 2013
Read/Write/Load Message with MQ : Part-1
Previous Post : What is MQ Stage ???
Stage MQ: The 3 parameters are:
Queue manager, User and Password.
Subscribe to:
Posts
(
Atom
)
