Delete Duplicate Rows in DB2 Database

Many times and Many places, this question is being asked :-) that How to delete the duplicate row from a table in different DBs. Here, we will see How to do this in DB2 DB.

Create table from another table in TeraData database

Same Queries for Teradata DBs -


===========================================================================
===========================================================================

Create table from another table in Oracle database

How to do the same in Oracle DB as we did in DB2 -Create table from another table in DB2 database
In Oracle, it is quite simple to create the duplicate tables with data :-)

Let's see How --

DataStage Scenario - Design5 - job1

DataStage Scenario Problem -->  DataStage Scenario - Problem5

  

Solution Design :

a) Job Design :

Below is the design which can achieve the output as we needed. Here, we are reading seq file as a input, then data is passing through a Sort and Transformer stage to achieve the output.

DataStage Scenario - Design4 - job1

DataStage Scenario Problem -->  DataStage Scenario - Problem4

Solution Design :

a) Job Design :

Below is the design which can achieve the output as we needed. Here, we are reading seq file as a input, then data is passing through a Sort and Transformer stage to achieve the output.

datastage4you QAnT - April2013 - 2

Click here ---> datastage4you QAnT - April2013 - 1

#14. DataStage Server – starting the server
a) DB2
su - db2inst1 -c "db2start“
b) WAS Server
/opt/IBM/WebSphere/AppServer/bin/startServer.sh server1 -user wasadmin -password PASSWORD
c) NODE
/opt/IBM/InformationServer/ASBNode/bin/NodeAgents.sh start
d) Engine
/opt/IBM/InformationServer/Server/DSEngine/bin/uv -admin -start

datastage4you QAnT - April2013 - 1

 #1. Use the Data Set Management utility, which is available in the Tools menu of the DataStage Designer or the DataStage Manager, to examine the schema, look at row counts, and delete a Parallel Data Set. You can also view the data itself.

#2. Use Sort stages instead of Remove duplicate stages. Sort stage has got more grouping options and sort indicator options.

#3. for quick checking if DS job is running on Server or not from UNIX
ps -ef | grep 'DSD.RUN'

Sort stage to remove duplicate

1)what is the advantage of using sort stage over remove duplicate stage in removing duplicates.
2) Is there any way in which we can specify which record to retain(like retaining the last record or retaining the first) when we remove duplicate using transform stage, similarly in sort stage also.

Ans : 

1)The advantage of using sort stage over remove duplicate stage is that sort stage allows us to capture the duplicate records whereas remove duplicate stage does not.

2) Using a sort stage we can only retain the first record.
Normally we go for retaining last when we sort a particular field in ascending order and try to get the last rec. The same can be done using sort stage by sorting in descending order to retain the first record.

How to find duplicate values in a table?

With the SQL statement below you can find duplicate values in any table, just change the tablefield into the column you want to search and change the table into the name of the table you need to search.