How to Remove Duplicates in Datastage?
In Datastage, duplicates can be removed using the four ways:
- Through the Duplicate Removal Stage
- Using the Hash File Stage.
- Using a sort stage and setting ALLOW DUPLICATES: false
- It can be done at any stage by doing a hash portion of the input data and checking options under Sort and Unique.
BY Best Interview Question ON 06 Jun 2020