5 Tips For Better DataStage Design #17
Atul Singh
December 01, 2020
1. For data being passed between Jobs, such as parallel jobs in a sequence, Datasets must be used and not sequential files. 2. Utility jobs...
Showing posts with label design. Show all posts
Showing posts with label design. Show all posts
Tuesday, December 1, 2020
Tuesday, December 25, 2018
MongoDB - Embedding v/s Referencing
Atul Singh
December 25, 2018
MongoDb, a NoSQL document DB, doesn't support the JOIN as RDBMS do which is a very useful feature in DB domain. So what's new or ad...
Wednesday, July 5, 2017
Conditionally Aborting Jobs with Transformer Stage
Atul Singh
July 05, 2017
How to develop a job which will stop processing when FROM_DATE and TO_DATE is equal in data? Or I want to abort the job when reject row co...
Wednesday, April 5, 2017
NULL Handling in Sequential File Stage
Atul Singh
April 05, 2017
DataStage has a mechanism for denoting NULL field values. It is slightly different in server and parallel jobs. In the sequential file sta...
Wednesday, January 18, 2017
5 Tips For Better DataStage Design #17
Atul Singh
January 18, 2017
** There is an automap button in some stages,it can maps fields with the same names. ** When you ...
Saturday, October 8, 2016
#2 DataStage Solutions to Common Warnings/Error - Null Handling
Atul Singh
October 08, 2016
Warnings/Errors Related to Null Handling - 1.1 When checking operator: When binding output interface field “XXXXX” to field “XXXX...
Monday, August 29, 2016
Modify Stage - What's been promised
Atul Singh
August 29, 2016
Modify stage, one of the most un-used stage in DataStage but very useful in terms of performance tuning. It is advisable to Developers not ...
Sunday, August 21, 2016
5 Tips For Better DataStage Design #15
Atul Singh
August 21, 2016
1. Stage variable does not accept null value. Hence no null able column should be directly mapped to stage variable without null handling....
Monday, August 8, 2016
ETL Strategy #2
Atul Singh
August 08, 2016
Continued...... ETL Strategy #1 Delta from Sources extracted by Timestamp This project will use the Timestamp to capture the deltas f...
Monday, July 18, 2016
ETL Strategy #1
Atul Singh
July 18, 2016
The ETL Load will be designed to extract data from all the required Data Sources. The data to feed the Next Gen BI Database will have to b...
Wednesday, June 15, 2016
5 Tips For Better DataStage Design #14
Atul Singh
June 15, 2016
1. The use of Lookup stage depends upon the volume of data.Sparse lookup type should be used when primary input data volume is small.If th...
Monday, May 16, 2016
Lookup Stage behaviour
Atul Singh
May 16, 2016
Today, I am gonna ask you a question, What value I will get from lookup when my datatype is integer (Not Null) and there is no match b/w s...
Tuesday, May 3, 2016
Otherwise Constraint - A Quick DataStage Recipe
Atul Singh
May 03, 2016
Recipe: How to use "Otherwise" constraint in Transformer Stage How To: To use "Otherwise" constraint in Trans...
Sunday, April 24, 2016
Suppress Warnings - A Quick DataStage Recipe
Atul Singh
April 24, 2016
Recipe: How to suppress job warnings in DS job log HowTo: Add "rule" in Message Handler Method: From DS Director, f...
Monday, April 18, 2016
10 Scenario based Interview Questions #2 - DataStage
Atul Singh
April 18, 2016
11. Design a job which insert the data if not exists and update if exists in target 12. Design a job which includes a header and footer i...
Sunday, April 10, 2016
5 Tips For Better DataStage Design #12
Atul Singh
April 10, 2016
1. Minimum number of sort stages should be use in a datastage job. “Don’t sort if previously sorted” in sort Stage, this option should be ...
Monday, April 4, 2016
DataStage Scenario #16 - Cross duplicate Removal
Atul Singh
April 04, 2016
Need to remove duplicate where source or destination can be switched. Input: source destination distance cit...
Monday, March 28, 2016
10 Scenario based Interview Questions #1 - DataStage
Atul Singh
March 28, 2016
1. Design a job which convert single source row to three target row. 2. Design a job which can identify the row if they are duplicate in i...
Wednesday, March 23, 2016
5 Tips For Better DataStage Design #11
Unknown
March 23, 2016
When writing intermediate results that will only be shared between parallel jobs, always write to persistent data sets (using Data Set ...
Tuesday, March 22, 2016
Transformer Stage alternative - A Quick DataStage Recipe
Atul Singh
March 22, 2016
What to use instead of "Transformer" Stage Copy Stage Use "Copy" stage instead of "Transformer" Stage fo...
