Conditionally Aborting Jobs with Transformer Stage
Atul Singh
July 05, 2017
How to develop a job which will stop processing when FROM_DATE and TO_DATE is equal in data? Or I want to abort the job when reject row co...
Showing posts with label develop. Show all posts
Showing posts with label develop. Show all posts
Wednesday, 5 July 2017
Wednesday, 18 January 2017
5 Tips For Better DataStage Design #17
Atul Singh
January 18, 2017
** There is an automap button in some stages,it can maps fields with the same names. ** When you ...
Monday, 29 August 2016
Modify Stage - What's been promised
Atul Singh
August 29, 2016
Modify stage, one of the most un-used stage in DataStage but very useful in terms of performance tuning. It is advisable to Developers not ...
Monday, 22 August 2016
5 Tips For Better DataStage Design #15
Atul Singh
August 22, 2016
1. Stage variable does not accept null value. Hence no null able column should be directly mapped to stage variable without null handling....
Monday, 8 August 2016
ETL Strategy #2
Atul Singh
August 08, 2016
Continued...... ETL Strategy #1 Delta from Sources extracted by Timestamp This project will use the Timestamp to capture the deltas f...
Tuesday, 19 July 2016
ETL Strategy #1
Atul Singh
July 19, 2016
The ETL Load will be designed to extract data from all the required Data Sources. The data to feed the Next Gen BI Database will have to b...
Thursday, 16 June 2016
5 Tips For Better DataStage Design #14
Atul Singh
June 16, 2016
1. The use of Lookup stage depends upon the volume of data.Sparse lookup type should be used when primary input data volume is small.If th...
Tuesday, 17 May 2016
Lookup Stage behaviour
Atul Singh
May 17, 2016
Today, I am gonna ask you a question, What value I will get from lookup when my datatype is integer (Not Null) and there is no match b/w s...
Monday, 25 April 2016
Suppress Warnings - A Quick DataStage Recipe
Atul Singh
April 25, 2016
Recipe: How to suppress job warnings in DS job log HowTo: Add "rule" in Message Handler Method: From DS Director, f...
Monday, 18 April 2016
10 Scenario based Interview Questions #2 - DataStage
Atul Singh
April 18, 2016
11. Design a job which insert the data if not exists and update if exists in target 12. Design a job which includes a header and footer i...
Thursday, 14 April 2016
ETL Code Review Checklist
Atul Singh
April 14, 2016
Guideline Design jobs for restartability/ if not designed then what is the reason ? Do not follow Sequential File s...
Sunday, 10 April 2016
5 Tips For Better DataStage Design #12
Atul Singh
April 10, 2016
1. Minimum number of sort stages should be use in a datastage job. “Don’t sort if previously sorted” in sort Stage, this option should be ...
Monday, 4 April 2016
DataStage Scenario #16 - Cross duplicate Removal
Atul Singh
April 04, 2016
Need to remove duplicate where source or destination can be switched. Input: source destination distance cit...
Monday, 28 March 2016
10 Scenario based Interview Questions #1 - DataStage
Atul Singh
March 28, 2016
1. Design a job which convert single source row to three target row. 2. Design a job which can identify the row if they are duplicate in i...
Wednesday, 23 March 2016
5 Tips For Better DataStage Design #11
Unknown
March 23, 2016
When writing intermediate results that will only be shared between parallel jobs, always write to persistent data sets (using Data Set ...
Tuesday, 22 March 2016
Transformer Stage alternative - A Quick DataStage Recipe
Atul Singh
March 22, 2016
What to use instead of "Transformer" Stage Copy Stage Use "Copy" stage instead of "Transformer" Stage fo...
Tuesday, 8 March 2016
Python - Get line no with print statement
Atul Singh
March 08, 2016
Sometime when we are working on some code and there are lot of print statement, It's difficult to check for which print statement produ...
Monday, 7 March 2016
Data Warehouse Approaches #2
Atul Singh
March 07, 2016
Top-down approach(Inmon) The top-down approach views the data warehouse from the top of the entire analytic environment. The data ware...
Wednesday, 2 March 2016
5 Tips For Better DataStage Design #10
Atul Singh
March 02, 2016
1. Establish baselines (especially with I/O), use copy with no output 2. Avoid the use of only one flow for tuning/performance testing. P...
Tuesday, 1 March 2016
ETL Development Standards
Atul Singh
March 01, 2016
These development standards provide consistency in the artifacts the ETL developers create. This consistency improves testing, operationa...
