jupyter notebook tip #1
Atul Singh
March 31, 2016
How we can start jupyter notebook from a specific directory? Below, I am sharing a very tiny batch (and linux shell) script which will k...
Thursday, March 31, 2016
Wednesday, March 30, 2016
echo the 'echo'
Atul Singh
March 30, 2016
"echo" command is the very basic command of Linux/Unix. Most of us known this command to print whatever is being passed to it ...
Monday, March 28, 2016
10 Scenario based Interview Questions #1 - DataStage
Atul Singh
March 28, 2016
1. Design a job which convert single source row to three target row. 2. Design a job which can identify the row if they are duplicate in i...
Saturday, March 26, 2016
Data Warehouse Glossary #3
Atul Singh
March 26, 2016
Drill Through: Data analysis that goes from an OLAP cube into the relational database. Data Warehousing: The process of designing, buil...
Wednesday, March 23, 2016
5 Tips For Better DataStage Design #11
Unknown
March 23, 2016
When writing intermediate results that will only be shared between parallel jobs, always write to persistent data sets (using Data Set ...
Tuesday, March 22, 2016
Transformer Stage alternative - A Quick DataStage Recipe
Atul Singh
March 22, 2016
What to use instead of "Transformer" Stage Copy Stage Use "Copy" stage instead of "Transformer" Stage fo...
Monday, March 21, 2016
Data Warehouse Glossary #2
Atul Singh
March 21, 2016
Dimension: A variable, perspective or general category of information that is used to organize and analyze information in a multi-dimensio...
Thursday, March 17, 2016
Data Warehouse Glossary #1
Atul Singh
March 17, 2016
Ad Hoc Query: A database search that is designed to extract specific information from a database. It is ad hoc if it is designed at the...
Tuesday, March 15, 2016
yet another Shell script to access DataStage job logs
Atul Singh
March 15, 2016
Introduction We have various data warehouses hosted on AIX/Linux/Unix operating systems. DataStage Director is one of the ETL monitori...
Monday, March 14, 2016
Machine Learning - Learning Steps
Atul Singh
March 14, 2016
Step 1 INTRODUCTION TO MACHINE LEARNING Overview of Machine Learning Supervised vs. Unsupervised Learning Classification vs. Regressio...
Machine Learning Links you must Visit
Atul Singh
March 14, 2016
1. Scikit-Learn Tutorial Series - http://buff.ly/1XnDWv6 2. 7 Free Machine Learning Courses - http://buff.ly/1XoBapa 3. k-nearest ne...
DataScience Links you must Visit
Atul Singh
March 14, 2016
1. Python (and R) for Data Science - sample code, libraries, projects, tutorials - http://buff.ly/22bwhXi 2. 19 Worst Mistakes at Data S...
Saturday, March 12, 2016
Capture Unmatched records from Join Stage - A Quick DataStage Recipe
Atul Singh
March 12, 2016
How to capture unmatched records from "Join" Stage. This stage does not provide reject handling for unmatched records (such as i...
Friday, March 11, 2016
Python Points #12 - execute OS commads
Atul Singh
March 11, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.goog...
Wednesday, March 9, 2016
Python Points #11 - Set
Atul Singh
March 09, 2016
Like the below page to get update https://www.facebook.com/datastage4you https://twitter.com/datagenx https://plus.google....
Monday, March 7, 2016
Python - Get line no with print statement
Atul Singh
March 07, 2016
Sometime when we are working on some code and there are lot of print statement, It's difficult to check for which print statement produ...
Data Warehouse Approaches #2
Atul Singh
March 07, 2016
Top-down approach(Inmon) The top-down approach views the data warehouse from the top of the entire analytic environment. The data ware...
Sunday, March 6, 2016
Python SyntaxError - Non-ASCII character '\xe2' in file
Atul Singh
March 06, 2016
If you get below error while running your python code - SyntaxError: Non-ASCII character '\xe2' in file .\set_learn.py...
Thursday, March 3, 2016
Data Warehouse Approaches #1
Atul Singh
March 03, 2016
It has been said there are as many ways to build data warehouses as there are companies to build them. Each data warehouse is unique becau...
Wednesday, March 2, 2016
5 Tips For Better DataStage Design #10
Atul Singh
March 02, 2016
1. Establish baselines (especially with I/O), use copy with no output 2. Avoid the use of only one flow for tuning/performance testing. P...
Tuesday, March 1, 2016
ETL Development Standards
Atul Singh
March 01, 2016
These development standards provide consistency in the artifacts the ETL developers create. This consistency improves testing, operationa...
