My scrapbook about almost anything I stumble upon but mostly around Cloud, K8s, OpenShift, DataScience, Machine Learning, Golang, Python, Data Analytics, DataStage, DWH and ETL Concepts. If you find any pages useful don't forget to give thumbs-up :)

Breaking

Thursday, December 16, 2021

Get File Size in Transformer Stage - DataStage

I have seen lot of cases where I have to get the file size or no of lines in file or any Linux command output in between job flow. The easy solution to this problem is to use Sequencer Job to execute the linux command and pass the output as input to Parallel job which is simple but with additional overhead. 

So, today, I am going to share a transformer Routine code which you can modify as per your need and voila !!! now you can check any Linux command in transformer stage in flight.  






Like the below page to get the update  
Facebook Page      Facebook Group      Twitter Feed      Telegram Group     


No comments:

Post a Comment

Disclaimer

The postings on this site are my own and don't necessarily represent IBM's or other companies positions, strategies or opinions. All content provided on this blog is for informational purposes and knowledge sharing only.
The owner of this blog makes no representations as to the accuracy or completeness of any information on this site or found by following any link on this site. The owner will not be liable for any errors or omissions in this information nor for the availability of this information. The owner will not be liable for any losses, injuries, or damages from the display or use of his information.