Jerome Rajan

0 %
Jerome Rajan
Data & AI Architect at Google
  • Residence:
    India
  • City:
    Mumbai
GCP Agent Platform
GenAI
SQL
Dataproc, EMR
Hadoop
BigQuery
PySpark, Python
Data Pipeline Design
Tableau, Redshift, Snowflake
IBM DataStage
  • AWS Lambda, S3, EMR, SQS, DynamoDB, Step Functions, Cloud Functions
  • Unix Shell Scripting, Python
  • Oracle, DB2, Redis
  • Alteryx, VBA, Blueprism, UiPath
English
Tamil
Hindi
Malayalam
Marathi
Spanish

Tag: ETL

AWS Glue: Develop & Test PySpark ETL Jobs Locally Using Development Endpoints
October 3, 2020 / Technology
AWS Glue: Develop & Test PySpark ETL Jobs Locally Using Development Endpoints

AWS Glue jobs—especially Streaming ETL jobs—can incur cold-start spin-up times of several minutes per run. Setting up an AWS Glue…

DataStage Warning NGBR-00019: Input Data Set 0 Not Present in Design Time Information
February 25, 2018 / Technology
DataStage Warning NGBR-00019: Input Data Set 0 Not Present in Design Time Information

This IBM InfoSphere DataStage warning cost me two full days of investigation. Here was the exact scenario: I needed to…

How to Replace Substrings in an IBM DataStage Parallel Transformer
February 25, 2018 / Technology
How to Replace Substrings in an IBM DataStage Parallel Transformer

Suppose you want to replace a multi-character substring inside an IBM DataStage Parallel Transformer—for instance, replacing “choc” with “mock” in…

Generate a Unique Sequence Counter in a DataStage Parallel Transformer
February 25, 2018 / Technology
Generate a Unique Sequence Counter in a DataStage Parallel Transformer

Need a deterministic, collision-free sequential row number across all parallel partitions in an IBM DataStage Parallel Transformer without adding a…

Understanding LUTCreateOp and LUTProcessOp in IBM DataStage
February 25, 2018 / Technology
Understanding LUTCreateOp and LUTProcessOp in IBM DataStage

Every so often on DSXchange, DataStage veterans like Ray Wurlod, Craig Hulett, and ArndW share concise explanations of what the…

Aggregator Methods in DataStage: Hash Mode vs. Sort Mode (Courtesy: Ray Wurlod)
February 25, 2018 / Technology
Aggregator Methods in DataStage: Hash Mode vs. Sort Mode (Courtesy: Ray Wurlod)

Choosing between Hash mode and Sort mode in the IBM DataStage Parallel Aggregator stage is one of the highest-leverage performance…

1 2 3
Be Original
Would the boy you were be proud of the man you are?