Jerome Rajan

0 %
Jerome Rajan
Staff Solutions Consultant at Google
Data & Analytics
  • Residence:
    India
  • City:
    Mumbai
SQL
Dataproc, EMR
Hadoop
BigQuery
AWS Glue
PySpark, Python
Data Pipeline Design
Tableau, Redshift, Snowflake
IBM DataStage
  • AWS Lambda, S3, EMR, SQS, DynamoDB, Step Functions, Cloud Functions
  • Unix Shell Scripting, Python
  • Oracle, DB2, Redis
  • Alteryx, VBA, Blueprism, UiPath
English
Tamil
Hindi
Malayalam
Marathi

LUTCreateOp and LUTProcessOp

February 25, 2018
DSxchange, every now and then, comes up with some very interesting discussions thanks to the DataStage gurus like Ray, Craig, Arnd et al. This post by Ray on the lookup composite operator was something I was looking for since a long time. Finally found it. Here’s what Ray Wurlod had to say:

Lookup stage ordinarily generates a composite operator consisting of LUTCreateOp and LUTProcessOp.
LUTCreateOp loads the reference data into memory and builds a hash index on the fly, unless the reference data are in a Lookup File Set in which case the index was built when the Lookup File Set was created/written to.

Posted in TechnologyTags:
Write a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Be Original
Would the boy you were be proud of the man you are?