Tag: AWS
December 21, 2020
/ Technology
What, Why, How – Continuous Loading To Snowflake Using Snowpipes (AWS)
WHAT Loading into Snowflake can be done in multiple ways – Bulk loading from Snowflake stages (internal and external) Using…
December 18, 2020
/ Technology
What, How, Why : Storage Integration Object in Snowflake
WHAT From a security POV, Storage Integration is a very useful feature provided by Snowflake. At it’s core, Storage Integration…
October 7, 2020
/ Technology
The All New AWS Glue Studio
Up until now, AWS provided a visual representation of your code but never really allowed you to build using a…
October 6, 2020
/ Technology
Real Time Data Streaming Into Kinesis & Ingestion Into Postgres Using AWS Glue – Part 2 (Configure Glue Catalog Tables)
Before we start building Glue jobs, we need to understand that one of the unique features of Glue is its…
October 5, 2020
/ Technology
Real Time Data Streaming Into Kinesis & Ingestion Into Postgres Using AWS Glue – Part 1 (Setup)
This April, Amazon announced support for serverless streaming ETL using AWS Glue. For the uninformed – AWS Glue is built…
October 3, 2020
/ Technology
AWS – Develop ETL jobs using AWS Glue Endpoints
AWS Glue scripts can have start up times that could be as long as 12 minutes especially if you are…