Tag: AWS Glue
October 7, 2020
/ Technology
The All-New AWS Glue Studio: Visual Drag-and-Drop Spark ETL
Until recently, AWS Glue offered a static visual graph of generated scripts without true drag-and-drop authoring—making the launch of AWS…
October 6, 2020
/ Technology
Real-Time Data Streaming into Kinesis & Ingestion into Postgres Using AWS Glue — Part 2 (Glue Catalog Setup)
Before we start building Glue jobs, we need to understand that one of the unique features of Glue is its…
October 5, 2020
/ Technology
Real-Time Data Streaming into Kinesis & Ingestion into Postgres Using AWS Glue — Part 1 (Setup)
Earlier this year, Amazon announced serverless streaming ETL support in AWS Glue. Under the hood, AWS Glue runs managed Apache…
October 3, 2020
/ Technology
AWS Glue: Develop & Test PySpark ETL Jobs Locally Using Development Endpoints
AWS Glue jobs—especially Streaming ETL jobs—can incur cold-start spin-up times of several minutes per run. Setting up an AWS Glue…