Technology
GCP Cloud Logging : How to Enable Data Access Audit For Selected Buckets
Also published at https://medium.com/google-cloud/gcp-cloud-logging-how-to-enable-data-access-audit-for-selected-buckets-aaec12556486 Introduction Data Access Audit Logs are used to trace and monitor API calls that create, modify or…
Autoscaling In Dataproc
Scalability is one of “THE” most important reasons why customers choose to migrate to the cloud. And as with all…
Spark Architecture – Notes & FAQ
I’ve spent the past couple of weeks trying to master the Spark Architecture and this post is a running summary of all my notes and questions gathered from across the internet & Stackoverflow. If you feel something is incorrect, I’ll be happy to discuss. Hope you find it useful!
What, Why, How – Continuous Loading To Snowflake Using Snowpipes (AWS)
WHAT Loading into Snowflake can be done in multiple ways – Bulk loading from Snowflake stages (internal and external) Using…
What, How, Why : Storage Integration Object in Snowflake
WHAT From a security POV, Storage Integration is a very useful feature provided by Snowflake. At it’s core, Storage Integration…