My Blog
Spark Config Calculator
The Spark Configuration Tool is a Streamlit-based application designed to assist users in optimizing Apache Spark configurations. It allows users…
Understanding Driver Pools in Dataproc
Let’s learn about driver pools in Dataproc – an important concept to understand while using multi-tenant Dataproc clusters
Build your own Ask-Me-Anything using VertexAI + LangChain + Streamlit 🎯🎯🎯
In this article, I walk through the process of creating a custom search engine using VertexAI, Streamlit and Langchain.
Hadoop — Understanding Splits, Blocks & Everything In Between
Originally published at my Medium Blog Understanding Hadoop is like trying to unravel a tangled ball of yarn while wearing…
Understanding CPU Oversubscription in Dataproc/Hadoop
This post explains the what, how and the why about CPU oversubscription in Hadoop clusters. It attempts to clear general misconceptions.
Dataproc — Why is my cluster not scaling?
(Article published at https://medium.com/google-cloud/autoscaling-in-dataproc-e02bf446a509) “Autoscaling” is a Dataproc API that automates the process of monitoring YARN memory utilisation and adding/removing…
GCP Cloud Logging : How to Enable Data Access Audit For Selected Buckets
Also published at https://medium.com/google-cloud/gcp-cloud-logging-how-to-enable-data-access-audit-for-selected-buckets-aaec12556486 Introduction Data Access Audit Logs are used to trace and monitor API calls that create, modify or…
Hilton Shillim – Expensive, Expansive, Exclusive!
The Hilton Shillim Estate Retreat & Spa is a property nestled quietly into the western ghats. Taking that turn from…
The Ultimate Shoe-down!
Do these brand logos look vaguely familiar? If you are from India, it is very likely that you relate better…
The Dessert & The City
Skies. Blue! Vada Pav. Mumbai! Halwa. Tirunelveli! Tirunelveli (or Nellai), a hot and vibrant city near the southernmost tip of…
Autoscaling In Dataproc
Scalability is one of “THE” most important reasons why customers choose to migrate to the cloud. And as with all…
Would The Boy You Were Be Proud Of The Man You Are?
A question I devote time to, once every month.A question that has helped me make new habits and break the…
Learnings from AWS – Bias For Action
Bias For Action If you’re not Amazonian enough to grasp what this means – It simply tells you to be…
Sicilian Defence Crushed!!
The pandemic helped me reprise my love and passion for a game I used to spend hours playing as child…