Welcome

My Blogs

List of Blogs related to Data Engineering, AWS, Devops and much more.

Install airflow on local/linux/AWS EC2 Kubernetes(k8s) using kind

Steps involved to successfully setup airflow using Kubernetes.

Spark Optimisation Techniques(Concept & Practical Both!)

Spark Optimisation Tips and Tricks covered both with conceptual and practical explanation

Database Modelling(Schemas and many more)

Database Modelling the practical way.

MLOps Architecture

Architecting MLOps System

Pyspark Interview Questions

Generic Pyspark interview question and solution alongwith scenario