Welcome

Harsha
Reddy

Principal Data Engineer — building scalable data systems, writing about what I learn along the way.

Read the Blog About Me

Apache Spark

Kubernetes

Python

AWS / GCP

Kafka

dbt

Terraform

TypeScript

Latest

Recent Articles

How I Design Idempotent Data Pipelines

Data Engineering 9 min read

How I Design Idempotent Data Pipelines

Learn how to build an idempotent data pipeline using partition overwrites, deterministic hashing, and the Medallion framework to avoid duplicate data.