This project demonstrates an end-to-end data pipeline built on cloud technologies, following the Medallion Architecture (Bronze–Silver–Gold). . Ingests raw data from cloud sources, processes via ETL/ELT in Databricks & DBT, orchestrated with Data Factory, and delivers clean, analytics-ready datasets stored in a scalable data lake.

ETL pipeline to extract real-time weather data from Open-Meteo API, transform it with Python & Pandas, and load it using Apache Airflow and Docker.

Cloud-based PySpark ETL pipeline for analyzing search keyword revenue using AWS Glue, S3, and Terraform

GitOps-driven Azure Data Factory pipeline that ingests multi-source data (GitHub + ADLS) into ADLS Bronze using dynamic, parameterized ETL workflows.