Skip to content
View pavanregalla1's full-sized avatar

Block or report pavanregalla1

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
pavanregalla1/README.md

Pavan Kumar Regalla — Data Engineer & Data Analyst

I'm Pavan. I work the full data stack, and I like building things that actually run — ingestion pipelines that don't break at 2am, streaming systems that keep up, dashboards people actually open.

These days I'm into batch + streaming pipelines (Spark, Kafka), lakehouses (Delta Lake, Databricks), analytics engineering (dbt, SQL), and BI (Power BI, DAX) — mostly on AWS.

Stack

Python SQL Apache Spark Kafka Databricks AWS Power BI dbt Delta Lake Airflow Docker

Work you can run

Project What it does
Real-Time Retail Intelligence Kafka → Spark Structured Streaming → Delta Lake platform with ML forecasting and real-time fraud alerts, dbt-tested
Retail Sales Analytics Batch lakehouse (bronze/silver/gold) processing 56K+ orders ($80.96M), 10/10 data-quality checks, Power BI dashboard
Cloud Analytics Knowledge Search Hybrid Retrieval and Grounded QA over 300 synthetic enterprise documents — TF-IDF + dense (MiniLM) + hybrid retrieval, measured recall/MRR, extractive answers with citations, Streamlit UI
Portfolio Personal portfolio website — Data Engineer | Data Analyst

Certifications

  • AWS Certified Data Engineer – Associate
  • Microsoft Power BI Data Analyst Associate (PL-300)
  • Databricks Certified Data Analyst Associate
  • Databricks Fundamentals Accreditation
  • Microsoft Azure AI Engineer Associate (AI-102)

Stats

Pavan's GitHub stats Top Langs

Find me

LinkedIn

Pinned Loading

  1. realtime-retail-intelligence realtime-retail-intelligence Public

    Real-time retail data platform: Kafka to Spark Structured Streaming to Delta Lake, with ML-powered anomaly detection and revenue forecasting.

    Python

  2. retail-sales-analytics retail-sales-analytics Public

    End-to-end retail analytics pipeline: messy raw data to medallion lakehouse to star schema to Power BI.

    Python

  3. cloud-analytics-knowledge-search cloud-analytics-knowledge-search Public

    Hybrid enterprise knowledge search using TF-IDF and sentence-transformer retrieval, grounded extractive answers, citations, Streamlit UI, and measured evaluation.

    Python

  4. portfolio portfolio Public

    Personal portfolio website — Data Engineer & Data Analyst.

    HTML