Skip to content
View Hawkeon's full-sized avatar

Block or report Hawkeon

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Hawkeon/README.md

Pham Tien Dat · Data Engineer

I build data pipelines that have to be correct, not just running CDC and streaming into OLAP warehouses, with idempotency and replay worked out rather than assumed.

Currently a Data Engineer Intern at RIPT-PTIT (Hanoi), building a real-time CDC pipeline streaming MySQL/MongoDB into ClickHouse and StarRocks. BSc in Information Systems at PTIT, expected 2028.


Selected work

Project What it demonstrates
Real-Time Clickstream Analytics Pipeline Exactly-once results from at-least-once delivery Kafka → Flink → ClickHouse. Verified by killing Flink mid-stream, not by assertion.
GDELT Medallion Pipeline Batch lakehouse end to end Polars / DuckDB / Postgres / MinIO. Manifest state machine where replaying a failed batch is a no-op; 160+ tests at 90%+ coverage.

Working with

Kafka Polars DuckDB ClickHouse StarRocks Parquet MinIO / S3 PostgreSQL MySQL MongoDB Python SQL Docker

Currently going deeper on: data warehouse modelling, pipeline correctness under failure, and the trade-offs between table formats.


Hanoi, Vietnam · English (TOEIC 945 LR) · Open to Data Engineer internships and junior roles

Pinned Loading

  1. gdelt-medallion-pipeline gdelt-medallion-pipeline Public

    GDELT 2.0 medallion pipeline: Airflow + Postgres + MinIO, pure-Python silver/gold on Parquet, DuckDB read path

    Python

  2. Real-Time-Clickstream-Analytics-Pipeline-exactly-once Real-Time-Clickstream-Analytics-Pipeline-exactly-once Public

    Exactly-once streaming pipeline: Kafka KRaft to Flink to ClickHouse. Zero data loss verified by killing Flink mid-stream, not by assertion.

    Python