Skip to content
View MatheuszOL's full-sized avatar
1 follower · 3 following

Block or report MatheuszOL

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
MatheuszOL/README.md

Matheus Oliveira | Data Engineer 👋

Data Governance & Lakehouse Architecture

Linkedin Email

Data Engineer specializing in scalable pipelines and modern Lakehouse architectures. Expert in large-scale data processing (+500M records) and implementing automation frameworks that significantly increase operational efficiency.

💼 Technical Experience & Value Delivery

  • Large-Scale Data Engineering: Development and maintenance of production ETL/ELT pipelines under Medallion Architecture (Bronze, Silver, Gold), utilizing PySpark, Delta Lake, and Spark on Databricks.
  • Architecture & Automation: Designing scalable ingestion frameworks and orchestrating complex workflows via Apache Airflow and Azure Data Factory (ADF), reducing operational times from 24 hours to under 20 minutes.
  • Governance & Quality: Implementing Data Quality practices and sensitive data governance (LGPD) using Microsoft Purview, interacting directly with Internal Audit stakeholders.
  • Cloud Infrastructure: Managing data processing within Data Lakes (ADLS) and implementing robust CI/CD pipelines for automated deployments in cloud environments.

🛠️ Technologies & Tools

Python SQL PySpark Databricks Azure Delta Lake ADLS
Airflow Purview Azure DevOps Git PowerBI Scrum

🎓 Education

  • B.S. in Computer Science – Universidade Cidade de São Paulo.
  • IT Technician – ETEC Aprígio Gonzaga.

Pinned Loading

  1. efficiency-performance-tuning-framework efficiency-performance-tuning-framework Public

    Spark performance tuning framework demonstrating partitioning, broadcast joins, and Delta optimization strategies to reduce processing time from hours to minutes.

    Python 1

  2. flagship-medallion-lakehouse flagship-medallion-lakehouse Public

    End-to-end Medallion Lakehouse pipeline with PySpark and Delta Lake (Bronze, Silver, Gold), including LGPD-aligned data anonymization and business KPI aggregation.

    Python 1

  3. etec-capstone-what-if-game etec-capstone-what-if-game Public

    ETEC capstone project: educational Android game in C# focused on climate awareness, scenario simulation, and decision-making outcomes.

    C# 2

  4. game-development-project game-development-project Public

    Python mini-game focused on mathematical logic, progressive difficulty levels, and clean modular game loop implementation.

    Python 1

  5. retail-market-project retail-market-project Public

    Retail system in Python for product management and shopping cart operations, including inventory flow and checkout simulation.

    Python 2