Cloud Data Engineer Bootcamp

This repository contains the solutions for the challenges and case studies in XPe bootcamp!

Modules

Module 1 - Fundamentals of Data Architecture and Cloud Solutions

Main concepts:

• Well-Architected Framework
• Database as a Service (DaaS) Relational & Non-relational
• Data Lake Architectures (Lambda, Kappa, Unifield, Lakehouse)
• Infrastructure as a Code (IaC)

Main tools:

• Amazon S3
• Amazon EMR
• Spark
• Terraform

Module 2 - Processing Streaming Data

Main concepts:

• Distributed Computing

Main tools:

• Spark

Module 3 - Big Data Technologies

Main concepts:

• Microservices Architecture

Main tools:

• Docker
• Kubernetes

Module 4 - Scalable Big Data Architecture

Main concepts:

• Event Streaming & Streaming Process Applications

Main tools:

• Apache Kafka
• Apache Pinot

Module 5 - Final Challenge

Description: Design and implementation of a complete data solution using batch tools and/or real time data processing. Explanation of how the Well Architected Framework principles are applied. Cost analysis and solution feasibility.

Support

Give a ⭐️ if you like this project!