Welcome to the Data Warehouse and Analytics Project repository! This project presents an end-to-end data warehousing and analytics solution, covering everything from building the data warehouse to deriving meaningful insights. Developed as a portfolio project, it showcases industry best practices in data engineering and analytics.
The data architecture for this project follows Medallion Architecture Bronze, Silver, and Gold layers:
- Bronze Layer: Stores raw data as-is from the source systems. Data is ingested from CSV Files into SQL Server Database.
- Silver Layer: This layer includes data cleansing, standardization, and normalization processes to prepare data for analysis.
- Gold Layer: Houses business-ready data modeled into a star schema required for reporting and analytics.
This project involves:
- Data Architecture: Designing a Modern Data Warehouse Using Medallion Architecture Bronze, Silver, and Gold layers.
- ETL Pipelines: Extracting, transforming, and loading data from source systems into the warehouse.
- Data Modeling: Developing fact and dimension tables optimized for analytical queries.
- Analytics & Reporting: Creating SQL-based reports and dashboards for actionable insights.
Build a modern SQL Server–based data warehouse to unify sales data and support analytical reporting for better decision-making.
- Data Sources: Load data from ERP and CRM systems provided in CSV format.
- Data Quality: Clean and standardize data to address quality issues before analysis.
- Integration: Merge both sources into a single, user-friendly analytical data model.
- Scope: Work with the most recent data only; historical tracking is not required.
- Documentation: Create clear and structured documentation to support business users and analytics teams.
Develop SQL-based analytics to deliver detailed insights into:
- Customer Behavior
- Product Performance
- Sales Trends
These insights empower stakeholders with key business metrics, enabling strategic decision-making.
This project is licensed under the MIT License. You are free to use, modify, and share this project with proper attribution.
Hello there! I'm Ridhima Doval. I’m an aspiring data analyst who enjoys working with data, solving problems, and creating insights using SQL, Excel, and Power BI.