Pinned Loading

1. springboard-projects springboard-projects Public

   A meta-repo for my Springboard data engineering boot camp projects.

   Shell

2. unguided-capstone-project unguided-capstone-project Public

   This is my unguided capstone project: exploring the impact of soundtrack genre diversity on movie popularity using TMDb & Discogs.

   Python

3. guided-capstone-project guided-capstone-project Public

   Build an end-to-end pipeline for high-frequency equity market data. Designed database schemas, ingested daily trade and quote records from CSV/JSON into Spark, implemented EOD batch loads with dedu…

   Jupyter Notebook

4. apache-spark-optimization-mini-project apache-spark-optimization-mini-project Public

   Optimized PySpark jobs by analyzing query execution plans and rewriting transformations for efficiency. Applied techniques such as reducing shuffles, tuning partitions, selecting efficient operator…

   Python

5. kafka-mini-project kafka-mini-project Public

   Built a streaming fraud detection system with Apache Kafka and Python. Deployed a Kafka cluster via Docker Compose, implemented a transaction generator and fraud detector using kafka-python, and ro…

   Python

6. mysql-python-data-pipeline-mini-project mysql-python-data-pipeline-mini-project Public

   Developed a Python and SQL data pipeline for an event ticketing system. Designed a MySQL table schema, ingested CSV sales data via Python connectors, and implemented queries to analyze ticket popul…

   Python