alanchn31/Data-Engineering-Projects resource

Health v2 · maintenance only

Flags: no_releases no_license

Adoption not part of the score

1030 stars · 208 forks observed · 2026-08-28

What it is AI-extracted, prompt v1, taxonomy v1, 2026-08-30, confidence not recorded

A collection of personal data engineering projects completed as part of Udacity's Data Engineering Nanodegree, covering ETL into Postgres, Cassandra, MongoDB, Redshift, and S3 data lakes with Spark and Airflow. It includes course notes and example notebooks demonstrating data modeling, warehousing, and pipeline orchestration.

Use cases

• learn data engineering through hands-on projects
• see examples of ETL pipelines with Airflow
• understand star schema data modeling in Postgres
• learn how to build a data lake with Spark and S3
• practice web scraping with Scrapy into MongoDB
• study for a data engineering nanodegree
• see how to load data into AWS Redshift

When to choose

• you want worked examples of common data engineering patterns
• you are following or reviewing Udacity's data engineering curriculum
• you need reference code for ETL with Spark, Airflow, Cassandra, or Redshift

When to avoid

• you need production-ready, maintained software with a license
• you want a reusable library rather than educational notebooks
• you need up-to-date tooling, as the projects were last updated in early 2023

Facets

learning-resource · maturity maintenance

etl database web-scraping data-science workflow-automation databases big-data tutorials python cloud data-warehouse data-lake airflow spark cassandra redshift mongodb star-schema udacity-nanodegree jupyter-notebook data-engineering

Member repositories

For agents

markdown · JSON · MCP: product_card(name="alanchn31/Data-Engineering-Projects")