💻 End-to-End Data Engineering Pipeline — Faker → NiFi → S3 → Snowflake (SCD Type 2 Automation). A fully automated, Dockerized ETL workflow for data generation, ingestion, transformation, and historical tracking using Snowflake tasks and streams.
python docker automation aws-s3 faker snowflake data-engineering apache-nifi data-pipeline etl-pipeline scd-type2
-
Updated
Oct 16, 2025 - Jupyter Notebook