Stack: Terraform
-
AWS medallion data platform
End-to-end batch platform: raw CSV and JSONL to bronze, silver and gold in Postgres — 6 PySpark Glue jobs, 4 Airflow DAGs, fully Terraformed.
End-to-end batch platform: raw CSV and JSONL to bronze, silver and gold in Postgres — 6 PySpark Glue jobs, 4 Airflow DAGs, fully Terraformed.