Skip to content
#

workflow-orchestration

Star

Here are 10 public repositories matching this topic...

Language: Python
Filter by language
All 26 Python 10 Jupyter Notebook 6 Go 3 HCL 1 Java 1 JavaScript 1 Rust 1 TypeScript 1

SayamAlt / Formula-1-Data-Ingestion-Transformation---ETL-Pipeline

Star 0

This project demonstrates a complete ETL pipeline for Formula 1 racing data using Azure Databricks, Delta Lake, and Azure Data Factory. It covers data ingestion, transformation with PySpark and Spark SQL, data governance with Unity Catalog, and visualization through Power BI. Designed to showcase real-world data engineering workflows in Azure.

data-transformation data-engineering spark-streaming data-ingestion spark-sql spark-mllib microsoft-azure databricks-notebooks azure-databricks delta-lake workflow-orchestration etl-pipelines azure-data-lake-storage-gen2
  • Updated Nov 14, 2024
  • Python

Improve this page

Add a description, image, and links to the workflow-orchestration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the workflow-orchestration topic, visit your repo's landing page and select "manage topics."

Learn more