Building Scalable Data Pipelines: Airflow, dbt, and SQL Optimization in Action

In modern data-driven environments, ensuring efficient data ingestion, transformation, and querying is essential for scalable analytics.

This hands-on workshop focuses on integrating data workflows within a data warehouse using Apache Airflow, dbt for data modeling, SQL transformations, and cloud storage solutions.

Vorkenntnisse

This talk is ideal for Beginner Data Engineers, BI professionals, and Developers looking to optimize data workflows in a cloud-native environment using modern ELT techniques.

Lernziele

Attendees will:

• gain practical insights into building scalable and maintainable pipelines, improving data quality, performance, and governance.
  
  
• learn to ingest and orchestrate batch data pipelines with Airflow, store raw data in temporary buckets, and model & transform it using dbt for modular, version-controlled workflows.
  
  
• optimize SQL transformations, manage structured data for stakeholder access, and enforce governance & data quality for reliability.