Airflow Data Quality (Day 2 Lab)

In this lab, Zach explains how automated data quality checks work. He discusses the process of running checks on an output table, ensuring that certain columns are not null, and executing Trino queries to validate the results. He also covers the steps involved in inserting and cleaning up data, as well as the challenges we faced with permissions. [Recorded on May23rd, 2024]

24 mins

Purchase Required

You need to purchase this content in order to view it

Airflow Data Quality (Day 1 Lecture)

Week 3: Airflow and Airflow Data Quality

Airflow Data Quality (Day 1 Lab)