Spark Data Quality (Day 3 Lecture)

This is a pre-recorded class. In this presentation, we delve into the pivotal role of data quality in the realm of analytics engineering, unraveling its profound impact on the success of data pipelines. The discussion underscores the necessity for automated data quality checks, shedding light on the challenges encountered by data engineers in their quest for ensuring data accuracy. Exploring the leadership dimension, we examine the crucial role of management in prioritizing data quality and the far-reaching consequences of subpar data quality on business outcomes. Join us in this insightful video to glean a deeper understanding of the critical role that data quality plays in analytics engineering, unraveling its implications for informed decision-making. [Recorded on Dec 12, 2023]

41 mins

Purchase Required

You need to purchase this content in order to view it

Spark Fundamentals Spark Lab on REST API consumption (Day 1 Lab)

Week 4: Batch Pipelines with Apache Spark

Spark Fundamentals (Day 1 Lecture)