Office Hours: Pipeline Automation and Data Quality

AI and analytics are only as reliable as the pipelines behind them. When pipelines break, downstream data products, dashboards, and models quickly lose trust.

In this office hours session, Starburst expert Lester Martin will walk through how to automate your data pipelines with job scheduling so they run reliably at scale. We’ll explore the data quality checks available. We will implement multiple checks and review them on the monitoring dashboard. 

In this session, we’ll cover:

• How to automate recurring pipelines with the job scheduler 
• Setting up and monitoring alerts for data quality issues
• How to automate data quality checks