Build a Streaming Ingest Pipeline with Kafka and Starburst Galaxy
Streaming data doesn’t have to be complex. In this step-by-step tutorial, you’ll learn how to create a live streaming pipeline that ingests data from Kafka directly into Starburst Galaxy, transforming it into analytics-ready Iceberg tables in minutes.
You will configure a Kafka topic, connect it to Galaxy, create a live table, and start streaming real-time data into your Iceberg catalog. You will then use SQL to query, validate, and explore that live data in a single platform without managing extra infrastructure.
By the end, you’ll know how to build and run a live streaming pipeline that ingests data from Kafka into Starburst Galaxy, transforming it into analytics-ready Iceberg tables for real-time querying and analysis.
What you’ll learn
- Set up a Kafka topic and connector for streaming data.
- Configure Galaxy for continuous ingest into Iceberg tables.
- Run live SQL queries on fresh streaming data.
Ready to get hands-on?
Register now to start the tutorial
Streaming data doesn’t have to be complex. In this step-by-step tutorial, you’ll learn how to create a live streaming pipeline that ingests data from Kafka directly into Starburst Galaxy, transforming it into analytics-ready Iceberg tables in minutes.
You will configure a Kafka topic, connect it to Galaxy, create a live table, and start streaming real-time data into your Iceberg catalog. You will then use SQL to query, validate, and explore that live data in a single platform without managing extra infrastructure.
By the end, you’ll know how to build and run a live streaming pipeline that ingests data from Kafka into Starburst Galaxy, transforming it into analytics-ready Iceberg tables for real-time querying and analysis.
What you’ll learn
- Set up a Kafka topic and connector for streaming data.
- Configure Galaxy for continuous ingest into Iceberg tables.
- Run live SQL queries on fresh streaming data.
Ready to get hands-on?
Register now to start the tutorial
