×
Blog
Resources
Pages
Documentation
Tag: Analytics Engineer
Showing 70 results
Fueling Trino large-scale geospatial analysis with Starburst Warp Speed
March 27, 2023
In our last post, we discussed two methods for running geospatial analysis with Trino and the Hive connector and explored a few optimization techniques...
Run optimized geospatial queries with Trino
March 23, 2023
The Trino open source distributed query engine is known as a choice for running ad-hoc analysis where there’s no need to model the data and...
Has the notion of a single data source for Financial Services run its course?
January 20, 2023
More than any other industry, Financial Services is likely to only partially realize the elusive utopian state of 'the single source of truth' for...
Building a federated data lakehouse with Starburst Galaxy
January 11, 2023
We are eleven days into the new year, and I have spent the past two weeks exerting unreasonable amounts of effort trying to make...
6 Reasons to Attend Datanova 2023: For Data Rebels
January 5, 2023
Over the past few weeks, we’ve shared a few examples of what it means to be a data rebel. Hopefully you’ve recognized yourself in...
Over 80 Data & Analytics Statistics, Data, Trends, and Facts
December 28, 2022
Most organizations have data and continue to generate and collect it on a daily basis, but have a far more difficult time in getting...
Tableau Cloud + Starburst: New Connector Supports Shift to Cloud-based SaaS
December 19, 2022
The shift to cloud-based software-as-a-service platforms is accelerating in just about every tech industry. So it wasn’t much of a surprise to the analytics...
What Are The Different Types Of Data Products
December 16, 2022
As we’ve gone from Data Mesh theory to practice, organizations have been shifting their focus towards the central tenet of Data Mesh — building...
Building lakehouse with dbt and Trino
November 30, 2022
In this series, we demonstrate how to build data pipelines using dbt and Trino with data directly from your operational systems. They can use...
Reliving the Hype: Highlights from Trino Summit 2022
November 18, 2022
Last week in San Francisco was one for the Trino history books. After three years of planning, rescheduling, planning, and rescheduling some more, Starburst...
Explore A New Way Of Utilizing A Data Lakehouse
November 10, 2022
A data lakehouse combines the principles of a data lake and a data warehouse to include the best of both worlds. Data lakehouses are...
Join the Team: Realizing the Promise Of Big Data
November 4, 2022
I have been in and around data since my days with Microsoft Access, Excel, and SQL Server circa 2000, and was fortunate to witness...
Countdown to Trino Summit 2022
November 1, 2022
It’s finally here! We are closing in on the final countdown to Trino Summit 2022, and I can feel myself getting more excited with...
Build a Data Lakehouse Reporting Structure with dbt and Starburst Galaxy
October 18, 2022
Since my first introduction to dbt, I was intrigued to say the least. Working as a data engineer, I was attempting to manage complicated...
Accenture Master Class: How to Adopt a Data Product Mindset
October 17, 2022
Since Datanova: The Data Mesh Summit and our in-person executive discussions on data products and Data Mesh, we’ve been validating the data product approach...
Second Edition of Trino: The Definitive Guide
October 5, 2022
Starburst has played a key role in the Trino community for a long time now. We contribute to the success of Trino every day....
Building Reporting Structures on S3 using Starburst Galaxy and Apache Iceberg
October 4, 2022
AWS S3 has become one of the most widely used storage platforms in the world. Companies store a variety of data on S3 from...
The Data Virtualization Evolution is Just Beginning
October 4, 2022
Data virtualization revolutionized the data infrastructure space by serving data consumers directly on top of data stores, without the need to move data elsewhere....
Accenture Master Class: Creating Data Products
September 27, 2022
Since Datanova: The Data Mesh Summit and our in-person executive discussions on data products and Data Mesh, we’ve been validating the data product approach...
4 Key Things You Should Know About Indexing
September 22, 2022
Data indexing radically accelerates query run time and concurrency without the need for massive compute resources. But before expecting indexing to solve all your...
Accenture Master Class: Why Organizations Should Create Data Products
September 6, 2022
Since Datanova: The Data Mesh Summit and our in-person executive discussions on data products and Data Mesh, we’ve been validating the data product approach...
Near Real-Time Ingestion For Trino
August 4, 2022
It is quite popular in today's data climate for modern data architectures to have some sort of batch processing system to move data into...
A Better Solution For Managing and Maintaining Data Pipelines, Now In Public Preview
July 6, 2022
Customers who want a single, super fast and easy-to-use solution for both interactive and longer-running data pipeline queries now have a solution: take advantage...
Confessions of a Space Quest League Advocate
July 6, 2022
Mission 2 Wrap and Mission 3 Launch We all know at least one pandemic puzzler, a devoted crossworder, or a religious wordler who finds...
Employee Perspective: Accelerating Data-Driven Insights in AdTech
June 16, 2022
Before I joined Starburst, I worked in the AdTech industry where companies buy and sell user data for online targeting advertisement campaigns or ML/AI-based...
Transforming Your Data Pipelines with Starburst
June 9, 2022
Current State of ETL/ELT Extract-transform-load, more commonly known by its street name “ETL”, has been around since the early days of computing. Bringing together...
The Past, Present, and Future of Trino
May 24, 2022
Recently, I had the pleasure of chatting with Ravit Jain on his show “The Ravit Show” to discuss the evolution of Trino and where...
Part 2: How to Run Batch Processes Using Starburst Galaxy
May 19, 2022
This is Part 2 of a 2-part blog about how Trino can support both interactive and batch use cases. In Part 1, we explored...
ETL vs Interactive Queries: The Case for Both
May 5, 2022
This is Part 1 of a 2-part blog about how Trino can support both interactive and batch use cases. In Part 1, we will...
Enter the Starburst Space Quest League for a Chance to Win Big!
April 18, 2022
Calling all data pros! Are you ready for a $20k payday? Yes, you heard it right – you could be walking away with $20,000...
Faster Query Processing: CPU Time
March 25, 2022
A key engineering responsibility at Starburst is on performance enhancements. One is to reduce the amount of time that a CPU has to work...
Learn From Complimentary Gartner® Report: Are Data Fabric and Data Mesh the Same or Different?
March 7, 2022
Data Fabric and Data Mesh continue to sustain legions of hype and debate. Data and analytics leaders are longing for a new roadmap, beyond...
What A SQL Query Engine Can Do For Big Data
February 16, 2022
Nod with me if you’ve suffered from the following problems with processing and analyzing Big Data via a centralized approach: different query languages, niche...
6 Reasons to Attend Datanova 2022: #4, Accenture Master Class
January 19, 2022
So far, we’ve highlighted a few reasons why you should attend Datanova: The Data Mesh Summit: The Woz and Justin Borgman. The next reason...
The Right Way to Query Across Data Sources in Tableau (or, The Cross-Database Join Is Not Always Your Friend)
January 13, 2022
Summary Use the right tool for the right job. Not doing so means the difference between your Tableau viz rendering in seconds vs. minutes...
Achieving Lightning-Fast Analytics on the Salesforce Customer 360
January 6, 2022
Over the past twenty or so years, companies have experienced a Cambrian explosion of where their customer data resides.Cloud and on-premises enterprise applications aim...
Part 2 of Current Data Patterns Blog Series: Data Lakehouse
December 6, 2021
As companies shift their analytical ecosystems from on-premise to cloud and try to avoid “data lock-in”, we’re noticing some very interesting data patterns. This...
Rethinking the Modern Data Stack
November 17, 2021
Over the past few years the “modern data stack” has entered the vernacular of the data world, describing a standardized, cloud-based data and analytics...
Tableau is Just Better with Starburst
November 15, 2021
I’m one of those strange people who has always enjoyed doing performance testing. The thought of spinning up lots of machines to do my...
Data Mesh: Data as a Product
October 21, 2021
Data Mesh is based on four central concepts, the second of which is data as a product. In this blog, we’ll explore what that...
Data Mesh: Domain-oriented Ownership & Architecture
October 14, 2021
Insane in the domain! Insane in the brain! Crazy insane, got no domain! - Cypress Hill, sort of Data Mesh is based on four...
The Intelligent Edge
September 13, 2021
Today’s digital world is an expanding frontier of emerging technologies. There are endless innovations, inspired by data, informed by data, enabled by data, and...
How Assurance Unlocked More Business Value with Starburst
September 9, 2021
By leveraging Starburst, Assurance was able to improve conversion rates, reduce costs, and enable robust modeling. Read the full case study here. ...
Coming Full Circle: Why Performance Matters
August 26, 2021
My fascination with SQL query performance started quite some time ago and I contributed a paper on efficient processing of data warehousing during my...
Part 1 of Current Data Patterns Blog Series: Hybrid Distributed Data Store and RDBMS
August 12, 2021
As companies shift their analytical ecosystems from on-premise to cloud and try to avoid “data lock-in”, we’re noticing some very interesting data patterns. This...
Kafka and Starburst: 3 Considerations for Accelerating Time to Value
July 27, 2021
Kafka was created at LinkedIn and open sourced into the Apache Software foundation in early 2011. It was developed to optimize writes especially for...
Query Federation Made Simple at Comcast
June 24, 2021
The media and telecommunications provider now known as Comcast began as a regional operator with just five channels and 12,000 customers. Today, Comcast has...
Managing Secrets in Trino
June 3, 2021
Most companies want to follow good security practices. With the number of security breaches coming out daily, it almost feels like a matter of...
Starburst Elements: Start Fast with Starburst Galaxy
May 20, 2021
This is the fourth episode in our video series, Starburst Elements, focused around anything and everything Starburst. In this episode, our Product Manager Vishal...
Starburst Elements: Introduction to Starburst Galaxy
May 7, 2021
This is the third episode in our video series, Starburst Elements, focused around anything and everything Starburst. In this episode, our Product Manager Vishal...
Data Mesh: The Answer to the Data Warehouse Hypocrisy
March 25, 2021
Note: I start this piece with some technical background that has nothing to do with the data mesh, and is only relevant to data...
A Gentle Introduction to the Hive Connector
February 12, 2021
TL;DR: The Hive connector is what you use in Starburst Enterprise for reading data from object storage that is organized according to the rules...
Reasons to Attend Datanova 2021: # 6, Technical Training from the Creators of Trino
February 5, 2021
We love data engineers at Starburst. They are our people, even when their Starburst Data equivalents try to trick Marketing into pronouncing the data...
Video: How to Migrate from EMR to Starburst Enterprise Presto
November 13, 2020
In this video, I walk you through the steps of migrating between an existing EMR Presto cluster that has existing data in S3 and...
Top 10 Reasons to Migrate from OS Presto on EMR to Starburst Enterprise Presto
November 13, 2020
In today’s data architecture economy, there are no shortages of options when it comes to choosing various distributions and deployment strategies for a given...
Presto & Data Science: Getting Data Into the Hands of Data Scientists (Faster)
June 26, 2020
A few days ago I read a Gartner report stating that data scientists spend 23% of their time on data collection and preparation. I...
Free Presto Book to Support the Community
April 14, 2020
As you probably know, Starburst is one of the main contributors and sponsors of the Presto open source project and the community around Presto....
How a Telecommunications Giant Established Universal Data Access
April 3, 2020
Our customer base has been growing quickly, and we’re excited to share a case study highlighting one of our largest clients, a telecommunications...
Presto at Pinterest
March 12, 2020
Article reposted from Medium with permission from the author, Ashish Singh | Pinterest Engineer, Data Engineering As a data-driven company, many critical business decisions...
2019 in Review: Fueled up and ready to go
February 4, 2020
What happened in 2019? 2019 was a big year for Starburst. Today we shared some of our major accomplishments: ...
Piotr Findeisen, a profile of one of Starburst’s Presto experts
January 7, 2020
We call ourselves the Presto experts here at Starburst Data, but what does that actually mean? ...
More Secure, More Connected: Starburst Presto Updated to 323e
November 21, 2019
Starburst Presto 323e is the now our most exciting and feature rich release by Starburst to date. When we founded Starburst, our vision was to...
Presto on Kubernetes
August 2, 2019
Kubernetes (K8s) eases the burden and complexity of configuring, deploying, managing, and monitoring containerized applications. We are excited to announce the availability and support...
General SQL Features in Presto
January 1, 2019
Welcome to the Advanced SQL Features in Presto series. In this series you are going to cover a set of SQL features that expands...
Querying data in S3 using Presto and Looker
July 10, 2018
With more and more companies using AWS for their many data processing and storage needs, it’s never been easier to query this data with...
Presto Memory Connector
May 1, 2018
Originally posted http://prestodb.rocks/news/presto-memory There is a highly efficient connector for Presto! It works by storing all data in memory on Presto Worker nodes, which...
Presto Join Enumeration
April 17, 2018
Karol Sobczak, Co-founder and Software Engineer at Starburst Welcome back to the series of blog posts (checkout our previous post!) about Presto's first Cost-Based...
Presto Cost-Based Optimizer rocks the TPC benchmarks!
April 3, 2018
Wojciech Biela, Co-founder at Starburst Introduction As mentioned in our previous blog about the Starburst Presto release and its hottest addition - the Cost...
Presto gets EVEN FASTER, with a 10-15x performance boost in upcoming release!
March 20, 2018
Next week, we will be releasing the Starburst Distribution of Presto 195e. Based on prestosql/presto 0.195, Starburst’s 195e will ship with Presto’s first cost-based...
Presto – Next Chapter
December 13, 2017
As you may have learned from our first press release, we have announced the creation of Starburst, a new independent company solely focused on...
A single point of access to all your data
© Starburst Data, Inc. Starburst and Starburst Data are registered trademarks of Starburst Data, Inc. All rights reserved. Presto®, the Presto logo, Delta Lake, and the Delta Lake logo are trademarks of LF Projects, LLC