Fully managed in the cloudStarburst GalaxySelf-managed anywhereStarburst Enterprise
- Start Free
Fully managed in the cloud
Study finds enterprise architectures are stretched to the limits, with more than 50% of data leaders saying architectural complexity is a significant pain point
BOSTON, MA – February 7, 2023 – New market research led by independent consulting firm Boston Consulting Group (BCG) and sponsored by Red Hat and Starburst explores organizational challenges related to exponential growth in data volumes and rapid innovation across the data stack. The research indicates that organizations are facing a perfect storm of cost, complexity, and talent when it comes to supporting critical analytics and AI initiatives.
The study titled, “A New Architecture to Manage Data Costs and Complexity,” highlights three main trends reshaping the data landscape 1) The volume and velocity of data are increasing; 2) Data use cases are becoming both more accessible, creating the growth of “citizen data scientists”; and 3) Technology advancements have shifted the pricing model.
According to the new report, these trends are creating challenges that have put immense pressure on today’s architectures:
Regarding the trend of data use cases becoming more accessible, Pranay Ahlawat, Partner and Associate Director at BCG, said, “Accessibility will continue to increase as data literacy and a basic understanding of programming languages such as SQL become more widespread among nontechnical employees. According to our research, almost three-quarters (73%) of survey respondents expect the number of non-technical consumers of data to increase in the next three years.” The research details the growth of ‘citizen data scientists’ and juxtaposes that growth with the increased sophistication of AI-related use cases. The gap between more advanced analytics use cases and technologies, and the analytics skill sets required, is currently limiting the business outcomes AI can drive. Ahlawat continues, “Only 54% of managers believe that their company’s AI initiatives create tangible business value.”
Regarding data storage and architecture complexity, Steven Huels Senior Director, Cloud Services for AI and Machine Learning at Red Hat, said, “The survey responses confirm that many enterprises are struggling with adapting to increasing data volumes across multi-cloud and edge while also maintaining legacy data architectures. This is compounded by increasing data privacy regulations, pressure on IT and data spend and a shortage of highly-skilled talent. Red Hat believes that the solution to managing these challenges will be to implement data architectures that are agile — built for today’s requirements with the flexibility to evolve quickly in the future.”
The research indicates that given the rapid growth of data and use-case volume, increasing complexity and the skyrocketing costs, more organizations are reaching a breaking point. For those willing to take this on, the report offered a few key lessons to keep in mind:
“One of the most significant takeaways from this study is the need for organizations to invest in a decoupled and federated data architecture,” said Starburst CEO and co-founder Justin Borgman. “This approach meets today’s reality that data is everywhere, and companies can’t afford the time, cost, and architectural complexity to centralize it. It allows companies to bring analytics to the data, making it accessible for decision-making without data movement complexities and costs. It is the only viable approach that will allow companies to meet increased demands for data storage and analytics workloads, while getting costs under control.”
Boston Consulting Group carried out A New Architecture to Manage Data Costs and Complexity study in collaboration with Red Hat and Starburst for six weeks, from September 2022 to November 2022. This research report involved surveying approximately 300 U.S. and Western European organizations, from mid-size and large companies, across a broad range of industry verticals including: consumer, industrial goods, financial, healthcare, technology, education, media, energy, telecom and more. This study surveyed titles in the C-Suite, SVP, VP, Director and Senior Manager and interviews with customers, buyers, industry leaders.
Starburst is the analytics engine for all your data. We provide the fastest, most efficient analytics engine for your data warehouse, data lake, or data mesh. We unlock the value of distributed data by making it fast and easy to access, no matter where it lives. Starburst queries data across any database, making it instantly actionable for data-driven organizations. With Starburst, teams can lower the total cost of their infrastructure and analytics investments, prevent vendor lock-in, and use the existing tools that work for their business. Trusted by companies like Apache Corporation, Comcast, Doordash, FINRA, and VMware, Starburst helps companies make better decisions faster on all data.
About Red Hat
Red Hat is the world’s leading provider of enterprise open source solutions—including Linux, cloud, container, and Kubernetes. We deliver hardened solutions that make it easier for enterprises to work across platforms and environments, from the core datacenter to the network edge.
About Boston Consulting Group
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we work closely with clients to embrace a transformational approach aimed at benefiting all stakeholders—empowering organizations to grow, build sustainable competitive advantage, and drive positive societal impact.
For more information, press only:
Up to $500 in usage credits included