Lei Gao is a seasoned Engineering Leader with a strong background in Enterprise Software, Cloud Computing, and Machine Learning Engineering. Lei specializes in designing and implementing data-intensive software systems and applications. At Workday (Engineering Manager), Lei led a team to build a data analytics platform serving over 2000 internal users and drove a 3-year public cloud migration program that significantly improved developer productivity. Lei holds a Ph.D. in Electronic and Computer Engineering from the University of Limerick, Ireland, and a US Patent for his work in distributed monitoring. An engaging speaker, Lei is passionate about the future of data-intensive systems and machine learning engineering.
Harnessing the Power of Dual Query Engines: Unifying Presto and Spark for Interactive and Advanced Analytics.
In the modern data-driven world, the need for powerful and versatile data access services has never been greater. Our approach at Workday is a unique dual query engine, leveraging the strengths of both Presto and Spark. This innovative configuration caters to a broad spectrum of needs, from interactive analytics to advanced machine learning tasks.
This talk will provide an in-depth exploration of the design, implementation, and benefits of our dual query engine system. We'll delve into how we facilitate user data access via a REST API and CLI, and ensure security through a unified enterprise model. We'll demonstrate how this dual query engine meets diverse analytical requirements, providing users with the tools needed to extract maximum value from their data.
Whether you are an engineer, a data scientist, or a business leader, this talk will offer valuable insights into the future of data analytics and how dual query engines can elevate your data operations to new heights.
Comments