Session: Building a Data Mesh With Open Source Technologies
The Data Mesh is a massive tsunami in the data engineering world. This new(ish) concept is allowing to bring higher data quality, clearer data ownership, better governance, and more. If I had to summarize what the Data Mesh is bringing in two words, it would be trust & agility.
As the Data Mesh is still in its infancy, there are no solutions and no open source solutions. There are bits and pieces everywhere.
I will first introduce the data mesh and its four principles in this talk. Then, I will dive into how to build one while relying on Open Source technologies, sharing some of the dangers, experiences, successes, and adjustments we went through at PayPal.
Takeaways: understand what the Data Mesh is bringing to your data engineering organization and build your Data Mesh with Open Source tools & components.
Audience: anyone interested in the future of data engineering.
Presenters:
This track proudly sponsored by 