Loading…
September 27-30, 2021
Seattle, Washington, USA + Virtual
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit + Embedded Linux Conference + OSPOCon 2021 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC -7). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Back To Schedule
Tuesday, September 28 • 12:00pm - 12:50pm
(VIRTUAL) The Future of Data Pipelines with Atomic Wasm Transformations and the Evolving Role of Data Engineers - Thomas Chataigner & Philippe Métais, Polyphene

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
« Data engineers are slowing us down. » This is what data scientists & analysts are saying in growing companies, in any sector. The truth is that data engineers are overworked. The ever increasing flow of data requires a radical change of mindset when it comes to writing and maintaining data pipelines. As Agile and DevOps changed the way software is built because software was slowing down companies, a similar shift needs to occur with data. Open source solutions like Airbyte and DBT are leading the way with connectors and SQL data transformations. But what about more complex pipelines that can’t be expressed with SQL? Philippe Métais and Thomas Chataigner, co-founders of Polyphene, will introduce a new open source protocol to create pipelines that address current and future data engineering challenges. The modular architecture of this protocol, based on a portable WebAssembly runtime as well as decentralized data and transformation registries, creates a versatile solution for scalable pipelines with guarantees of reproducibility, version control and data availability. While the first part of the presentation will cover technical considerations, the second part will provide a demo on a practical use case.
Speakers
avatar for Thomas Chataigner

Thomas Chataigner

Co-founder CTO, Polyphene
Thomas is co-founder and CTO of Polyphene. At Polyphene, Thomas and his team are working on the development of an open source protocol to create data pipelines of atomic Wasm transformations and execute them in a way that enables sharing of any data transformation history. Thomas... Read More →
avatar for Philippe Métais

Philippe Métais

Co-founder CEO, Polyphene
Philippe is the co-founder and CEO of Polyphene. At Polyphene, Philippe and his team are working on the development of an open source protocol to create data pipelines of atomic Wasm transformations and execute them in a way that enables sharing of any data transformation history... Read More →

Tuesday September 28, 2021 12:00pm - 12:50pm PDT
MeetingPlay Platform + Virtual Learning Lab
  AI & Data, Data (Versioning + Format + Pipeline Management + Stream Processing + SQL Engines + Feature Engineering + Visualization + Governance + Labeling)