September 27-30, 2021
Seattle, Washington, USA + Virtual
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit + Embedded Linux Conference + OSPOCon 2021 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Pacific Daylight Time (UTC -7). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Back To Schedule
Wednesday, September 29 • 10:30am - 11:20am
(VIRTUAL) Infusing Trusted AI using Machine Learning Payload Logging on Kubernetes - Tommy Li & Andrew Butler, IBM

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
As more machine learning models are developed and served on Kubernetes, it's becoming harder to track the incoming data and payloads by just reading the logs. For trusting model predictions, drift, anomaly, adversarial and bias detection need to be built in the platform. Data scientists have difficulty figuring out model behavior on Kubernetes since it's hard to access and process model payloads on Kubernetes. Therefore, it's important to record and persist the model input and output payloads with the proper schema. These payloads can be used with other tools to explain, analyze, and generate machine learning metrics such as fairness and drift detection for models running in production. This can help AI operators and data scientists visualize and find any potential issues with the model. This talk covers how to use KFServing, Kafka Connect, and AIF360 to serve ML models, persist payloads, and measure the model fairness in a production environment.

avatar for Andrew Butler

Andrew Butler

Developer - Deep Learning/Machine Learning/AI Advocate, IBM
Andrew Butler is a Machine Learning Software Developer for IBM, where he works on incorporating tools that increase trust in machine learning models by looking at the explainability, robustness, and fairness of those models. In addition, he works on a project that provides Kubernetes-style... Read More →
avatar for Tommy Li

Tommy Li

Senior Software Developer, IBM
Tommy Li is a senior software developer in IBM focusing on Cloud, Kubernetes, and Machine Learning. He is one of the Kubeflow committers and worked on various open-source projects related to Kubernetes, Microservice, and deep learning applications to provide advanced use cases on... Read More →

Wednesday September 29, 2021 10:30am - 11:20am PDT
MeetingPlay Platform + Virtual Learning Lab
  AI & Data, Trusted and Responsible AI