Danny D. Leybzon

Dec 3, 2021

blog bg left
Back to Blog

Observability in Production: Monitoring Data Drift with WhyLabs and Valohai

  • AI Observability
  • ML Monitoring
  • MLOps
  • Data Logging
  • integration

Danny D. Leybzon

Dec 3, 2021

Imagine that magical day when your machine learning model is in production. It is possibly integrated into end-user applications, serving predictions and providing real-world value. As a Data Scientist, You may think that your job is done and that you can move on to the next problem to be solved. Unfortunately, the work is just getting started.

What works today might not work tomorrow. And when a model is in real-world use, serving the faulty predictions can lead to catastrophic consequences like what happened with Zillow and their iBuying algorithm which caused the company to overpay for real estate and ultimately, lay off 25% of their workforce.

...

We will dig into how we can easily get started with observability and detect data drift using whylogs while executing your pipeline on Valohai.

Continue reading on the Valohai Blog

Danny D. Leybzon

Other posts

Data Logging With whylogs

Danny D. Leybzon
|  

May 31, 2022

Users can detect data drift, prevent ML model performance degradation, validate the quality of their data, and more in a single, lightning-fast, easy-to-use package. The v1 release brings a simpler API, new data constraints, new profile visualizations, faster performance, and a usability refresh.
Read post
  • whylogs
  • Data Logging
  • Logging
  • open source
  • ML Monitoring

Visually Inspecting Data Profiles for Data Distribution Shifts

Felipe Adachi
|  

Jun 28, 2022

This short tutorial shows how to inspect data for distribution shift issues by comparing distribution metrics and applying statistical tests for drift values calculations.
Read post
  • whylogs
  • Data Logging
  • ML Monitoring

Choosing the Right Data Quality Monitoring Solution

Stephen Oladele,
Danny D. Leybzon
|  

May 18, 2022

In the second article in this series, we break down what to look for in a data quality monitoring solution, open source and Saas tools available, and how to decide on the best one for your organization.
Read post
  • ML Monitoring
  • Machine Learning

A Comprehensive Overview Of Data Quality Monitoring

Stephen Oladele,
Danny D. Leybzon
|  

Apr 29, 2022

In the first article in this series, we provide a detailed overview of why data quality monitoring is crucial for building successful data and machine learning systems and how to approach it.
Read post
  • ML Monitoring
  • Machine Learning

WhyLabs Now Available in AWS Marketplace

Maria Karaivanova
|  

Mar 18, 2022

AWS customers worldwide can now quickly deploy the WhyLabs AI Observatory to monitor, understand, and debug their machine learning models deployed in AWS.
Read post
  • AI Observability
  • WhyLabs
  • Machine Learning
  • ML Monitoring

Deploying and Monitoring Made Easy with TeachableHub and WhyLabs

Danny D. Leybzon,
Felipe Adachi
|  

Mar 16, 2022

Deploying a model into production and maintaining its performance can be harrowing for many Data Scientists, especially without specialized expertise and equipment. Fortunately, TeachableHub and WhyLabs make it easy to get models out of the sandbox and into a production-ready environment.
Read post
  • integration
  • ML Monitoring
  • AI Observability

How Observability Uncovers the Effects of ML Technical Debt

Bernease Herman,
Alessya Visnjic,
Danny D. Leybzon
|  

Mar 10, 2022

Many teams test their machine learning models offline but conduct little to no online evaluation after initial deployment. These teams are flying blind—running production systems with no insight into their ongoing performance.
Read post
  • AI Observability
  • WhyLabs
  • whylogs
  • Thought Leadership
  • ML Monitoring
  • MLOps
  • Data Logging

Deploy your ML model with UbiOps and monitor it with WhyLabs

Danny D. Leybzon
|  

Jan 5, 2022

Machine learning models can only provide value for a business when they are brought out of the sandbox and into the real world... Fortunately, UbiOps and WhyLabs have partnered together to make deploying and monitoring machine learning models easy.
Read post
  • integration
  • AI Observability
  • Machine Learning
  • ML Monitoring
  • MLOps
  • Startup
  • WhyLabs

AI Observability for All

Alessya Visnjic
|  

Jan 4, 2022

We’re excited to announce our new Starter edition: a free tier of our model monitoring solution that allows users to access all of the features of the WhyLabs AI observability platform. It is entirely self-service, meaning that users can sign up for an account and get started right away.
Read post
  • AI Observability
pre footer decoration
pre footer decoration
pre footer decoration

Run AI With Certainty

Get started for free
loading...