Danny D. Leybzon

Dec 3, 2021

blog bg left
Back to Blog

Observability in Production: Monitoring Data Drift with WhyLabs and Valohai

  • AI Observability
  • ML Monitoring
  • MLOps
  • Data Logging
  • integration

Danny D. Leybzon

Dec 3, 2021

Imagine that magical day when your machine learning model is in production. It is possibly integrated into end-user applications, serving predictions and providing real-world value. As a Data Scientist, You may think that your job is done and that you can move on to the next problem to be solved. Unfortunately, the work is just getting started.

What works today might not work tomorrow. And when a model is in real-world use, serving the faulty predictions can lead to catastrophic consequences like what happened with Zillow and their iBuying algorithm which caused the company to overpay for real estate and ultimately, lay off 25% of their workforce.

...

We will dig into how we can easily get started with observability and detect data drift using whylogs while executing your pipeline on Valohai.

Continue reading on the Valohai Blog

Danny D. Leybzon

Other posts

AI Observability for All

Alessya Visnjic
|  

Jan 4, 2022

We’re excited to announce our new Starter edition: a free tier of our model monitoring solution that allows users to access all of the features of the WhyLabs AI observability platform. It is entirely self-service, meaning that users can sign up for an account and get started right away.
Read post
  • AI Observability

Deploy your ML model with UbiOps and monitor it with WhyLabs

Danny D. Leybzon
|  

Jan 5, 2022

Machine learning models can only provide value for a business when they are brought out of the sandbox and into the real world... Fortunately, UbiOps and WhyLabs have partnered together to make deploying and monitoring machine learning models easy.
Read post
  • integration
  • AI Observability
  • Machine Learning
  • ML Monitoring
  • MLOps
  • Startup
  • WhyLabs

Why You Need ML Monitoring

Danny D. Leybzon
|  

Dec 2, 2021

Machine learning models are increasingly becoming key to businesses of all shapes and sizes, performing myriad functions... If a machine learning model is providing value to a business, it’s essential that the model remains performant.
Read post
  • AI
  • AI Observability
  • Data Logging
  • Machine Learning
  • ML Monitoring
  • MLOps
  • WhyLabs

Data Labeling Meets Data Monitoring with Superb AI and WhyLabs

Danny D. Leybzon
|  

Nov 29, 2021

Data quality is the key to a performant machine learning model. That’s why WhyLabs and Superb AI are on a mission to ensure that data scientists and machine learning engineers have access to tools designed specifically for their needs and workflows.
Read post
  • integration
  • DataOps
  • Image Data
  • Data Logging
  • ML Monitoring
  • AI Observability

Running and Monitoring Distributed ML with Ray and whylogs

Anthony Naddeo,
Danny D. Leybzon
|  

Nov 23, 2021

Running and monitoring distributed ML systems can be challenging. Fortunately, Ray makes parallelizing Python processes easy, and the open source whylogs enables users to monitor ML models in production, even if those models are running in a distributed environment.
Read post
  • open source
  • whylogs
  • integration
  • AI Observability
  • Logging

Monitor your SageMaker model with WhyLabs

Danny D. Leybzon
|  

Nov 18, 2021

In this blog post, we will dive into the WhyLabs AI Observatory, a data and ML monitoring and observability platform, and show how it complements Amazon SageMaker.
Read post
  • SageMaker
  • AI Observability
  • Machine Learning
  • integration
  • WhyLabs
pre footer decoration
pre footer decoration
pre footer decoration

Run AI With Certainty

Get started for free
loading...