Observability in Production: Monitoring Data Drift with WhyLabs and Valohai

Danny D. Leybzon

Dec 3, 2021

Back to Blog

Observability in Production: Monitoring Data Drift with WhyLabs and Valohai

AI Observability
ML Monitoring
MLOps
Data Logging
Integration

Danny D. Leybzon

Dec 3, 2021

Imagine that magical day when your machine learning model is in production. It is possibly integrated into end-user applications, serving predictions and providing real-world value. As a Data Scientist, You may think that your job is done and that you can move on to the next problem to be solved. Unfortunately, the work is just getting started.

What works today might not work tomorrow. And when a model is in real-world use, serving the faulty predictions can lead to catastrophic consequences like what happened with Zillow and their iBuying algorithm which caused the company to overpay for real estate and ultimately, lay off 25% of their workforce.

...

We will dig into how we can easily get started with observability and detect data drift using whylogs while executing your pipeline on Valohai.

Continue reading on the Valohai Blog

Danny D. Leybzon

Re-imagine Data Monitoring with whylogs and Apache Spark

Andy Dang

Nov 23, 2022

An overview of how the whylogs integration with Apache Spark achieves large scale data profiling, and how users can apply this integration into existing data and ML pipelines.

Read post

Integration
Apache Spark
whylogs

ML Monitoring in Under 5 Minutes

Sage Elliott

Nov 15, 2022

A quick guide to using whylogs and WhyLabs to monitor common issues with your ML models to surface data drift, concept drift, data quality, and performance issues.

Read post

ML Monitoring
MLOps
Data Logging

AIShield and WhyLabs: Threat Detection and Monitoring for AI

Danny D. Leybzon,

Amit Phadke

Nov 8, 2022

The seamless integration of AIShield’s security insights on WhyLabs AI observability platform delivers comprehensive insights into ML workloads and brings security hardening to AI-powered enterprises.

Read post

Integration
AI Observability

Large Scale Data Profiling with whylogs and Fugue on Spark, Ray or Dask

WhyLabs Team

Oct 13, 2022

Profiling large-scale data for use cases such as anomaly detection, drift detection, and data validation with Fugue on Spark, Ray or Dask.

Read post

whylogs
Integration

Monitoring Image Data with whylogs v1

Ray Reed

Oct 5, 2022

When operating computer vision systems, data quality and data drift issues always pose the risk of model performance degradation. Whylabs provides a simple yet highly customizable solution for maintaining observability into data to detect issues and take action sooner.

Read post

whylogs
Image Data

WhyLabs Private Beta: Real-time, No-code, Cloud Storage Data Profiling

WhyLabs Team

Oct 3, 2022

We’re excited to announce our Private Beta release for a no-code integration option for WhyLabs, allowing users to bypass the need to integrate whylogs into their data pipeline.

Read post