Observability in Production: Monitoring Data Drift with WhyLabs and Valohai
- AI Observability
- ML Monitoring
- MLOps
- Data Logging
- Integration
Dec 3, 2021
Imagine that magical day when your machine learning model is in production. It is possibly integrated into end-user applications, serving predictions and providing real-world value. As a Data Scientist, You may think that your job is done and that you can move on to the next problem to be solved. Unfortunately, the work is just getting started.
What works today might not work tomorrow. And when a model is in real-world use, serving the faulty predictions can lead to catastrophic consequences like what happened with Zillow and their iBuying algorithm which caused the company to overpay for real estate and ultimately, lay off 25% of their workforce.
...
We will dig into how we can easily get started with observability and detect data drift using whylogs while executing your pipeline on Valohai.
Continue reading on the Valohai Blog
Other posts
How to Troubleshoot Embeddings Without Eye-balling t-SNE or UMAP Plots
Feb 23, 2023
- AI Observability
- whylogs
Robust & Responsible AI Newsletter - Issue #5
Mar 10, 2023
- WhyLabs
- Newsletter
Detecting Financial Fraud in Real-Time: A Guide to ML Monitoring
Mar 7, 2023
- ML Monitoring
- MLOps
Achieving Ethical AI with Model Performance Tracing and ML Explainability
Feb 2, 2023
- WhyLabs
- ML Monitoring
Detecting and Fixing Data Drift in Computer Vision
Jan 26, 2023
- ML Monitoring
- whylogs
- WhyLabs
BigQuery Data Monitoring with WhyLabs
Jan 17, 2023
- WhyLabs
- BigQuery
- Integration
Robust & Responsible AI Newsletter - Issue #4
Dec 22, 2022
- WhyLabs
- Newsletter
WhyLabs Private Beta: Real-time Data Monitoring on Prem
Dec 21, 2022
- whylogs
- WhyLabs
Understanding Kolmogorov-Smirnov (KS) Tests for Data Drift on Profiled Data
Dec 21, 2022
- Data Science
- Machine Learning
- MLOps