Model drift
ML Concept
Overview
Use casedetecting and measuring changes in machine learning model performance over time
Knowledge graph stats
Claims92
Avg confidence91%
Avg freshness100%
Last updatedUpdated 5 days ago
WikidataQ138967967
Trust distribution
100% unverified
Governance
Not assessed
Model drift
concept
Degradation of model performance over time due to changes in underlying data distributions.
Compare with...category
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| machine learning operations concept | ○Unverified | High | Fresh | 1 |
| machine learning monitoring concept | ○Unverified | High | Fresh | 1 |
| ML monitoring concept | ○Unverified | High | Fresh | 1 |
| ML monitoring and observability concept | ○Unverified | High | Fresh | 1 |
subcategory of
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| ML monitoring | ○Unverified | High | Fresh | 1 |
| model monitoring | ○Unverified | High | Fresh | 1 |
impacts
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| model accuracy | ○Unverified | High | Fresh | 1 |
| model accuracy degradation | ○Unverified | High | Fresh | 1 |
primary use case
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| detecting and measuring changes in machine learning model performance over time | ○Unverified | High | Fresh | 1 |
| detecting changes in model performance over time | ○Unverified | High | Fresh | 1 |
| monitoring machine learning model performance degradation over time | ○Unverified | High | Fresh | 1 |
| detecting degradation in machine learning model performance over time | ○Unverified | High | Fresh | 1 |
| detecting when machine learning model performance degrades over time | ○Unverified | High | Fresh | 1 |
| monitoring degradation in machine learning model performance over time | ○Unverified | High | Fresh | 1 |
category of
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| machine learning operations | ○Unverified | High | Fresh | 1 |
mitigation strategies include
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| model retraining | ○Unverified | High | Fresh | 1 |
| online learning | ○Unverified | Moderate | Fresh | 1 |
causes problem
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| degraded model accuracy | ○Unverified | High | Fresh | 1 |
related concept
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| data drift | ○Unverified | High | Fresh | 1 |
| concept drift | ○Unverified | High | Fresh | 1 |
causes include
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| data drift | ○Unverified | High | Fresh | 1 |
| concept drift | ○Unverified | High | Fresh | 1 |
| changes in input data distribution | ○Unverified | High | Fresh | 1 |
| data distribution changes and concept shift | ○Unverified | High | Fresh | 1 |
| data distribution changes | ○Unverified | High | Fresh | 1 |
| feature drift | ○Unverified | High | Fresh | 1 |
| feature distribution changes | ○Unverified | High | Fresh | 1 |
| data drift and concept drift | ○Unverified | High | Fresh | 1 |
part of discipline
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| machine learning engineering | ○Unverified | High | Fresh | 1 |
| MLOps | ○Unverified | High | Fresh | 1 |
occurs in
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| production ML systems | ○Unverified | High | Fresh | 1 |
| production machine learning systems | ○Unverified | High | Fresh | 1 |
related to
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| concept drift | ○Unverified | High | Fresh | 1 |
| data drift | ○Unverified | High | Fresh | 1 |
| covariate shift | ○Unverified | Moderate | Fresh | 1 |
addressed by technique
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| model retraining | ○Unverified | High | Fresh | 1 |
| online learning | ○Unverified | Moderate | Fresh | 1 |
category type
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| ML operations concept | ○Unverified | High | Fresh | 1 |
defined as
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| phenomenon where ML model accuracy decreases due to changes in data distribution | ○Unverified | High | Fresh | 1 |
mitigation strategy
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| continuous model retraining | ○Unverified | High | Fresh | 1 |
| model retraining | ○Unverified | High | Fresh | 1 |
| online learning | ○Unverified | Moderate | Fresh | 1 |
| continuous model retraining and validation | ○Unverified | Moderate | Fresh | 1 |
causes
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| changes in underlying data distribution | ○Unverified | High | Fresh | 1 |
| changes in input data distribution | ○Unverified | High | Fresh | 1 |
monitored in
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| production environments | ○Unverified | High | Fresh | 1 |
measured using
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| performance metrics | ○Unverified | High | Fresh | 1 |
| statistical tests | ○Unverified | Moderate | Fresh | 1 |
| statistical distance metrics between training and inference data | ○Unverified | Moderate | Fresh | 1 |
| KL divergence | ○Unverified | Moderate | Fresh | 1 |
applies to
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| supervised learning models | ○Unverified | High | Fresh | 1 |
| supervised learning models in production | ○Unverified | High | Fresh | 1 |
addressed by tools
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Amazon SageMaker Model Monitor | ○Unverified | High | Fresh | 1 |
| Evidently AI | ○Unverified | High | Fresh | 1 |
| MLflow | ○Unverified | Moderate | Fresh | 1 |
prevention strategy
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| continuous monitoring | ○Unverified | High | Fresh | 1 |
measured by
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| statistical distance metrics | ○Unverified | High | Fresh | 1 |
monitoring frequency
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| continuous or batch monitoring | ○Unverified | High | Fresh | 1 |
part of
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| MLOps lifecycle | ○Unverified | High | Fresh | 1 |
detection methods include
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| statistical hypothesis testing | ○Unverified | High | Fresh | 1 |
| performance metrics monitoring | ○Unverified | Moderate | Fresh | 1 |
| performance metric monitoring | ○Unverified | Moderate | Fresh | 1 |
| Kolmogorov-Smirnov test | ○Unverified | Moderate | Fresh | 1 |
| Population Stability Index | ○Unverified | Moderate | Fresh | 1 |
business impact
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| decreased model accuracy and prediction reliability | ○Unverified | High | Fresh | 1 |
detected by
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| statistical tests and performance monitoring | ○Unverified | Moderate | Fresh | 1 |
addressed by
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| model retraining | ○Unverified | Moderate | Fresh | 1 |
monitored by
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| MLOps platforms | ○Unverified | Moderate | Fresh | 1 |
monitoring tools include
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Amazon SageMaker Model Monitor | ○Unverified | Moderate | Fresh | 1 |
| Azure Machine Learning | ○Unverified | Moderate | Fresh | 1 |
| Google Cloud AI Platform | ○Unverified | Moderate | Fresh | 1 |
| evidently ai | ○Unverified | Moderate | Fresh | 1 |
academic foundation
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| concept drift research | ○Unverified | Moderate | Fresh | 1 |
also known as
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| concept drift | ○Unverified | Moderate | Fresh | 1 |
mitigation approach
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| model retraining | ○Unverified | Moderate | Fresh | 1 |
requires
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| statistical monitoring techniques | ○Unverified | Moderate | Fresh | 1 |
monitored using
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Amazon SageMaker Model Monitor | ○Unverified | Moderate | Fresh | 1 |
| MLflow Model Registry | ○Unverified | Moderate | Fresh | 1 |
| Azure Machine Learning model monitoring | ○Unverified | Moderate | Fresh | 1 |
measurement metric
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| prediction accuracy decline | ○Unverified | Moderate | Fresh | 1 |
| accuracy degradation | ○Unverified | Moderate | Fresh | 1 |
component of
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| MLOps pipeline | ○Unverified | Moderate | Fresh | 1 |
detection method
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| KL divergence | ○Unverified | Moderate | Fresh | 1 |
| statistical hypothesis testing | ○Unverified | Moderate | Fresh | 1 |
open source tools include
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| Evidently AI | ○Unverified | Moderate | Fresh | 1 |
detection methods
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| KL divergence and population stability index | ○Unverified | Moderate | Fresh | 1 |
common in
| Value | Trust | Confidence | Freshness | Sources |
|---|---|---|---|---|
| time series forecasting | ○Unverified | Moderate | Fresh | 1 |