Detection and correction by machine learning
Detection and correction of data quality problems with machine learning
Quizzed article REF: H3701 V1
Detection and correction by machine learning
Detection and correction of data quality problems with machine learning

Author : Laure BERTI-ÉQUILLE

Publication date: May 10, 2023, Review date: November 19, 2024 | Lire en français

Logo Techniques de l'Ingenieur You do not have access to this resource.
Request your free trial access! Free trial

Already subscribed?

2. Detection and correction by machine learning

Recent work has shown that machine learning models can be used to accurately identify problems in data and correct certain types of error with complex (semi-)automatic correction mechanisms that were previously performed manually or based on hard-to-maintain heuristics. New learning strategies can also determine which corrections are necessary depending on the analysis objective, as it is not necessarily necessary (or even feasible) to correct all problems.

Learning-based approaches can be used to detect or correct erroneous data. They rely on examples of erroneous and correct records to train the model. But designing models that are sufficiently expressive and therefore complex requires the use of a large number of examples. Depending on the task (detection of outliers, duplicates, inconsistencies, etc.), the creation of these sets of examples can prove very difficult,...

You do not have access to this resource.
Logo Techniques de l'Ingenieur

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource. Click here to request your free trial access!

Already subscribed?


Ongoing reading
Detection and correction by machine learning

Article included in this offer

"Software technologies and System architectures"

( 227 articles )

Complete knowledge base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

View offer details