4. Evaluation campaigns: benchmarking, challenges and competitions
4.1 Benchmarking campaign
The aim of a benchmarking campaign is to carry out a comparative evaluation (parangonnage) of the performance of different AI systems designed to automate a specific task, at a given time and place.
-
LNE's past experience in organizing assessment campaigns has led to the identification of best practices for guaranteeing the value of the results obtained. In particular, this means ensuring that the campaign is :
scientific: while preserving the demonstration aspect typically associated with evaluation campaigns, these must be based on the scientific criteria of objectivity of evaluation, repeatability of performance measurement and reproducibility of experiments,...
Exclusive to subscribers. 97% yet to be discovered!
Already subscribed? Log in!
Evaluation campaigns: benchmarking, challenges and competitions
Conclusion
Article included in this offer
"Instrumentation and measurement methods"
(
52 articles
)
Updated and enriched with articles validated by our scientific committees
A set of exclusive tools to complement the resources
Bibliography
Exclusive to subscribers. 97% yet to be discovered!
Already subscribed? Log in!
