Skip to Main content Skip to Navigation
Conference papers

OPTION: OPTImization Algorithm Benchmarking ONtology

Abstract : Many platforms for benchmarking optimization algorithms offer users the possibility of sharing their experimental data with the purpose of promoting reproducible and reusable research. However, different platforms use different data models and formats, which drastically inhibits identification of relevant data sets, their interpretation, and their interoperability. Consequently, a semantically rich, ontology-based, machine-readable data model is highly desired. We report in this paper on the development of such an ontology, which we name OPTION (OPTImization algorithm benchmarking ONtology). Our ontology provides the vocabulary needed for semantic annotation of the core entities involved in the benchmarking process, such as algorithms, problems, and evaluation measures. It also provides means for automated data integration, improved interoperability, powerful querying capabilities and reasoning, thereby enriching the value of the benchmark data. We demonstrate the utility of OPTION by annotating and querying a corpus of benchmark performance data from the BBOB workshop data-a use case which can be easily extended to cover other benchmarking data collections. CCS CONCEPTS • Computing methodologies → Ontology engineering; Reasoning about belief and knowledge; Continuous space search;
Document type :
Conference papers
Complete list of metadata
Contributor : Carola Doerr <>
Submitted on : Friday, June 4, 2021 - 6:09:05 PM
Last modification on : Wednesday, June 9, 2021 - 3:33:53 AM


Kostovska OPTION arxiv 2104.11...
Files produced by the author(s)



Ana Kostovska, Diederick Vermetten, Carola Doerr, Saso Dzeroski, Panče Panov, et al.. OPTION: OPTImization Algorithm Benchmarking ONtology. Genetic and Evolutionary Computation Conference (GECCO 2021, Companion Material), Jul 2021, Lille (on line), France. ⟨10.1145/3449726.3459579⟩. ⟨hal-03233907⟩



Record views


Files downloads