Baselines

Track 1 · Subtrack 1 — global equivalence alignment

Repaired coherence-aware P/R/F1

Macro-averaged over the three pairs (NCIT–DOID, SNOMED–FMA, SNOMED–NCIT); sorted by the headline column. See evaluation metrics.

Track 1 · Subtrack 2 — local equivalence ranking

MRR and Hits@k

Macro-averaged over the three pairs (NCIT–DOID, SNOMED–FMA, SNOMED–NCIT); sorted by the headline column. See evaluation metrics.

About these baselines

Organiser baselines (macro over the three pairs). Global = semi-supervised test-slice (option a): repaired coherence-aware F1 headline. Participant results appear on the CodaBench leaderboards. The global-alignment headline is the repaired coherence-aware F1; local ranking is headlined by MRR. Full data: leaderboard.json. Participant results appear on the results page, fed by the CodaBench leaderboards.

Reference coherence

Reference coherence — before vs after repair

The Task-1 reference alignment is grounded in UMLS/Mondo and can be logically incoherent; the repair procedure removes or weakens the incoherence-inducing correspondences. This table reports the coherence of each pair's reference before and after repair — the number of unsatisfiable named classes in the merged ontology and the corresponding incoherence degree. All three repaired references are coherent (0 unsatisfiable classes).

Unsatisfiable classes are counted in the merged ontology (O_src ∪ O_tgt ∪ R) under the ELK reasoner; the incoherence degree is that count over the merged named-class signature. † denotes an ELK lower bound (a sound under-approximation; the exact figure is pending). The all-equivalence standard SNOMED–FMA merge does not classify under ELK even at a 128 GB heap, so its before-repair figure is unavailable (—). Machine-readable data: reference_coherence.json.

Editions

Baselines and results by edition

OAEI Bio-ML 2026 is the current edition. As the track matures, each edition's final baselines and participant results will be archived here, and changes between editions are recorded in the changelog.