๐ OpenEuroLLM Multilingual Evaluation
Normalized average downstream performance (min-max scaled per benchmark/metric, then averaged across languages and benchmarks) vs. tokens trained. Only benchmarks that were decontaminated from the training data are averaged: ARC Challenge MT, Belebele, Global MMLU, INCLUDE, MultiBLiMP, XCSQA and xHellaSwag.