[restart] [share link] [json] select language: [swap] [compare scores] [compare models] [map] [release history] [uploads]

OPUS-MT Dashboard

Table of chrf++ score differences between the best OPUS-MT model and the best external modelfor language pairs with an existing OPUS-MT model (other cells are left blank):

aframharaasmastazjbelbenbosbulcatcebcesckbcmn_Hanscmn_Hantcymdandeuellengestfasfinfrafulgleglggujhauhebhinhrvhunhyeiboindislitajavjpnkamkankatkazkeakhmkirkorlaolavlinlitltzlugmalmarmkdmltmonmrimsamyanldnobnpinsonyaociorypanpolporpusronrusslkslvsnasndsomspasrpsrp_Cyrlsweswhtamteltgktglthaturukrumburduzbviewolxhoyorzul
afrafr-13.5-6.6 1.1-1.0-5.2-5.6-8.6-6.6-4.6-4.0 1.0-3.3-7.0-6.6-5.7-9.1
amhamh-12.7-12.0-38.5-37.7-30.9-12.8-38.3-11.4-12.9
ara-13.4ara-2.0 0.9-1.5 1.3 2.8-3.2 1.1-28.5 2.0 0.4-0.7-2.9-1.1-9.1 1.3-8.4-15.6-1.9-5.7 0.8-10.0 1.8-1.2-2.6-10.9 0.6 0.2 2.1-5.3-10.0
asmasm-10.2-15.3-16.1-13.4-10.2-37.3-36.8-35.7-12.8
ast-0.8ast-13.4 1.5 1.4-2.8-1.6 0.9-38.0 1.0-19.7 1.1-2.7-0.1-0.2-8.8-0.5-10.1
bel-9.5-0.1bel-7.6-0.6-0.5-1.3-3.7-0.2 0.0 0.1-2.6-4.9-4.6-0.7-2.2 0.3 0.4-4.9-12.3-0.6-0.9-17.4 0.3-31.8-8.5 0.2-8.9-0.8-0.1-1.0-0.9-3.0-0.4-0.7-29.5-0.1 0.6-17.7 0.6
ben-6.7ben-13.3-17.4-14.6-9.7-40.1-39.5-37.7-13.2
bos-6.5bos-4.5-5.5-2.2-2.8-5.6-5.8-2.7-5.0-2.6-4.3-6.1-5.4-43.5 1.7-6.4
bul-7.5-6.4-4.2bul-2.0-0.2 3.4 7.2 0.8 2.0 1.2-6.4 1.3 1.0-2.8 4.3 0.4-6.0 2.2 1.2-8.9 0.7 2.3-10.0-0.3 0.7-2.0 0.9-32.5-0.8 1.0-24.5 4.2 0.6-0.9 0.6
cat 0.4 2.9-0.9-13.7cat-6.0-1.8 1.0-0.4-16.9 0.5 0.1 2.7-41.5 0.9 3.2-0.4-22.3 1.0-2.7 0.7-2.0-6.5-0.1 3.3-9.5
cebceb-2.9-1.1-4.3-14.0-15.9-1.3-1.1
ces-6.8-7.0-10.8 1.1-1.5ces 2.5 5.7 1.3 2.6 1.4-7.0 1.6 1.5-2.4 4.3 1.1-2.0 1.9 0.5 1.2 1.0 2.3-10.4 0.0 1.2-2.2 1.6-34.5 0.9 1.1-35.1 4.8 1.0 1.8
ckbckb-17.5
cmn_Hans-22.5-12.6-16.7cmn_Hans-2.4 0.2-10.6-4.6-16.0-2.9-7.5-1.0-13.7 0.3-19.6-24.0-21.8-16.9-10.9-22.3
cmn_Hant-19.7-9.5-13.0-0.8cmn_Hant 0.3-11.5-3.4-12.9 0.1-6.3-0.0-11.1-0.2-18.1-21.9-19.8-13.3-13.8-19.2
cymcym-0.8-11.2-7.2-8.5-24.8-9.7-6.1
dan-3.0 4.8-0.6-28.9 0.1 1.5dan 2.5 2.5-36.4 0.8 2.0-1.3 3.8-24.5-0.7 4.7 2.2-6.2-20.7-22.4-16.3-26.5 0.6 2.6 2.9 3.4 4.6 2.7-21.8 1.2-24.6 3.7 4.8 5.2
deu 1.3 4.0-1.9-1.3 0.5-10.3 3.6-2.5 0.1 3.8deu-0.1-2.3 3.3-12.0 6.7 2.8 3.4 3.4 2.7-5.2 3.8 3.1-5.5 9.6 4.3-0.3-13.6 2.2 2.5 2.6 4.1 1.9 2.3 1.7-46.6 3.1 4.6-0.6 4.5 3.3 2.1
ell-7.5-0.6ell-1.8-3.7
eng 3.3-8.1 4.7-11.1-0.5-29.7-1.3-10.9 0.1 5.0 2.5-1.3 2.9-17.9 6.1 9.5 0.7 3.3-0.7 1.5eng 3.8-4.5 3.3 3.3-6.2 6.5-0.2-24.5-21.6-0.1 2.4 2.4 3.1-4.8-3.9-1.8 4.1 0.8-19.5-8.6-5.5-12.8-6.3-5.2-19.4 0.8-19.8 2.9-19.0 1.8-1.9 3.0-2.8-0.7-4.6-9.0-0.6 6.7-10.8-11.8-15.2-4.7-0.3 3.3-29.5-33.2-2.4-0.6-43.2-44.7 0.8 2.5-9.9 1.5 2.8 3.6 0.8-3.2-44.1-12.0 1.0-32.6 2.2 1.2-7.9-12.7-1.9-44.413.4 4.6 5.0 4.4 0.3-9.8-35.3-5.1-3.5-1.9-1.9-0.9
est-3.1-7.3-7.0-6.3-4.7-29.2 0.8 2.5est 2.7-5.4-3.3-21.4-28.3-0.1-1.6-20.5-5.0-1.8-25.5-2.7-5.0-25.8-2.7-42.3-5.0-28.5-12.7-5.7-38.2
fas-2.3 0.9-10.8fas-0.8-0.0-0.1-30.9-2.9-16.1-0.7-12.3
fin-5.4 1.9-7.5-5.3 3.7 3.9-6.5-1.7 1.5 3.4 1.8 4.8fin 1.2 0.8 4.6-1.1-10.5 2.6 2.2-28.1-22.1-2.8 2.6-21.3-5.1-16.4 1.5 1.8 3.3 3.4 3.3-26.5 4.7 1.3-39.8 4.6 5.0 4.5 4.8-37.4-21.5
fra 1.2 3.6 3.9 0.0 2.4 2.2 2.0-1.2-0.3-26.0 0.6 4.3 0.7 6.0fra-17.5 1.0 3.9 3.5-3.5 1.6 5.3 4.3-20.3 2.1-13.5 1.9-2.9-0.1 1.8 1.7 1.4 2.6 4.2 0.3 3.2 1.317.4 3.8 3.7-4.9
fulful-14.5
gle-10.2 0.7-8.3gle-9.2-19.9-5.3-5.1
glg-1.2 3.2 2.7-13.8 1.2-3.3 0.9 1.2-1.6-0.2glg 2.2-40.8 1.2 4.4 2.8-23.1 1.1-3.0-0.2 0.4-5.8-0.2 3.0-8.6
guj-12.0-16.8-23.5guj-21.1-16.5-43.1-42.5-40.3-19.8
hau-18.0-25.0-23.5hau-22.1
heb-14.6-8.3-3.1 2.4 1.0 2.0 2.2 3.1 1.6-29.3 1.9-0.6-1.2heb-7.1-1.2-0.6-17.9-26.5-9.4-19.9 2.0 1.4 1.9-0.8 0.2 3.5-12.3 0.1 2.8-8.4 1.7
hin-8.5-11.1-2.1-18.7hin-9.9-42.7-44.0-40.6-11.7
hrv 4.2-1.4 0.1 4.2-0.3 3.6 2.9 5.7 3.3 4.1 0.6-1.4 6.4 1.7-1.0hrv-1.1 2.1 1.8 4.4 2.4-9.2 3.0 3.4 3.6 1.9 5.2 0.9-35.9 4.4 1.9 3.0
hun-6.2-13.9-7.9-6.3-5.7 1.4-7.3-1.5-3.6-4.3 0.1-1.0 3.6-8.2-3.3hun-10.8-6.2-29.0-21.1-22.5-4.4-16.8-3.1-4.0-3.4-8.4-25.4-1.8-41.5-4.6-2.8-13.5 3.4-38.4-21.2
hye-4.9hye-13.3
ibo-14.7ibo
ind-19.0-13.2-33.1-9.4-5.2 0.2 1.5-0.4-11.6-0.3-31.8-10.8ind-4.3-16.0-37.8-30.2 2.8-30.4-7.6 0.8-9.4
isl-2.9-4.8-21.7 0.8 2.2 4.4 4.4 3.0-25.5-1.0 1.5-1.3 1.3-21.2-3.3isl 1.6-15.7-19.2-13.8-22.6-3.3 3.4 2.3 1.8 3.5-4.7-19.1 1.3-20.3 4.9-1.3
ita 0.0 2.4 7.3-1.6 0.6 1.7 0.6-2.8-0.0-24.4-0.2 2.4-0.6 5.6 0.6-17.9 1.2 2.4-4.2-5.1ita 6.7 3.2-19.9-12.0 1.9-3.4 1.7 0.9 1.1 0.5 3.1 0.9-5.7
jav-14.5-2.2-3.8-5.2-19.0jav-2.2-2.0
jpn-17.3-7.0-12.0-3.5 0.7-19.9-8.8-13.7-9.0-10.6-13.9-9.1-8.7-13.9-8.7jpn-5.0-16.8-10.1-15.6-10.4-8.8-9.1-7.3-37.3-16.5-16.5-12.3-14.5
kan-16.7kan-25.1-24.7-25.2
kat-7.1kat-12.6
kaz-20.6-20.3-18.8-20.4kaz-38.3-12.9-16.1-28.0
kea-6.2-2.7-11.7kea-20.6-2.9
khm-26.7-13.4-8.7-7.7-11.3-2.9-4.4-31.4khm-29.6-20.2-2.8
kir-14.8-19.2-19.7-21.0-36.4kir-11.0-13.2-25.4
kor-5.3-0.7-5.5-6.4-3.0kor-6.8-4.2
lao-27.4-38.2-37.7-37.6lao-30.0
lav-27.4-1.4-21.2 3.2 1.1-1.2-29.8-28.7 2.0-23.5lav 2.5-26.9 0.2-22.4-0.5 1.0
lin-13.6lin
lit-26.4-2.7-19.0 2.2 0.8 2.6-28.0-28.3-0.6-1.4 5.2lit 0.8-24.8 1.8-1.7-1.3-6.2 3.1
ltz-3.6-15.5-12.9-0.3-7.8-18.0-18.3-24.6-24.7-19.4-10.1-18.4ltz-3.6-10.6-22.3-17.3-12.2-24.0-20.3
lug-10.9lug
mal-11.1-24.8mal-23.8-24.6
mar-9.8-13.3-8.7-21.3-16.2mar-41.2-40.9-38.8-15.7
mkd 5.7-0.0-0.1 3.8-0.4 2.8 2.7 3.5 0.7-1.9-1.9 1.8-1.7 4.8-1.3 1.4 1.7mkd 1.7-9.9 2.3 2.9 2.2 1.3-28.6 5.0 1.2-25.6 4.2 3.4 3.3
mlt-12.2-8.8 0.2-32.6-29.7-8.5-30.2-40.9mlt-11.1-12.0
mon-10.3-25.3-26.2-27.0-34.6-32.5mon-15.0-26.2
mri-22.5mri
msa-13.6-9.2-4.9 0.0 0.6-0.7-11.7-0.6-11.1-7.9-5.4-17.7msa 2.1-10.3 0.3-10.8
mya-12.2-7.3-13.4-36.9-35.7-32.9mya
nld 1.0-11.1-7.2-3.6 0.2 0.8 2.2-1.1 0.6 2.7-0.7-16.3-1.4-3.5-11.5-2.8nld-1.6-2.8-10.5 1.0-17.1-4.0
nob-2.6 4.3 1.7-22.7 3.6 4.1-7.5-1.3 2.8 4.6 2.3-28.5 1.4 3.3 1.7 3.9-21.6-0.6 4.7 3.2-14.1-22.5-0.1nob 3.1 4.0 3.9 3.1-19.3 2.3-20.3 3.5 5.0 6.4
npi-8.2-13.8-18.3-19.3-17.9-12.3npi-41.8-39.7-15.0
nya-8.6nya
oci-4.012.8-16.1-1.7-9.6-5.1-2.3-6.0-2.9-2.2-43.6-1.0-26.3-1.7oci-2.6-2.9-13.5-1.4-2.6-14.5
orm-20.9-19.3-18.9
pan-9.7-14.5-17.6-18.9-16.0-14.0-43.6pan-41.7-13.8
pol-15.7 3.2-6.4-7.0 2.8-0.2 2.7 3.8 6.9 2.9 3.2 0.1-1.4 5.4 1.6-1.4 3.4 4.0-1.1 2.3 0.7 1.8 1.6 2.7 2.1-8.6pol 2.1 2.7 2.0-24.7 3.7 0.7-32.1 3.6 3.3 2.8
por-0.1 3.6 9.9-1.3 1.8 1.9 1.8-2.0 1.4-32.3-0.7 3.6-0.8 5.8 0.4-22.3 0.5 3.9 3.2-42.2 1.0 7.4 3.7-23.1 1.2 1.4-2.9 2.0por 1.4 2.5 3.9 0.4 2.7 0.8 3.4 3.3
pus-19.5-29.6pus
ron 0.1 3.0 7.9-13.4 1.6-12.5-6.6-28.1 2.6-1.3-0.1-17.4 0.8 3.3-41.0 0.8-22.4 1.5-3.0 1.7ron-4.3 0.1 4.0 2.4
rus-4.4-2.4 5.3-3.1-7.2 3.5 2.3 4.2 2.5 6.3 2.8 3.1-0.4-1.0 7.7 2.6 0.2 3.2 4.5-2.7-11.6-7.8 1.5 2.0 0.3 5.1 4.8-17.2 3.6-36.3-2.9 1.9-7.6 3.8 4.0 1.4rus 0.3 4.6 1.6-35.1 4.4 3.7-19.9 2.4-6.7
slk-10.2-12.1-8.7 1.0-10.4-10.5-10.0-10.7-7.7 2.1slk-8.6 3.4
slv 2.6-7.1-4.7 3.1-0.2 3.8 4.0 7.0 3.1 3.9 0.4-1.0 6.0 1.6-1.5 4.4 5.2-0.3 2.0 1.7 1.8 3.0 2.0-9.0 2.7 2.9 3.5 1.1-26.8slv 1.2-34.2 4.0 4.2 2.6
sna-9.3sna
snd-12.3-18.1-24.3-21.6-19.7-16.4-42.0-41.8snd-16.7
som-14.4-14.7-17.2-24.9-22.9-15.1-22.7-33.2-13.0som-10.4
spa-0.8 2.2 5.9-1.0 1.6-0.5 1.3 2.4 1.1-23.5-0.4 2.8-1.0 4.3-0.2-15.5-0.3 2.5 2.4-36.2-4.3 1.0 6.3 3.2-18.8 2.4 1.2-2.2-2.1 1.7 0.8 0.6 2.2 2.6spa 2.337.5 2.4 2.0-5.4
srp-6.4 0.4-1.9-3.0-3.6-2.4-1.8-3.3 0.9-1.8 1.5-3.5-4.9-2.8srp 9.3-2.3
srp_Cyrl 8.9-6.4 4.1 0.8 4.3 0.6 4.7 4.0 4.6 0.4 5.4 2.8-1.2 4.8 2.4 2.4 4.6 2.8-9.4 2.6 3.5 3.9 2.5 5.2 1.3srp_Cyrl 4.4 3.7
swe-3.1 4.2-0.3-26.3 2.0 3.8-5.1 0.6 3.6 4.6 1.8-31.0 8.8 2.3-0.3 3.4-24.3-0.7 4.5 2.1-18.0-21.3-16.0-26.0 1.1 2.5 3.2 3.5 4.2 2.7-21.7 1.1-24.6swe 4.0 5.6
swh-8.3swh
tam-15.1-24.0-24.3tam-24.3
tel-10.2-25.0-24.9-24.3tel
tgk-15.7tgk
tgl-7.9-6.6-9.6 0.1-0.7tgl
tha-3.3-23.5-11.3-27.8-32.8tha
tur-8.8-14.9-0.8 1.2 3.4 3.9 0.1-11.0 5.6 0.3 0.2-21.8-11.0 1.4-37.4-33.2-5.8-23.9-13.2-18.5 2.5-8.6 1.8-0.2-21.2 0.1 4.0tur 3.4-30.6
ukr-5.5 7.0-2.7-6.1 4.0 2.8 5.3 2.9 6.2 3.9 3.6 0.2-1.3 7.8 2.7-0.2 4.3 4.6 5.3-8.9 2.1 1.9 1.5 6.3 4.8-17.4 4.1-37.4-2.9 3.0-7.7 4.2 3.5 4.0 1.3 2.3 4.6 1.5-36.8 4.9 5.0 5.0ukr
umb-4.9umb
urd-9.1-13.2-17.6-17.9-13.7-10.8-40.1-40.4-39.7urd
uzb-27.4-22.6-23.7-23.9-40.3-38.3-15.6-20.3uzb
vie-2.9-1.0 2.2 2.6-4.6-4.3 0.2-8.1 0.4 0.0-2.5-5.2-8.4-1.2-8.3-1.6-7.4-4.8vie
wol-15.0wol
xho-9.4xho
yor-14.4yor
zul-9.0zul

GitHub: [OPUS] [OPUS-MT] [benchmarks] [leaderboards] [dashboard]