[restart] [share link] [json] select language: [swap] [compare scores] [compare models] [map] [release history] [uploads]

OPUS-MT Dashboard

Table of spbleu score differences between the best OPUS-MT model and the best external model:

araarqazebelbos_Latnbrebulcatceschachvcmn_Hanscmn_Hantcorcrhdandeudsbdtpellengepoestfasfinfkvfrafryglagleglggosgotgrcgrnhbshebhinhrvhsbhunidoido_Latnileile_Latninaina_Latnindislitajavjbojbo_Latnjpnkabkatkazkaz_Cyrlkhmkorkurladlad_Latnlatlat_Latnlavlfnlfn_Latnlitltzmarmkdmonmrimsandsnldnnonobnorociotaota_Arabota_Latnpespmnpmspolporromronrunrusslvspasqisrp_Cyrlsrp_Latnswaswetattglthatlhtlh_Latnturukrurduzbuzb_Latnvievolwuuyidyue_Hansyue_Hantzhozsm_Latnzza
araara 2.0-2.3-15.7
arqarq 9.1
azeaze 3.4
belbel-2.6-23.6 6.7
ber16.7
ber_Latn 2.016.7
bos_Latnbos_Latn68.4
brebre27.8
bulbul 4.2-4.9 1.1
catcat 1.1-18.7 0.6-0.6-0.4 4.7-13.7
cesces 0.2 2.711.3 6.4 3.2 0.0
chacha 9.0
chvchv35.911.2
cmn_Hanscmn_Hans-3.1-0.8-8.8-24.3-11.0-10.2 0.9 1.5-23.5-14.6 6.3
cmn_Hantcmn_Hant 4.8 3.7-5.1-10.1-8.710.9
corcor 8.1
crhcrh-5.0
dandan 3.0 0.2-21.7 1.4 0.0-12.0 1.7 8.3 1.8
deu-7.5-1.3 3.1 1.5 8.5 3.1deu25.5-3.2-10.7 8.3 5.6 2.625.9 5.4 0.6-2.8 1.9 0.4-9.6-8.3-14.9-17.012.128.4 1.2 0.1 1.0 0.8-11.3 0.1 7.6 3.8
dsb44.4dsb
dtpdtp 2.7 0.0 0.0
ell 1.2ell 3.2-14.0 2.7-7.3 4.7-8.5
eng 2.5 3.053.9 3.011.532.0 6.1 6.9 2.2 0.0 2.8 2.1eng-8.3-3.2 2.4 2.210.0-10.2 2.7 0.8 5.8 0.2 3.445.3 0.0 3.9 6.213.813.822.011.6-1.3-4.6 0.7 0.7-18.8-11.7 2.8-4.131.1-1.6 4.315.821.324.230.3 8.5 3.8-11.9-10.1 4.7-7.9-11.6 0.0 2.2 0.2 4.3 6.1 0.725.2 0.0 5.012.0 1.7-0.2 1.3 0.9 7.5 9.142.215.6-0.7 6.0 2.3-1.913.035.7 0.411.8 5.7 7.5 6.1 0.9
epo-16.6-28.8-17.0-23.8-10.3-17.2-11.0epo19.5-11.1-19.3-18.1-19.817.1 4.4 4.4-12.2 0.6-21.9 0.713.0 2.4 3.3-21.9-10.7-11.1-19.6-10.4-22.0-1.8-10.1-15.8 0.4
est 6.8est-3.1
fas-3.629.5fas 0.5
fin 4.1 2.8fin 2.9 4.1-12.3-18.5 2.9-22.717.0 3.8 9.1-25.0
fkv27.5fkv
fra21.0 3.3 2.9-0.5 4.8 6.8 0.7 3.7-1.8-0.3-8.0-1.5 4.2fra 4.2 5.4-2.3 1.4 0.4-14.0-15.2-14.7 8.713.320.8 2.0 1.121.8 3.4 6.0 1.8-17.4 0.7 0.6 2.3 2.1 5.0 3.0 0.213.9-24.2
fry19.8fry24.2
gla-17.1gla
gle-2.5gle
glg-3.7-17.8glg 2.9
gos22.1gos
got 0.4got
grc 9.9grc
grngrn-19.1
hbs59.9hbs60.158.6
heb-28.5 0.8-17.8heb-2.6-13.3 9.8 4.1 1.5 0.7 0.0
hinhin-6.6
hrv 0.5hrv 2.3
hsb48.1hsb
hun 2.6 0.5-18.6 1.7-5.0hun-13.414.2-7.2-6.7-1.3
ido24.338.835.5ido26.0
ido_Latn33.7ido_Latn
ile47.642.6ile
ile_Latn47.6ile_Latn
ina43.8ina 5.2 2.4
ina_Latnina_Latn 8.2
ind-1.8 0.5ind27.8
isl 2.8 2.6isl-13.9
ita 1.8-1.4 1.5-12.9 0.3-19.5 3.4ita-14.518.6-0.6 4.0-2.4 0.9-13.2
jav-11.2jav
jbo 1.1 0.7 1.2jbo
jbo_Latn 1.1jbo_Latn
jpn-6.0-14.4-7.5 0.6-10.1-24.9-3.1-5.0-5.1-5.9-23.5-8.0jpn 3.5-13.3 8.0 7.2-7.327.3-10.0-7.1-7.0-6.3-6.0 1.7-6.5-19.5-6.011.3
jpn_Hani30.725.634.9
jpn_Hira29.720.330.923.917.222.922.2
kab-8.0-15.3-14.5kab-25.7-7.2
kat-6.7kat-15.0
kaz-13.3kaz
kaz_Cyrl37.7kaz_Cyrl
khm-17.1khm-3.6
kor-3.1 0.6-1.1-1.4-15.8kor-0.9
kor_Hang43.331.034.3
kur18.5kur
lad33.5lad36.8 1.5
lad_Latn36.5lad_Latn 1.9
lat25.411.8lat31.017.627.6
lat_Latnlat_Latn17.6
lav 4.9lav
lfn10.4 0.7lfn
lfn_Latn 8.6 4.9lfn_Latn
lit-0.1-42.7-16.0lit 3.3-2.2-5.3
ltz-18.9-9.9ltz-24.5
mar-15.2mar
mkd 1.0mkd
mon-9.3mon
mri-13.4mri
msa-1.0 2.9-13.0-6.2-0.814.9
nds51.348.139.4nds43.022.547.9
nld-5.4 1.4-0.3-28.1 3.9 2.136.2-2.5-18.5-41.6nld-3.1 1.1
nno-7.2nno82.1
nob-1.958.9nob 0.5
nor41.059.257.559.976.827.5
oci-37.4oci
ota 6.2ota 4.2
ota_Arab 4.2ota_Arab
ota_Latn17.5ota_Latn
pes-3.2pes
pmn 0.9pmn
pms20.7pms
pol 5.3 0.8-33.2 3.5-10.4pol 3.9 2.6-42.4 3.6
por 3.4 4.1 9.9-1.8-3.4-1.6-7.8 2.4 2.8 2.5-1.9-16.417.717.725.5 2.2por-0.2 3.4 0.6
rom12.7rom
ron-0.7 0.9-4.3 1.5ron-2.4 2.4 3.7
run-21.6run
rus 5.2 2.1-1.8-25.7 6.6 3.0-0.6-1.6-17.2-22.1-43.310.8 8.8-0.8-3.9rus 2.9 1.8
slv-5.2 1.6 3.5-41.5 5.7-3.2slv-7.2
spa 6.0 9.7 2.2-0.3-4.2 5.3 1.2-8.650.6 2.1 0.7-17.4-2.112.0-17.925.132.8 4.7-3.223.0 0.6 0.9 7.2-0.6 0.8spa26.3 6.5 0.3 0.6 1.919.0
sqi11.0sqi
srp_Cyrl 3.1srp_Cyrl 3.5
srp_Latn60.8srp_Latn
swa17.7swa
swe 7.511.1 9.5 2.111.5 3.6 2.9-14.3 7.874.6 3.9swe 0.437.4
tat-6.3tat17.4
tgl-11.9tgl
tha 1.8tha
tlh 3.6 1.4tlh
tur34.4 1.824.9-30.410.3 1.5-54.4-0.7-0.3-6.5-15.3 2.2 2.1-44.7 0.1 2.2 3.415.4tur-5.612.3
ukr-1.1 0.3-3.3 1.456.5 3.0 2.0-14.0 4.3-0.8 0.3 6.0-2.1ukr
urd-9.5urd
uzb-28.6-33.1uzb
uzb_Latn41.2uzb_Latn
vie 5.9-11.8 2.5vie20.1
vol 2.3 0.7vol
wuu24.7wuu
yid20.935.428.7 8.1yid
yue_Hans24.7yue_Hans
yue_Hant29.9yue_Hant
zho33.6-0.140.531.110.917.312.514.847.919.8zho
zsm_Latn39.5zsm_Latn
zza 3.1zza

GitHub: [OPUS] [OPUS-MT] [benchmarks] [leaderboards] [dashboard]