CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus

CoVoST is built on Common Voice (2019-06-12 release). It includes speeches in 11 languages (French, German, Dutch, Russian, Spanish, Italian, Turkish, Persian, Swedish, Mongolian and Chinese), their transcripts and English translations. We also provide an additional out-of-domain evaluation set from Tatoeba for 5 languages (French, German, Dutch, Russian and Spanish).

Please also check out our paper for more details.

What's New

• 2020-02-27: Google Colab example added for exploring CoVoST data with VizSeq
• 2020-02-13: Paper accepted to LREC 2020 (Oral)
• 2020-02-07: CoVoST released

Getting Data

CoVoST

1. Download the 2019-06-12 release of Common Voice (NOT the latest 2019-12-10 one from the web page) for speeches and transcripts:

   • French (fr)
   • German (de)
   • Dutch (nl)
   • Russian (ru)
   • Spanish (es)
   • Italian (it)
   • Turkish (tr)
   • Persian (fa)
   • Swedish (sv-SE)
   • Mongolian (mn)
   • Chinese (zh-CN)

2. Download translations for all the 11 languages, where validated.<lang>_en.en are matched with the transcripts in validated.tsv.

Tatoeba Evaluation Data

1. Download transcripts and translations and extract files to data/tt/*.

2. Download speech data:

python get_tt_speech.py --root <mp3 download root (default to data/tt/mp3)>

Exploring Data

Google Colab example

License

Citation

Please cite as

@misc{wang2020covost,
    title={CoVoST: A Diverse Multilingual Speech-To-Text Translation Corpus},
    author={Changhan Wang and Juan Pino and Anne Wu and Jiatao Gu},
    year={2020},
    eprint={2002.01320},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

Contact

Changhan Wang (changhan@fb.com), Juan Miguel Pino (juancarabina@fb.com), Jiatao Gu (jgu@fb.com)