This repository collects open source parallel aligned corpuses Catalan to several languages.
We use these corpuses to train the Softcatalà neural translation system:
- English - Catalan
- German - Catalan
- French - Catalan
- Italian - Catalan
- Japanese - Catalan
- Dutch - Catalan
- Portuguese - Catalan
- Spanish - Catalan
- Occitan - Catalan
- Galician - Catalan
Note: files with extension xz need to be descompressed with xz.
We strongly recommend the following sources of aligned Catalan parallel corpuses:
- https://opus.nlpl.eu/
- https://github.com/facebookresearch/LASER/tree/master/tasks/WikiMatrix
- https://www.statmt.org/cc-aligned/
On top of these previously available corpus, we have created the following corpus:
- Europarl-catalan
- Tilde-MODEL-catalan
- Open source corpus in serval directions using Softcatalà translation tools
See here (In Catalan)
Contact Jordi Mas [email protected]
The following table is necessary for this dataset to be indexed by search engines such as Google Dataset Search.
| property | value |
|---|---|
| name | Open source aligned text corpus English, German, Spanish, etc to/from Catalan. |
| description | Open source aligned text corpus for building NLP applications (e.g. machine translation). Already existing corpus have been clean up and new corpus have been introduced: Europarl Catalan, Tilde Catalan and open source translation memories. |
| sameAs | https://github.com/Softcatala/parallel-catalan-corpus/ |
| url | https://github.com/Softcatala/parallel-catalan-corpus/ |
| creator | Softcatalà |