- Description:
Evaluation datasets for low-resource machine translation: Nepali-English and Sinhala-English.
Additional Documentation: Explore on Papers With Code
Source code:
tfds.translate.FloresVersions:
1.2.0(default): No release notes.
Download size:
1.47 MiBAuto-cached (documentation): Yes
Figure (tfds.show_examples): Not supported.
Citation:
@misc{guzmn2019new,
title={Two New Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English},
author={Francisco Guzman and Peng-Jen Chen and Myle Ott and Juan Pino and Guillaume Lample and Philipp Koehn and Vishrav Chaudhary and Marc'Aurelio Ranzato},
year={2019},
eprint={1902.01382},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
flores/neen (default config)
Config description: Translation dataset from ne to en.
Dataset size:
1.89 MiBSplits:
| Split | Examples |
|---|---|
'test' |
2,835 |
'validation' |
2,559 |
- Feature structure:
Translation({
'en': Text(shape=(), dtype=string),
'ne': Text(shape=(), dtype=string),
})
- Feature documentation:
| Feature | Class | Shape | Dtype | Description |
|---|---|---|---|---|
| Translation | ||||
| en | Text | string | ||
| ne | Text | string |
Supervised keys (See
as_superviseddoc):('ne', 'en')Examples (tfds.as_dataframe):
flores/sien
Config description: Translation dataset from si to en.
Dataset size:
2.05 MiBSplits:
| Split | Examples |
|---|---|
'test' |
2,766 |
'validation' |
2,898 |
- Feature structure:
Translation({
'en': Text(shape=(), dtype=string),
'si': Text(shape=(), dtype=string),
})
- Feature documentation:
| Feature | Class | Shape | Dtype | Description |
|---|---|---|---|---|
| Translation | ||||
| en | Text | string | ||
| si | Text | string |
Supervised keys (See
as_superviseddoc):('si', 'en')Examples (tfds.as_dataframe):