- Description:
Evaluation datasets for low-resource machine translation: Nepali-English and Sinhala-English.
Additional Documentation: Explore on Papers With Code
Source code:
tfds.translate.Flores
Versions:
1.2.0
(default): No release notes.
Download size:
1.47 MiB
Auto-cached (documentation): Yes
Figure (tfds.show_examples): Not supported.
Citation:
@misc{guzmn2019new,
title={Two New Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English},
author={Francisco Guzman and Peng-Jen Chen and Myle Ott and Juan Pino and Guillaume Lample and Philipp Koehn and Vishrav Chaudhary and Marc'Aurelio Ranzato},
year={2019},
eprint={1902.01382},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
flores/neen (default config)
Config description: Translation dataset from ne to en.
Dataset size:
1.89 MiB
Splits:
Split | Examples |
---|---|
'test' |
2,835 |
'validation' |
2,559 |
- Feature structure:
Translation({
'en': Text(shape=(), dtype=string),
'ne': Text(shape=(), dtype=string),
})
- Feature documentation:
Feature | Class | Shape | Dtype | Description |
---|---|---|---|---|
Translation | ||||
en | Text | string | ||
ne | Text | string |
Supervised keys (See
as_supervised
doc):('ne', 'en')
Examples (tfds.as_dataframe):
flores/sien
Config description: Translation dataset from si to en.
Dataset size:
2.05 MiB
Splits:
Split | Examples |
---|---|
'test' |
2,766 |
'validation' |
2,898 |
- Feature structure:
Translation({
'en': Text(shape=(), dtype=string),
'si': Text(shape=(), dtype=string),
})
- Feature documentation:
Feature | Class | Shape | Dtype | Description |
---|---|---|---|---|
Translation | ||||
en | Text | string | ||
si | Text | string |
Supervised keys (See
as_supervised
doc):('si', 'en')
Examples (tfds.as_dataframe):