ted_hrlr_translate

• Description:

Data sets derived from TED talk transcripts for comparing similar language pairs where one is high resource and the other is low resource.

• Homepage: https://github.com/neulab/word-embeddings-for-nmt

• Source code: tfds.datasets.ted_hrlr_translate.Builder

• Versions:

  • 1.0.0 (default): New split API (https://tensorflow.org/datasets/splits)

• Download size: 124.94 MiB

• Auto-cached (documentation): Yes

• Figure (tfds.show_examples): Not supported.

• Citation:

@inproceedings{Ye2018WordEmbeddings,
  author  = {Ye, Qi and Devendra, Sachan and Matthieu, Felix and Sarguna, Padmanabhan and Graham, Neubig},
  title   = {When and Why are pre-trained word embeddings useful for Neural Machine Translation},
  booktitle = {HLT-NAACL},
  year    = {2018},
  }

ted_hrlr_translate/az_to_en (default config)

• Config description: Translation dataset from az to en in plain text.

• Dataset size: 1.61 MiB

• Splits:

• Feature structure:

Translation({
    'az': Text(shape=(), dtype=string),
    'en': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('az', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/aztr_to_en

• Config description: Translation dataset from az_tr to en in plain text.

• Dataset size: 42.54 MiB

• Splits:

• Feature structure:

Translation({
    'az_tr': Text(shape=(), dtype=string),
    'en': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('az_tr', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/be_to_en

• Config description: Translation dataset from be to en in plain text.

• Dataset size: 1.47 MiB

• Splits:

• Feature structure:

Translation({
    'be': Text(shape=(), dtype=string),
    'en': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('be', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/beru_to_en

• Config description: Translation dataset from be_ru to en in plain text.

• Dataset size: 62.45 MiB

• Splits:

• Feature structure:

Translation({
    'be_ru': Text(shape=(), dtype=string),
    'en': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('be_ru', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/es_to_pt

• Config description: Translation dataset from es to pt in plain text.

• Dataset size: 9.62 MiB

• Splits:

• Feature structure:

Translation({
    'es': Text(shape=(), dtype=string),
    'pt': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('es', 'pt')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/fr_to_pt

• Config description: Translation dataset from fr to pt in plain text.

• Dataset size: 9.74 MiB

• Splits:

• Feature structure:

Translation({
    'fr': Text(shape=(), dtype=string),
    'pt': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('fr', 'pt')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/gl_to_en

• Config description: Translation dataset from gl to en in plain text.

• Dataset size: 2.41 MiB

• Splits:

• Feature structure:

Translation({
    'en': Text(shape=(), dtype=string),
    'gl': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('gl', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/glpt_to_en

• Config description: Translation dataset from gl_pt to en in plain text.

• Dataset size: 12.90 MiB

• Splits:

• Feature structure:

Translation({
    'en': Text(shape=(), dtype=string),
    'gl_pt': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('gl_pt', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/he_to_pt

• Config description: Translation dataset from he to pt in plain text.

• Dataset size: 11.71 MiB

• Splits:

• Feature structure:

Translation({
    'he': Text(shape=(), dtype=string),
    'pt': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('he', 'pt')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/it_to_pt

• Config description: Translation dataset from it to pt in plain text.

• Dataset size: 9.94 MiB

• Splits:

• Feature structure:

Translation({
    'it': Text(shape=(), dtype=string),
    'pt': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('it', 'pt')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/pt_to_en

• Config description: Translation dataset from pt to en in plain text.

• Dataset size: 10.89 MiB

• Splits:

• Feature structure:

Translation({
    'en': Text(shape=(), dtype=string),
    'pt': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('pt', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/ru_to_en

• Config description: Translation dataset from ru to en in plain text.

• Dataset size: 63.22 MiB

• Splits:

• Feature structure:

Translation({
    'en': Text(shape=(), dtype=string),
    'ru': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('ru', 'en')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/ru_to_pt

• Config description: Translation dataset from ru to pt in plain text.

• Dataset size: 13.00 MiB

• Splits:

• Feature structure:

Translation({
    'pt': Text(shape=(), dtype=string),
    'ru': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('ru', 'pt')

• Examples (tfds.as_dataframe):

ted_hrlr_translate/tr_to_en

• Config description: Translation dataset from tr to en in plain text.

• Dataset size: 42.33 MiB

• Splits:

• Feature structure:

Translation({
    'en': Text(shape=(), dtype=string),
    'tr': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): ('tr', 'en')

• Examples (tfds.as_dataframe):