piqa

• Description:

Physical IQa: Physical Interaction QA, a new commonsense QA benchmark for naive physics reasoning focusing on how we interact with everyday objects in everyday situations. This dataset focuses on affordances of objects, i.e., what actions each physical object affords (e.g., it is possible to use a shoe as a doorstop), and what physical interactions a group of objects afford (e.g., it is possible to place an apple on top of a book, but not the other way around). The dataset requires reasoning about both the prototypical use of objects (e.g., shoes are used for walking) and non-prototypical but practically plausible use of objects (e.g., shoes can be used as a doorstop). The dataset includes 20,000 QA pairs that are either multiple-choice or true/false questions.

• Additional Documentation: Explore on Papers With Code north_east

• Homepage: https://leaderboard.allenai.org/physicaliqa/submissions/get-started

• Source code: tfds.datasets.piqa.Builder

• Versions:

  • 1.0.0 (default): No release notes.

• Download size: 1.74 MiB

• Dataset size: 5.92 MiB

• Auto-cached (documentation): Yes

• Splits:

• Feature structure:

FeaturesDict({
    'goal': Text(shape=(), dtype=string),
    'id': Text(shape=(), dtype=string),
    'label': ClassLabel(shape=(), dtype=int64, num_classes=2),
    'sol1': Text(shape=(), dtype=string),
    'sol2': Text(shape=(), dtype=string),
})

• Feature documentation:

• Supervised keys (See as_supervised doc): None

• Figure (tfds.show_examples): Not supported.

• Examples (tfds.as_dataframe):

• Citation:

@inproceedings{Bisk2020,
  author = {Yonatan Bisk and Rowan Zellers and
            Ronan Le Bras and Jianfeng Gao
            and Yejin Choi},
  title = {PIQA: Reasoning about Physical Commonsense in
           Natural Language},
  booktitle = {Thirty-Fourth AAAI Conference on
               Artificial Intelligence},
  year = {2020},
}