SkillAgentSearch skills...

Duorc

A Large-Scale Dataset for Paraphrased Reading Comprehension

Install / Use

/learn @duorc/Duorc
About this skill

Quality Score

0/100

Supported Platforms

Universal

README

DuoRC

DuoRC contains 186,089 unique question-answer pairs created from a collection of 7680 pairs of movie plots where each pair in the collection reflects two versions of the same movie.

Evaluation

For evaluation, the answers should be stored in a JSON file with the following format:

{
    'id1': 'answer1',
    'id2': 'NA',
    ...
}

Note: NA is the expected string for no answer

Next, use the provided evaluation script to calculate the exact match and F1 scores:

python evaluate.py <test-file-path>.json <answer-file-path>.json

See https://duorc.github.io/ for more details

Related Skills

View on GitHub
GitHub Stars15
CategoryEducation
Updated1y ago
Forks2

Languages

Python

Security Score

80/100

Audited on Nov 12, 2024

No findings