GEM benchmark

https://gem-benchmark.com

Activity Feed Request to join this org

AI & ML interests

We develop infrastructure for the evaluation of generated text.

GEM 's datasets 44

GEM/xlsum

Updated Oct 3, 2024 • 1.56k • 5

GEM/wiki_auto_asset_turk

Viewer • Updated May 29, 2024 • 510k • 513 • 8

GEM/gem

Updated Jan 18, 2024 • 5.84k • 33

GEM/opusparcus

Updated Jan 9, 2024 • 325 • 2

GEM/Augmented_CACAPO_for_E2E

Viewer • Updated Feb 26, 2023 • 47.3k • 39

GEM/CACAPO_E2E

Viewer • Updated Feb 26, 2023 • 20.1k • 44

GEM/Elongated_CACAPO_for_E2E

Updated Feb 26, 2023 • 30

GEM/xwikis

Updated Feb 22, 2023 • 1.01k • 4

GEM/wiki_lingua

Updated Feb 16, 2023 • 9.82k • 50

GEM/xmediasum

Viewer • Updated Feb 15, 2023 • 40k • 23 • 4

GEM/TaTA

Viewer • Updated Nov 3, 2022 • 8.69k • 30 • 1

GEM/FairytaleQA

Viewer • Updated Oct 25, 2022 • 10.6k • 203 • 9

GEM/squality

Updated Oct 25, 2022 • 35 • 2

GEM/xsum

Updated Oct 24, 2022 • 176 • 2

GEM/wiki_cat_sum

Viewer • Updated Oct 24, 2022 • 187k • 1.56k • 4

GEM/web_nlg

Viewer • Updated Oct 24, 2022 • 58.9k • 557 • 2

GEM/viggo

Viewer • Updated Oct 24, 2022 • 8.84k • 661 • 35

GEM/turku_hockey_data2text

Updated Oct 24, 2022 • 207

GEM/totto

Viewer • Updated Oct 24, 2022 • 138k • 512 • 2

GEM/surface_realisation_st_2020

Viewer • Updated Oct 24, 2022 • 351k • 742 • 1

GEM/squad_v2

Viewer • Updated Oct 24, 2022 • 142k • 204 • 3

GEM/sportsett_basketball

Viewer • Updated Oct 24, 2022 • 6.15k • 178 • 12

GEM/schema_guided_dialog

Viewer • Updated Oct 24, 2022 • 188k • 370 • 8

GEM/mlsum

Viewer • Updated Oct 24, 2022 • 535k • 98 • 2

GEM/mlb_data_to_text

Viewer • Updated Oct 24, 2022 • 26.2k • 79 • 3

GEM/e2e_nlg

Viewer • Updated Oct 24, 2022 • 38.4k • 281 • 1

GEM/dstc10_track2_task2

Updated Oct 24, 2022 • 30 • 4

GEM/dart

Viewer • Updated Oct 24, 2022 • 70.5k • 155

GEM/cs_restaurants

Viewer • Updated Oct 24, 2022 • 6.69k • 52 • 1

GEM/conversational_weather

Updated Oct 24, 2022 • 397 • 5