Zebra Logic Bench - a allenai Collection

allenai 's Collections

Open Coding Agents Specialization

Open Coding Agents

Molmo2

Bolmo

Olmo 3

SAGE

Olmo 3 Pre-training

Olmo 3 Post-training

MolmoAct Data Mixture

IFBench

OLMo 2

olmOCR

OLMoE (January 2025)

PixMo

Tulu 3 Datasets

Molmo

OLMoE (November 2024)

Tulu V2.5 Suite

Paloma

SciRIFF

AI2 Safety Toolkit

Zebra Logic Bench

OLMo 2 Preview Post-trained Models

ACE

Zebra Logic Bench

updated Dec 23, 2025

ZebraLogic Bench: Testing the Limits of LLMs in Logical Reasoning

Running

91

Zebra Logic Bench

🦓

91

Show leaderboard and explore model puzzle results
allenai/ZebraLogicBench

Viewer • Updated Jul 11, 2024 • 4.26k • 371 • 23

Note 1k puzzles in grid format and 3k in mcqa format. answers are hidden.
allenai/ZebraLogicBench-private

Viewer • Updated Jul 4, 2024 • 4.26k • 187 • 12

Note answers are included here. to prevent data leakage, plz apply for access.
Faith and Fate: Limits of Transformers on Compositionality

Paper • 2305.18654 • Published May 29, 2023 • 8

Note Our NeurIPS 2023 (spotlight) paper about the data and analysis.