Benchmarking Temporal Reasoning and Alignment Across Chinese Dynasties
Temporal reasoning is fundamental to human cognition and is crucial for
various real-world applications. While recent advances in Large Language Models
have demonstrated promising capabilities in temporal reasoning, existing
benchmarks primarily rely on rule-based construction, lack contextual depth,
and involve a limited range of temporal entities. To address these limitations,
we introduce Chinese Time Reasoning (CTM), a benchmark designed to evaluate
LLMs on temporal reasoning within the extensive scope of Chinese dynastic
chronology. CTM emphasizes cross-entity relationships, pairwise temporal
alignment, and contextualized and culturally-grounded reasoning, providing a
comprehensive evaluation. Extensive experimental results reveal the challenges
posed by CTM and highlight potential avenues for improvement.
67bd3d6b60186d7478467208
Zhenglin Wang
claimed_verified
2025-02-25T09:39:15.633Z
6643261b8876db14227eeb19
/avatars/67428c9e37a2273697c0547e1783ec6b.svg
Zhenglin Wang
user
wzl0228
67bd3d6b60186d7478467209
Jialong Wu
claimed_verified
2025-02-25T15:06:02.856Z
644a4fbc2166258fccc664bc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/8k3b44MbhQiWuo6i8BnYl.jpeg
Jialong Wu
user
callanwu
67bd3d6b60186d747846720a
Pengfei LI
67bd3d6b60186d747846720b
Yong Jiang
admin_assigned
2025-02-25T16:29:23.380Z
678ddd806aa55e76bfffb953
/avatars/f447936c286a6a2d2874a760210b2f17.svg
Yong Jiang
user
yongjiangNLP
67bd3d6b60186d747846720c
Deyu Zhou
admin_assigned
2025-02-25T16:29:35.320Z
64e821f2bddc5b1072b15c2e
/avatars/618b5a48f2fa62daff4e1922a9aa9e8b.svg
zhoudeyu
user
zhoudeyu
Benchmarking Temporal Reasoning and Alignment Across Chinese Dynasties
Temporal reasoning is fundamental to human cognition and is crucial for
various real-world applications. While recent advances in Large Language Models
have demonstrated promising capabilities in temporal reasoning, existing
benchmarks primarily rely on rule-based construction, lack contextual depth,
and involve a limited range of temporal entities. To address these limitations,
we introduce Chinese Time Reasoning (CTM), a benchmark designed to evaluate
LLMs on temporal reasoning within the extensive scope of Chinese dynastic
chronology. CTM emphasizes cross-entity relationships, pairwise temporal
alignment, and contextualized and culturally-grounded reasoning, providing a
comprehensive evaluation. Extensive experimental results reveal the challenges
posed by CTM and highlight potential avenues for improvement.
Temporal reasoning Large Language Models rule-based construction contextual depth temporal entities Chinese Time Reasoning (CTM) cross-entity relationships pairwise temporal alignment contextualized and culturally-grounded reasoning