GPT Can Solve Mathematical Problems Without a Calculator
Previous studies have typically assumed that large language models are unable
to accurately perform arithmetic operations, particularly multiplication of >8
digits, and operations involving decimals and fractions, without the use of
calculator tools. This paper aims to challenge this misconception. With
sufficient training data, a 2 billion-parameter language model can accurately
perform multi-digit arithmetic operations with almost 100% accuracy without
data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication
accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from
GLM-10B on a dataset with additional multi-step arithmetic operations and math
problems described in text, achieves similar performance to GPT-4 on a
5,000-samples Chinese math problem test set.
64fa724fbb362cbf2fd19bd9
Zhen Yang
64fa724fbb362cbf2fd19bda
Ming Ding
64fa724fbb362cbf2fd19bdb
Qingsong Lv
admin_assigned
2023-09-08T11:33:38.507Z
61bd8ac694bd578f7286181b
/avatars/ff14b64339217858927ae01c2b2fa28d.svg
Qingsong Lv
user
qingsonglv
64fa724fbb362cbf2fd19bdc
Zhihuan Jiang
64fa724fbb362cbf2fd19bdd
Zehai He
claimed_verified
2025-07-02T08:32:59.598Z
64f5c2f19eaf9d8fb74d2b47
/avatars/2623c5fc9bff757f20b66f7626065d52.svg
Zehai He
user
he-zh22
64fa724fbb362cbf2fd19bde
Yuyi Guo
64fa724fbb362cbf2fd19bdf
Jinfeng Bai
64fa724fbb362cbf2fd19be0
Jie Tang
admin_assigned
2023-09-08T11:34:59.355Z
640dff05474aa6f89556677e
/avatars/1b4591c7322d649c797b3125148f1915.svg
Jie Tang
user
jerytang
GPT Can Solve Mathematical Problems Without a Calculator
Previous studies have typically assumed that large language models are unable
to accurately perform arithmetic operations, particularly multiplication of >8
digits, and operations involving decimals and fractions, without the use of
calculator tools. This paper aims to challenge this misconception. With
sufficient training data, a 2 billion-parameter language model can accurately
perform multi-digit arithmetic operations with almost 100% accuracy without
data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication
accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from
GLM-10B on a dataset with additional multi-step arithmetic operations and math
problems described in text, achieves similar performance to GPT-4 on a
5,000-samples Chinese math problem test set.
A large language model with sufficient training data can accurately perform complex arithmetic operations without calculator tools, outperforming GPT-4.
large language models arithmetic operations multiplication decimals fractions training data 2 billion-parameter language model multi-digit arithmetic data leakage GPT-4 MathGLM GLM-10B multi-step arithmetic operations Chinese math problem test set