Exploring Large Language Models' Cognitive Moral Development through
  Defining Issues Test
The development of large language models has instilled widespread interest
among the researchers to understand their inherent reasoning and
problem-solving capabilities. Despite good amount of research going on to
elucidate these capabilities, there is a still an appreciable gap in
understanding moral development and judgments of these models. The current
approaches of evaluating the ethical reasoning abilities of these models as a
classification task pose numerous inaccuracies because of over-simplification.
In this study, we built a psychological connection by bridging two disparate
fields-human psychology and AI. We proposed an effective evaluation framework
which can help to delineate the model's ethical reasoning ability in terms of
moral consistency and Kohlberg's moral development stages with the help of
Psychometric Assessment Tool-Defining Issues Test.
651274d01e3b49ac794ab421
Kumar Tanmay
admin_assigned
2023-09-26T13:46:40.526Z
64d13e4d1ed6649d70bb81c2
/avatars/b00626358f883bb06b8e458530bcd873.svg
Kumar Tanmay
user
krtanmay147
651274d01e3b49ac794ab422
Aditi Khandelwal
claimed_verified
2023-09-26T14:25:21.269Z
6512e852a76fd5945b19e9a1
/avatars/751526fbc0c939a972bea684937a34bf.svg
Aditi Khandelwal
user
aditi184
651274d01e3b49ac794ab423
Utkarsh Agarwal
claimed_verified
2023-09-26T14:02:54.367Z
6512e3e542a541c175220416
/avatars/0df68a43ca072b0eb9726337849dff5e.svg
Utkarsh Agarwal
user
utkarshagarwal
651274d01e3b49ac794ab424
Monojit Choudhury
claimed_verified
2023-09-26T18:51:29.350Z
65130e31330c55fdc52e8174
/avatars/39269a0f5298c985d3db62948a527ada.svg
MONOJIT CHOUDHURY
user
monojit
Exploring Large Language Models' Cognitive Moral Development through
  Defining Issues Test
The development of large language models has instilled widespread interest
among the researchers to understand their inherent reasoning and
problem-solving capabilities. Despite good amount of research going on to
elucidate these capabilities, there is a still an appreciable gap in
understanding moral development and judgments of these models. The current
approaches of evaluating the ethical reasoning abilities of these models as a
classification task pose numerous inaccuracies because of over-simplification.
In this study, we built a psychological connection by bridging two disparate
fields-human psychology and AI. We proposed an effective evaluation framework
which can help to delineate the model's ethical reasoning ability in terms of
moral consistency and Kohlberg's moral development stages with the help of
Psychometric Assessment Tool-Defining Issues Test.
A new evaluation framework connects human psychology and AI to assess the moral reasoning and development stages of large language models using a Psychometric Assessment Tool.
large language models ethical reasoning moral development Kohlberg's moral development stages Psychometric Assessment Tool-Defining Issues Test