Automatic Differential Diagnosis using Transformer-Based Multi-Label
  Sequence Classification
As the field of artificial intelligence progresses, assistive technologies
are becoming more widely used across all industries. The healthcare industry is
no different, with numerous studies being done to develop assistive tools for
healthcare professionals. Automatic diagnostic systems are one such beneficial
tool that can assist with a variety of tasks, including collecting patient
information, analyzing test results, and diagnosing patients. However, the idea
of developing systems that can provide a differential diagnosis has been
largely overlooked in most of these research studies. In this study, we propose
a transformer-based approach for providing differential diagnoses based on a
patient's age, sex, medical history, and symptoms. We use the DDXPlus dataset,
which provides differential diagnosis information for patients based on 49
disease types. Firstly, we propose a method to process the tabular patient data
from the dataset and engineer them into patient reports to make them suitable
for our research. In addition, we introduce two data modification modules to
diversify the training data and consequently improve the robustness of the
models. We approach the task as a multi-label classification problem and
conduct extensive experiments using four transformer models. All the models
displayed promising results by achieving over 97% F1 score on the held-out test
set. Moreover, we design additional behavioral tests to get a broader
understanding of the models. In particular, for one of our test cases, we
prepared a custom test set of 100 samples with the assistance of a doctor. The
results on the custom set showed that our proposed data modification modules
improved the model's generalization capabilities. We hope our findings will
provide future researchers with valuable insights and inspire them to develop
reliable systems for automatic differential diagnosis.
66d03fe85685fc01abd65168
Abu Adnan Sadi
admin_assigned
2024-09-02T09:23:02.086Z
62ffac65311cad266f9b34f9
/avatars/efacfa91f067acb20e372d9207448bcb.svg
Abu Adnan Sadi
user
AdnanSadi
66d03fe85685fc01abd65169
Mohammad Ashrafuzzaman Khan
claimed_verified
2024-09-04T07:25:27.415Z
62fd0a8403f86646220655b8
/avatars/392731415f3772946c22f13ceee6ef47.svg
Mohammad Ashrafuzzaman Khan
user
m-ak
66d03fe85685fc01abd6516a
Lubaba Binte Saber
claimed_verified
2024-09-03T07:48:37.634Z
66d6103604841918b64e22d0
/avatars/e917765f6c024743b68907f940a3ffcf.svg
Lubaba Binte Saber 
user
Lubaba26
Automatic Differential Diagnosis using Transformer-Based Multi-Label
  Sequence Classification
As the field of artificial intelligence progresses, assistive technologies
are becoming more widely used across all industries. The healthcare industry is
no different, with numerous studies being done to develop assistive tools for
healthcare professionals. Automatic diagnostic systems are one such beneficial
tool that can assist with a variety of tasks, including collecting patient
information, analyzing test results, and diagnosing patients. However, the idea
of developing systems that can provide a differential diagnosis has been
largely overlooked in most of these research studies. In this study, we propose
a transformer-based approach for providing differential diagnoses based on a
patient's age, sex, medical history, and symptoms. We use the DDXPlus dataset,
which provides differential diagnosis information for patients based on 49
disease types. Firstly, we propose a method to process the tabular patient data
from the dataset and engineer them into patient reports to make them suitable
for our research. In addition, we introduce two data modification modules to
diversify the training data and consequently improve the robustness of the
models. We approach the task as a multi-label classification problem and
conduct extensive experiments using four transformer models. All the models
displayed promising results by achieving over 97% F1 score on the held-out test
set. Moreover, we design additional behavioral tests to get a broader
understanding of the models. In particular, for one of our test cases, we
prepared a custom test set of 100 samples with the assistance of a doctor. The
results on the custom set showed that our proposed data modification modules
improved the model's generalization capabilities. We hope our findings will
provide future researchers with valuable insights and inspire them to develop
reliable systems for automatic differential diagnosis.
A transformer-based system for differential diagnosis in healthcare achieves high accuracy through data processing, diversification, and multi-label classification.
transformer-based approach differential diagnoses DDXPlus dataset patient reports data modification modules multi-label classification F1 score