SoTaNa: The Open-Source Software Development Assistant
Software development plays a crucial role in driving innovation and
efficiency across modern societies. To meet the demands of this dynamic field,
there is a growing need for an effective software development assistant.
However, existing large language models represented by ChatGPT suffer from
limited accessibility, including training data and model weights. Although
other large open-source models like LLaMA have shown promise, they still
struggle with understanding human intent. In this paper, we present SoTaNa, an
open-source software development assistant. SoTaNa utilizes ChatGPT to generate
high-quality instruction-based data for the domain of software engineering and
employs a parameter-efficient fine-tuning approach to enhance the open-source
foundation model, LLaMA. We evaluate the effectiveness of  in answering
Stack Overflow questions and demonstrate its capabilities. Additionally, we
discuss its capabilities in code summarization and generation, as well as the
impact of varying the volume of generated data on model performance. Notably,
SoTaNa can run on a single GPU, making it accessible to a broader range of
researchers. Our code, model weights, and data are public at
https://github.com/DeepSoftwareAnalytics/SoTaNa.
64ec46d5171e6c9862e3125a
Ensheng Shi
admin_assigned
2023-08-28T07:22:03.089Z
622573983b9427436c09fe26
https://cdn-avatars.huggingface.co/v1/production/uploads/1646653372528-622573983b9427436c09fe26.jpeg
Ensheng Shi
user
Ensheng
64ec46d5171e6c9862e3125b
Fengji Zhang
admin_assigned
2023-08-28T07:22:31.806Z
64c8d4ac120a85440bfad55d
/avatars/d65334288d69700250de51d0df344d9b.svg
Fengji Zhang
user
zfj1998
64ec46d5171e6c9862e3125c
Yanlin Wang
64ec46d5171e6c9862e3125d
Bei Chen
claimed_verified
2024-01-23T13:49:33.830Z
64cc65d786d8dc0caa6ab3cd
/avatars/23dc126f7332825e713807fb1c000ab6.svg
Bei Chen
user
BellaBei
64ec46d5171e6c9862e3125e
Lun Du
64ec46d5171e6c9862e3125f
Hongyu Zhang
64ec46d5171e6c9862e31260
Shi Han
64ec46d5171e6c9862e31261
Dongmei Zhang
64ec46d5171e6c9862e31262
Hongbin Sun
SoTaNa: The Open-Source Software Development Assistant
Software development plays a crucial role in driving innovation and
efficiency across modern societies. To meet the demands of this dynamic field,
there is a growing need for an effective software development assistant.
However, existing large language models represented by ChatGPT suffer from
limited accessibility, including training data and model weights. Although
other large open-source models like LLaMA have shown promise, they still
struggle with understanding human intent. In this paper, we present SoTaNa, an
open-source software development assistant. SoTaNa utilizes ChatGPT to generate
high-quality instruction-based data for the domain of software engineering and
employs a parameter-efficient fine-tuning approach to enhance the open-source
foundation model, LLaMA. We evaluate the effectiveness of  in answering
Stack Overflow questions and demonstrate its capabilities. Additionally, we
discuss its capabilities in code summarization and generation, as well as the
impact of varying the volume of generated data on model performance. Notably,
SoTaNa can run on a single GPU, making it accessible to a broader range of
researchers. Our code, model weights, and data are public at
https://github.com/DeepSoftwareAnalytics/SoTaNa.
SoTaNa utilizes ChatGPT-generated data and parameter-efficient fine-tuning to enhance LLaMA, providing an accessible open-source software development assistant capable of answering Stack Overflow questions, code summarization, and generation.
large language models ChatGPT training data model weights LLaMA parameter-efficient fine-tuning software development assistant Stack Overflow code summarization code generation