The Imperative of Conversation Analysis in the Era of LLMs: A Survey of
  Tasks, Techniques, and Trends
In the era of large language models (LLMs), a vast amount of conversation
logs will be accumulated thanks to the rapid development trend of language UI.
Conversation Analysis (CA) strives to uncover and analyze critical information
from conversation data, streamlining manual processes and supporting business
insights and decision-making. The need for CA to extract actionable insights
and drive empowerment is becoming increasingly prominent and attracting
widespread attention. However, the lack of a clear scope for CA leads to a
dispersion of various techniques, making it difficult to form a systematic
technical synergy to empower business applications. In this paper, we perform a
thorough review and systematize CA task to summarize the existing related work.
Specifically, we formally define CA task to confront the fragmented and chaotic
landscape in this field, and derive four key steps of CA from conversation
scene reconstruction, to in-depth attribution analysis, and then to performing
targeted training, finally generating conversations based on the targeted
training for achieving the specific goals. In addition, we showcase the
relevant benchmarks, discuss potential challenges and point out future
directions in both industry and academia. In view of current advancements, it
is evident that the majority of efforts are still concentrated on the analysis
of shallow conversation elements, which presents a considerable gap between the
research and business, and with the assist of LLMs, recent work has shown a
trend towards research on causality and strategic tasks which are sophisticated
and high-level. The analyzed experiences and insights will inevitably have
broader application value in business operations that target conversation logs.
66f6a945cd978208b9e30aee
Xinghua Zhang
66f6a945cd978208b9e30aef
Haiyang Yu
claimed_verified
2024-09-30T08:07:00.648Z
64a4ceda9a90f701134189b7
/avatars/859a189c5d2ae2fcb9aa2d79104fbfe7.svg
Haiyang Yu
user
yhycai
66f6a945cd978208b9e30af0
Yongbin Li
claimed_verified
2024-10-14T10:47:49.935Z
66641b2fd8e1e34bc621e688
https://cdn-avatars.huggingface.co/v1/production/uploads/66641b2fd8e1e34bc621e688/csPETwnx2zCIHSWi9uAi-.png
Yongbin Li
user
Yongbin-Li
66f6a945cd978208b9e30af1
Minzheng Wang
claimed_verified
2024-10-08T08:17:34.920Z
64bcc373ef8c0e42bf16acc5
/avatars/873308203d28115ae1a9e4d0e26508f4.svg
mz.w
user
iiiiwis
66f6a945cd978208b9e30af2
Longze Chen
66f6a945cd978208b9e30af3
Fei Huang
The Imperative of Conversation Analysis in the Era of LLMs: A Survey of
  Tasks, Techniques, and Trends
In the era of large language models (LLMs), a vast amount of conversation
logs will be accumulated thanks to the rapid development trend of language UI.
Conversation Analysis (CA) strives to uncover and analyze critical information
from conversation data, streamlining manual processes and supporting business
insights and decision-making. The need for CA to extract actionable insights
and drive empowerment is becoming increasingly prominent and attracting
widespread attention. However, the lack of a clear scope for CA leads to a
dispersion of various techniques, making it difficult to form a systematic
technical synergy to empower business applications. In this paper, we perform a
thorough review and systematize CA task to summarize the existing related work.
Specifically, we formally define CA task to confront the fragmented and chaotic
landscape in this field, and derive four key steps of CA from conversation
scene reconstruction, to in-depth attribution analysis, and then to performing
targeted training, finally generating conversations based on the targeted
training for achieving the specific goals. In addition, we showcase the
relevant benchmarks, discuss potential challenges and point out future
directions in both industry and academia. In view of current advancements, it
is evident that the majority of efforts are still concentrated on the analysis
of shallow conversation elements, which presents a considerable gap between the
research and business, and with the assist of LLMs, recent work has shown a
trend towards research on causality and strategic tasks which are sophisticated
and high-level. The analyzed experiences and insights will inevitably have
broader application value in business operations that target conversation logs.
Conversation Analysis task is systematized into four key steps, leveraging large language models to bridge the gap between research and business by focusing on causality and strategic tasks.
large language models Conversation Analysis conversation scene reconstruction in-depth attribution analysis targeted training causality strategic tasks