Rambler: Supporting Writing With Speech via LLM-Assisted Gist
  Manipulation
Dictation enables efficient text input on mobile devices. However, writing
with speech can produce disfluent, wordy, and incoherent text and thus requires
heavy post-processing. This paper presents Rambler, an LLM-powered graphical
user interface that supports gist-level manipulation of dictated text with two
main sets of functions: gist extraction and macro revision. Gist extraction
generates keywords and summaries as anchors to support the review and
interaction with spoken text. LLM-assisted macro revisions allow users to
respeak, split, merge and transform dictated text without specifying precise
editing locations. Together they pave the way for interactive dictation and
revision that help close gaps between spontaneous spoken words and
well-structured writing. In a comparative study with 12 participants performing
verbal composition tasks, Rambler outperformed the baseline of a speech-to-text
editor + ChatGPT, as it better facilitates iterative revisions with enhanced
user control over the content while supporting surprisingly diverse user
strategies.
65adf42114e6582c300d13f1
Susan Lin
65adf42114e6582c300d13f2
Jeremy Warner
claimed_verified
2024-01-22T21:11:16.695Z
64067f4fa577649430c4472b
/avatars/187e9dd452879591112ee1989c15c28e.svg
Jeremy Warner
user
jeremywrnr
65adf42114e6582c300d13f3
J. D. Zamfirescu-Pereira
admin_assigned
2024-01-22T13:04:38.941Z
61a5ad000a91f17a58e16da2
/avatars/d8abe61c4541b2828307f1bbdd7941c9.svg
J.D. Zamfirescu-Pereira
user
zamfi
65adf42114e6582c300d13f4
Matthew G. Lee
claimed_verified
2024-01-22T21:11:18.805Z
65062b09ada48d4be2490d39
/avatars/8c10ab8dc200e53c1ed38916018154c3.svg
Matthew Lee
user
matthewlee626
65adf42114e6582c300d13f5
Sauhard Jain
claimed_verified
2024-01-23T08:09:37.314Z
65aec574dabf5a8a583ecdb2
/avatars/6f19bf13c56a8a3d40d3e69217e8dc7b.svg
Sauhard Jain
user
sauhardjain
65adf42114e6582c300d13f6
Michael Xuelin Huang
65adf42114e6582c300d13f7
Piyawat Lertvittayakumjorn
65adf42114e6582c300d13f8
Shanqing Cai
admin_assigned
2024-01-22T13:00:17.625Z
63a5dfba28af3c9aa20703d7
/avatars/a47f248d01775a3ebf5819dd9367a761.svg
Shanqing Cai
user
sqcai
65adf42114e6582c300d13f9
Shumin Zhai
65adf42114e6582c300d13fa
Björn Hartmann
65adf42114e6582c300d13fb
Can Liu
claimed_verified
2024-01-23T08:09:34.966Z
65af283d22762a684ea75809
/avatars/f6f754106f27d26649bd41ca60237ee3.svg
Can Liu
user
canlhci
Rambler: Supporting Writing With Speech via LLM-Assisted Gist
  Manipulation
Dictation enables efficient text input on mobile devices. However, writing
with speech can produce disfluent, wordy, and incoherent text and thus requires
heavy post-processing. This paper presents Rambler, an LLM-powered graphical
user interface that supports gist-level manipulation of dictated text with two
main sets of functions: gist extraction and macro revision. Gist extraction
generates keywords and summaries as anchors to support the review and
interaction with spoken text. LLM-assisted macro revisions allow users to
respeak, split, merge and transform dictated text without specifying precise
editing locations. Together they pave the way for interactive dictation and
revision that help close gaps between spontaneous spoken words and
well-structured writing. In a comparative study with 12 participants performing
verbal composition tasks, Rambler outperformed the baseline of a speech-to-text
editor + ChatGPT, as it better facilitates iterative revisions with enhanced
user control over the content while supporting surprisingly diverse user
strategies.
Rambler, an LLM-powered GUI, simplifies dictation post-processing by enabling gist-level text manipulation and macro revisions, outperforming traditional tools in facilitating user-controlled iterative composition.
LLM-powered graphical user interface gist extraction macro revision LLM-assisted macro revisions speech-to-text editor iterative revisions user control