LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video
  Editing
Video creation has become increasingly popular, yet the expertise and effort
required for editing often pose barriers to beginners. In this paper, we
explore the integration of large language models (LLMs) into the video editing
workflow to reduce these barriers. Our design vision is embodied in LAVE, a
novel system that provides LLM-powered agent assistance and language-augmented
editing features. LAVE automatically generates language descriptions for the
user's footage, serving as the foundation for enabling the LLM to process
videos and assist in editing tasks. When the user provides editing objectives,
the agent plans and executes relevant actions to fulfill them. Moreover, LAVE
allows users to edit videos through either the agent or direct UI manipulation,
providing flexibility and enabling manual refinement of agent actions. Our user
study, which included eight participants ranging from novices to proficient
editors, demonstrated LAVE's effectiveness. The results also shed light on user
perceptions of the proposed LLM-assisted editing paradigm and its impact on
users' creativity and sense of co-creation. Based on these findings, we propose
design implications to inform the future development of agent-assisted content
editing.
65d2d78ff5a15aa421fd7339
Bryan Wang
admin_assigned
2024-02-19T15:46:50.083Z
6215a70a6f827861d125fe2e
/avatars/c84b243e02ca2b71af079c8220c5fe44.svg
Bryan Wang
user
bw0514
65d2d78ff5a15aa421fd733a
Yuliang Li
extracted_confirmed
2025-04-08T18:57:21.275Z
67f450824a1509c573f476a3
/avatars/e4f78097ef5fdfc95e220bf3168402e3.svg
Yuliang Li
user
yuliangli-meta
65d2d78ff5a15aa421fd733b
Zhaoyang Lv
extracted_pending
2024-02-19T04:22:41.112Z
64a5b3ba84f954be0b716ac8
/avatars/f7a1df6229d3c127c609b1f1d5fa9a90.svg
Zhaoyang Lv
user
zhaoyang-lv-meta
65d2d78ff5a15aa421fd733c
Haijun Xia
65d2d78ff5a15aa421fd733d
Yan Xu
65d2d78ff5a15aa421fd733e
Raj Sodhi
LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video
  Editing
Video creation has become increasingly popular, yet the expertise and effort
required for editing often pose barriers to beginners. In this paper, we
explore the integration of large language models (LLMs) into the video editing
workflow to reduce these barriers. Our design vision is embodied in LAVE, a
novel system that provides LLM-powered agent assistance and language-augmented
editing features. LAVE automatically generates language descriptions for the
user's footage, serving as the foundation for enabling the LLM to process
videos and assist in editing tasks. When the user provides editing objectives,
the agent plans and executes relevant actions to fulfill them. Moreover, LAVE
allows users to edit videos through either the agent or direct UI manipulation,
providing flexibility and enabling manual refinement of agent actions. Our user
study, which included eight participants ranging from novices to proficient
editors, demonstrated LAVE's effectiveness. The results also shed light on user
perceptions of the proposed LLM-assisted editing paradigm and its impact on
users' creativity and sense of co-creation. Based on these findings, we propose
design implications to inform the future development of agent-assisted content
editing.