Pegasus-v1 Technical Report
This technical report introduces Pegasus-1, a multimodal language model
specialized in video content understanding and interaction through natural
language. Pegasus-1 is designed to address the unique challenges posed by video
data, such as interpreting spatiotemporal information, to offer nuanced video
content comprehension across various lengths. This technical report overviews
Pegasus-1's architecture, training strategies, and its performance in
benchmarks on video conversation, zero-shot video question answering, and video
summarization. We also explore qualitative characteristics of Pegasus-1 ,
demonstrating its capabilities as well as its limitations, in order to provide
readers a balanced view of its current state and its future direction.
662867869176f1c30505bd14
Raehyuk Jung
662867869176f1c30505bd15
Hyojun Go
admin_assigned
2024-04-24T11:28:55.768Z
630d5aff7dacb93b3359fe26
/avatars/e69c2bcb9d45131b68defae1bdb9d0cc.svg
Hyojun Go 
user
gohyojun15
662867869176f1c30505bd16
Jaehyuk Yi
admin_assigned
2024-04-24T11:34:06.840Z
641d47ef45487810d13867e4
/avatars/26e9968cb67be08129b135a38ee9065e.svg
Jay Yi
user
jay-12labs
662867869176f1c30505bd17
Jiho Jang
admin_assigned
2024-04-24T11:29:18.760Z
66220b24486de1d8db5f5534
/avatars/0fcc480fc0ec80b18c0ca7c9a7a73c34.svg
Jiho Jang
user
hagiss
662867869176f1c30505bd18
Daniel Kim
662867869176f1c30505bd19
Jay Suh
662867869176f1c30505bd1a
Aiden Lee
admin_assigned
2024-04-24T11:30:00.403Z
651c99a423e4906954d4e7df
/avatars/9f626af609b9d290abbcc67ec9c97ffc.svg
Aiden Lee
user
aidenslee
662867869176f1c30505bd1b
Cooper Han
claimed_verified
2024-04-25T06:55:09.922Z
65a49107482c457f354586d2
https://cdn-avatars.huggingface.co/v1/production/uploads/65a49107482c457f354586d2/vC7lVrfbqDS5-EyK6JpNu.jpeg
Cooper Han
user
cooper12labs
662867869176f1c30505bd1c
Jae Lee
admin_assigned
2024-04-24T11:33:39.459Z
643db7780efe9e9de0998bfc
https://cdn-avatars.huggingface.co/v1/production/uploads/643db7780efe9e9de0998bfc/dmgUOtpqB20POYcCBugTs.png
Jae Lee
user
Jaebird
662867869176f1c30505bd1d
Jeff Kim
662867869176f1c30505bd1e
Jin-Young Kim
admin_assigned
2024-04-24T11:30:57.456Z
65392959899a7547c963e133
/avatars/1727f93161c1e970e891ce7239222f46.svg
Jin-Young Kim
user
Jiny123
662867869176f1c30505bd1f
Junwan Kim
claimed_verified
2024-12-02T08:52:40.359Z
64c2c45ae818eec6128fdda3
/avatars/d4399e25e6399345e263c7902789047e.svg
Junwan Kim
user
junwann
662867869176f1c30505bd20
Kyle Park
662867869176f1c30505bd21
Lucas Lee
662867869176f1c30505bd22
Mars Ha
662867869176f1c30505bd23
Minjoon Seo
claimed_verified
2024-05-08T09:14:57.897Z
621f05ba970615ad5861ceb1
/avatars/7e1902aa71369a524afda9b0a9e88e22.svg
Minjoon Seo
user
minjoon
662867869176f1c30505bd24
Abraham Jo
662867869176f1c30505bd25
Ed Park
662867869176f1c30505bd26
Hassan Kianinejad
662867869176f1c30505bd27
SJ Kim
662867869176f1c30505bd28
Tony Moon
admin_assigned
2024-04-24T11:36:04.622Z
64de14af1499c62d84aa4eac
/avatars/f9011f51a38a0f050837cd517bf5a877.svg
Sangwoo Moon
user
swmoon00
662867869176f1c30505bd29
Wade Jeong
662867869176f1c30505bd2a
Andrei Popescu
662867869176f1c30505bd2b
Esther Kim
662867869176f1c30505bd2c
EK Yoon
662867869176f1c30505bd2d
Genie Heo
662867869176f1c30505bd2e
Henry Choi
662867869176f1c30505bd2f
Jenna Kang
662867869176f1c30505bd30
Kevin Han
662867869176f1c30505bd31
Noah Seo
662867869176f1c30505bd32
Sunny Nguyen
662867869176f1c30505bd33
Ryan Won
662867869176f1c30505bd34
Yeonhoo Park
662867869176f1c30505bd35
Anthony Giuliani
662867869176f1c30505bd36
Dave Chung
662867869176f1c30505bd37
Hans Yoon
662867869176f1c30505bd38
James Le
claimed_verified
2024-04-24T15:34:29.269Z
647f755aaa8c04bbf9395c90
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/IcLdvynfdrCKtcSJd6fcz.png
James Le
user
khanhnamle1994
662867869176f1c30505bd39
Jenny Ahn
662867869176f1c30505bd3a
June Lee
662867869176f1c30505bd3b
Maninder Saini
662867869176f1c30505bd3c
Meredith Sanders
662867869176f1c30505bd3d
Soyoung Lee
662867869176f1c30505bd3e
Sue Kim
662867869176f1c30505bd3f
Travis Couture
Pegasus-v1 Technical Report
This technical report introduces Pegasus-1, a multimodal language model
specialized in video content understanding and interaction through natural
language. Pegasus-1 is designed to address the unique challenges posed by video
data, such as interpreting spatiotemporal information, to offer nuanced video
content comprehension across various lengths. This technical report overviews
Pegasus-1's architecture, training strategies, and its performance in
benchmarks on video conversation, zero-shot video question answering, and video
summarization. We also explore qualitative characteristics of Pegasus-1 ,
demonstrating its capabilities as well as its limitations, in order to provide
readers a balanced view of its current state and its future direction.
Pegasus-1 is a multimodal language model designed for video content comprehension, handling spatiotemporal information and demonstrated in benchmarks for video conversation, zero-shot video question answering, and video summarization.
multimodal language model video content understanding spatiotemporal information video conversation zero-shot video question answering video summarization