EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
Paper
ā¢
2402.17485
ā¢
Published
ā¢
195
š Avatars
The latest AI-powered technologies usher in a new era of realistic avatars! š
Note š® Post: https://huggingface.co/posts/DmitryRyumin/146398971160140 š Paper: https://huggingface.co/papers/2402.17485 š Github Page: https://humanaigc.github.io/emote-portrait-alive š Repository: https://github.com/HumanAIGC/EMO
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior
Paper ā¢ 2312.01841 ā¢ Published ā¢ 1Note š Paper: https://huggingface.co/papers/2312.01841 š Github Page: https://humanaigc.github.io/vivid-talk š Repository: https://github.com/HumanAIGC/VividTalk šŗ Video: https://www.youtube.com/watch?v=lJVzt7JCe_4
MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
Paper ā¢ 2311.16498 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/578997477674932 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š¤ Demo: https://huggingface.co/spaces/zcxu-eric/magicanimate š Paper: https://huggingface.co/papers/2311.16498 š Github Page: https://showlab.github.io/magicanimate/ š Repository: https://github.com/magic-research/magic-animate š„ Model š¤: https://huggingface.co/zcxu-eric/MagicAnimate
GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians
Paper ā¢ 2312.02134 ā¢ Published ā¢ 2Note š® Post: https://huggingface.co/posts/DmitryRyumin/635360328098616 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2312.02134 š Github Page: https://huliangxiao.github.io/GaussianAvatar š Repository: https://github.com/huliangxiao/GaussianAvatar šŗ Video: https://www.youtube.com/watch?v=a4g8Z9nCF-k
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis
Paper ā¢ 2311.17590 ā¢ Published ā¢ 2Note š® Post: https://huggingface.co/posts/DmitryRyumin/733100901107547 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2311.17590 š Github Page: https://ziqiaopeng.github.io/synctalk š Repository: https://github.com/ZiqiaoPeng/SyncTalk
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis
Paper ā¢ 2401.08503 ā¢ Published ā¢ 4Note š® Post: https://huggingface.co/posts/DmitryRyumin/170929653134354 š Conference: ICLR, May 7-11, 2024 | Vienna, Austria š¦š¹ š Paper: https://huggingface.co/papers/2401.08503 š Github Page: https://real3dportrait.github.io/ š Repository: https://github.com/yerfor/Real3DPortrait š„ Model š¤: https://huggingface.co/ameerazam08/Real3DPortrait
GPAvatar: Generalizable and Precise Head Avatar from Image(s)
Paper ā¢ 2401.10215 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/289967366439346 š Conference: ICLR, May 7-11, 2024 | Vienna, Austria š¦š¹ š Paper: https://huggingface.co/papers/2401.10215 š Github Page: https://xg-chu.github.io/project_gpavatar š Repository: https://github.com/xg-chu/GPAvatar šŗ Video: https://www.youtube.com/watch?v=7A3DMaB6Zk0
Relightable and Animatable Neural Avatars from Videos
Paper ā¢ 2312.12877 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/188560282332993 š Conference: AAAI, February 20-27, 2024 | Vancouver, Canada šØš¦ š Paper: https://huggingface.co/papers/2312.12877 š Github Page: https://wenbin-lin.github.io/RelightableAvatar-page š Repository: https://github.com/wenbin-lin/RelightableAvatar šŗ Video: https://www.youtube.com/watch?v=v9rlys0xQGo
High-Fidelity 3D Head Avatars Reconstruction through Spatially-Varying Expression Conditioned Neural Radiance Field
Paper ā¢ 2310.06275 ā¢ Published ā¢ 2Note š Conference: AAAI, February 20-27, 2024 | Vancouver, Canada šØš¦ š Paper: https://huggingface.co/papers/2310.06275 š Github Page: https://minghanqin.github.io/AvatarSVE/ š Repository: https://github.com/minghanqin/AvatarSVE šŗ Video: https://www.youtube.com/watch?v=dPgAa-6Kt8Q
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis
Paper ā¢ 2403.08764 ā¢ Published ā¢ 36Note š® Post: https://huggingface.co/posts/DmitryRyumin/888482747169050 š Paper: https://huggingface.co/papers/2403.08764 š Github Page: https://enriccorona.github.io/vlogger/
Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling
Paper ā¢ 2311.16096 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/496583626851543 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2311.16096 š Github Page: https://animatable-gaussians.github.io š Repository: https://github.com/lizhe00/AnimatableGaussians šŗ Video: https://www.youtube.com/watch?v=kOmZxD0HxZI
NECA: Neural Customizable Human Avatar
Paper ā¢ 2403.10335 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/399329903001758 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2403.10335 š Repository: https://github.com/iSEE-Laboratory/NECA
InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image
Paper ā¢ 2311.02826 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/288502341253111 š Conference: ICLR, May 7-11, 2024 | Vienna, Austria š¦š¹ š Paper: https://huggingface.co/papers/2311.02826 š Github Page: https://mybabyyh.github.io/InstructPix2NeRF š Repository: https://github.com/mybabyyh/InstructPix2NeRF
Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians
Paper ā¢ 2312.03029 ā¢ Published ā¢ 26Note š® Post: https://huggingface.co/posts/DmitryRyumin/685682060907396 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2312.03029 š Github Page: https://yuelangx.github.io/gaussianheadavatar š Repository: https://github.com/YuelangX/Gaussian-Head-Avatar šŗ Video: https://www.youtube.com/watch?v=kvrrI3EoM5g
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Paper ā¢ 2312.02069 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/619817116350533 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2312.02069 š Github Page: https://shenhanqian.github.io/gaussian-avatars š Repository: https://github.com/ShenhanQian/GaussianAvatars šŗ Video: https://www.youtube.com/watch?v=lVEY78RwU_I
Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute
Paper ā¢ 2401.00711 ā¢ Published ā¢ 2Note š® Post: https://huggingface.co/posts/DmitryRyumin/595207139085023 š Conference: ICASSP, 14-19 April 2024 | Seoul, Korea š°š· š Paper: https://huggingface.co/papers/2401.00711 š Github Page: https://iecqgong.github.io/text2avatar/
FlashFace: Human Image Personalization with High-fidelity Identity Preservation
Paper ā¢ 2403.17008 ā¢ Published ā¢ 21Note š® Post: https://huggingface.co/posts/DmitryRyumin/204103548247572 š Paper: https://huggingface.co/papers/2403.17008 š Github Page: https://jshilong.github.io/flashface-page/
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
Paper ā¢ 2403.17694 ā¢ Published ā¢ 12Note š® Post: https://huggingface.co/posts/DmitryRyumin/191716706611860 š¤ Demo: https://huggingface.co/spaces/ZJYang/AniPortrait_official š Paper: https://huggingface.co/papers/2403.17694 š Repository: https://github.com/Zejun-Yang/AniPortrait š„ Model š¤: https://huggingface.co/ZJYang/AniPortrait
Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes
Paper ā¢ 2404.01543 ā¢ Published ā¢ 3Note š® Post: https://huggingface.co/posts/DmitryRyumin/763522030257659 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2404.01543 š Github Page: https://augmentedperception.github.io/monoavatar-plus/
GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image
Paper ā¢ 2404.02152 ā¢ Published ā¢ 3Note š® Post: https://huggingface.co/posts/DmitryRyumin/335365529548063 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2404.02152 š Github Page: https://zju3dv.github.io/geneavatar/ š Repository: https://github.com/zju3dv/GeneAvatar šŗ Video: https://www.youtube.com/watch?v=4zfbfPivtVU
3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting
Paper ā¢ 2312.09228 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/381309144455409 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2312.09228 š Github Page: https://neuralbodies.github.io/3DGS-Avatar/ š Repository: https://github.com/mikeqzy/3dgs-avatar-release šŗ Video: https://www.youtube.com/watch?v=FJ29U9OkmmU
InstructHumans: Editing Animated 3D Human Textures with Instructions
Paper ā¢ 2404.04037 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/462458353486294 š Paper: https://huggingface.co/papers/2404.04037 š Web Page: https://jyzhu.top/instruct-humans/ š Repository: https://github.com/viridityzhu/InstructHumans
PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations
Paper ā¢ 2404.04421 ā¢ Published ā¢ 18Note š® Post: https://huggingface.co/posts/DmitryRyumin/930608949502580 š Paper: https://huggingface.co/papers/2404.04421 š GitHub Page: https://qingqing-zhao.github.io/PhysAvatar
GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
Paper ā¢ 2404.07991 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/532264219296718 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2404.07991 š Github Page: https://wenj.github.io/GoMAvatar/ š Repository: https://github.com/wenj/GoMAvatar
VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time
Paper ā¢ 2404.10667 ā¢ Published ā¢ 22Note š Paper: https://huggingface.co/papers/2404.10667 š Web Page: https://www.microsoft.com/en-us/research/project/vasa-1/
HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach
Paper ā¢ 2404.01094 ā¢ Published ā¢ 6Note š® Post: https://huggingface.co/posts/DmitryRyumin/932263322939776 š¤ Demo: https://huggingface.co/spaces/multimodalart/hairfastgan š Paper: https://huggingface.co/papers/2404.01094 š Repository: https://github.com/AIRI-Institute/HairFastGAN š„ Model š¤: https://huggingface.co/AIRI-Institute/HairFastGAN
Learn2Talk: 3D Talking Face Learns from 2D Talking Face
Paper ā¢ 2404.12888 ā¢ Published ā¢ 2Note š® Post: https://huggingface.co/posts/DmitryRyumin/511657668327096 š Paper: https://huggingface.co/papers/2404.12888 š Github Page: https://lkjkjoiuiu.github.io/Learn2Talk/
WANDR: Intention-guided Human Motion Generation
Paper ā¢ 2404.15383 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/295452758814429 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2404.15383 š Web Page: https://wandr.is.tue.mpg.de š Repository: https://github.com/markos-diomataris/wandr šŗ Video: https://www.youtube.com/watch?v=9szizM-XUCg
ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving
Paper ā¢ 2404.16771 ā¢ Published ā¢ 19Note š® Post: https://huggingface.co/posts/DmitryRyumin/303634956982953 š Paper: https://huggingface.co/papers/2404.16771 š Github Page: https://ssugarwh.github.io/consistentid.github.io/ š Repository: https://github.com/JackAILab/ConsistentID
EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars
Paper ā¢ 2404.19110 ā¢ Published ā¢ 4Note š® Post: https://huggingface.co/posts/DmitryRyumin/113952082634225 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2404.19110 š Github Page: https://neeek2303.github.io/EMOPortraits
3D Gaussian Blendshapes for Head Avatar Animation
Paper ā¢ 2404.19398 ā¢ Published ā¢ 2Note š® Post: https://huggingface.co/posts/DmitryRyumin/802475347987275 š Conference: SIGGRAPH, 28 Jul ā 1 Aug, 2024 | Denver CO, USA šŗšø š Paper: https://huggingface.co/papers/2404.19398 š Github Page: https://gapszju.github.io/GaussianBlendshape/
AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding
Paper ā¢ 2405.03121 ā¢ Published ā¢ 2Note š® Post: https://huggingface.co/posts/DmitryRyumin/698577433443867 š Paper: https://huggingface.co/papers/2405.03121 š Github Page: https://x-lance.github.io/AniTalker š Repository: https://github.com/X-LANCE/AniTalker
LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer
Paper ā¢ 2405.07319 ā¢ PublishedNote š® Post: https://huggingface.co/posts/DmitryRyumin/182984250825015 š Conference: SIGGRAPH, 28 Jul ā 1 Aug, 2024 | Denver CO, USA šŗšø š Paper: https://huggingface.co/papers/2405.07319 š Github Page: https://jsnln.github.io/layga/index.html
Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping
Paper ā¢ 2405.12069 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/557611713480917 š Paper: https://huggingface.co/papers/2405.12069 š Github Page: https://gaussian-head-shoulders.netlify.app
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
Paper ā¢ 2405.15758 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/378045093988402 š Paper: https://huggingface.co/papers/2405.15758 š Github Page: https://wangyuchi369.github.io/InstructAvatar/ š Repository: https://github.com/wangyuchi369/InstructAvatar
Human4DiT: Free-view Human Video Generation with 4D Diffusion Transformer
Paper ā¢ 2405.17405 ā¢ Published ā¢ 16Note š Paper: https://huggingface.co/papers/2405.17405 š Github Page: https://human4dit.github.io/
Relightable Gaussian Codec Avatars
Paper ā¢ 2312.03704 ā¢ Published ā¢ 33Note š® Post: https://huggingface.co/posts/DmitryRyumin/998191475426468 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2312.03704 š Github Page: https://shunsukesaito.github.io/rgca/
GMTalker: Gaussian Mixture based Emotional talking video Portraits
Paper ā¢ 2312.07669 ā¢ Published ā¢ 1Note š Paper: https://huggingface.co/papers/2312.07669 š Github Page: https://bob35buaa.github.io/GMTalker šŗ Video: https://www.youtube.com/watch?v=8kcYw3Ps48w
NPGA: Neural Parametric Gaussian Avatars
Paper ā¢ 2405.19331 ā¢ Published ā¢ 10Note š Paper: https://huggingface.co/papers/2405.19331 š Github Page: https://simongiebenhain.github.io/NPGA/ šŗ Video: https://www.youtube.com/watch?v=NGRxAYbIkus
Learning One-Shot 4D Head Avatar Synthesis using Synthetic Data
Paper ā¢ 2311.18729 ā¢ PublishedNote š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2311.18729 š Github Page: https://yudeng.github.io/Portrait4D/ š Repository: https://github.com/YuDeng/Portrait-4D šŗ Video: https://www.youtube.com/watch?v=8f1NBTdhvzw
Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizer
Paper ā¢ 2403.13570 ā¢ Published ā¢ 3Note š® Post: https://huggingface.co/posts/DmitryRyumin/891674447263162 š Paper: https://huggingface.co/papers/2403.13570 š Github Page: https://yudeng.github.io/Portrait4D-v2/ š Repository: https://github.com/YuDeng/Portrait-4D šŗ Video: https://www.youtube.com/watch?v=5YJY6-wcOJo
Stratified Avatar Generation from Sparse Observations
Paper ā¢ 2405.20786 ā¢ PublishedNote š Paper: https://huggingface.co/papers/2405.20786 š Github Page: https://fhan235.github.io/SAGENet/ š Repository: https://github.com/Wenchao-M/SAGE šŗ Video: https://www.youtube.com/watch?v=RkXaxyv1TOU
Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
Paper ā¢ 2406.08475 ā¢ Published ā¢ 1Note š Paper: https://huggingface.co/papers/2406.08475 š Github Page: https://yuxuan-xue.com/human-3diffusion/ š Repository: https://github.com/YuxuanSnow/Human3Diffusion/
Instant 3D Human Avatar Generation using Image Diffusion Models
Paper ā¢ 2406.07516 ā¢ Published ā¢ 1Note š Paper: https://huggingface.co/papers/2406.07516 š Github Page: https://www.nikoskolot.com/avatarpopup/
Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture
Paper ā¢ 2406.00440 ā¢ PublishedNote š® Post: https://huggingface.co/posts/DmitryRyumin/753056979023615 š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2406.00440 š Github Page: https://xuanchenli.github.io/Topo4D/ š Repository: https://github.com/XuanchenLi/Topo4D
Expressive Gaussian Human Avatars from Monocular RGB Video
Paper ā¢ 2407.03204 ā¢ Published ā¢ 1Note š® Post: https://huggingface.co/posts/DmitryRyumin/852656118525688 š Paper: https://huggingface.co/papers/2407.03204 š Github Page: https://evahuman.github.io/ š Repository: https://github.com/evahuman/EVA
LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
Paper ā¢ 2407.03168 ā¢ Published ā¢ 3Note š® Post: https://huggingface.co/posts/DmitryRyumin/181465871908039 š¤ Demo: https://huggingface.co/spaces/KwaiVGI/LivePortrait š Paper: https://huggingface.co/papers/2407.03168 š Github Page: https://liveportrait.github.io/ š Repository: https://github.com/KwaiVGI/LivePortrait š„ Model š¤: https://huggingface.co/KwaiVGI/LivePortrait
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
Paper ā¢ 2401.04730 ā¢ PublishedNote š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2401.04730 š Repository: https://github.com/FangyunWei/SLRT
PICA: Physics-Integrated Clothed Avatar
Paper ā¢ 2407.05324 ā¢ PublishedNote š Paper: https://huggingface.co/papers/2407.05324 š Github Page: https://ustc3dv.github.io/PICA/
MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devices
Paper ā¢ 2407.05712 ā¢ PublishedNote š Paper: https://huggingface.co/papers/2407.05712 š Github Page: https://mobileportrait.github.io/
RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models
Paper ā¢ 2407.06938 ā¢ Published ā¢ 25Note š® Post: https://huggingface.co/posts/DmitryRyumin/124284908420927 š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.06938 š Github Page: https://rodinhd.github.io/ š Repository: https://github.com/RodinHD/RodinHD šŗ Video: https://www.youtube.com/watch?v=ULvHt7dZx-Q
IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing
Paper ā¢ 2312.05210 ā¢ PublishedNote š® Post: https://huggingface.co/posts/DmitryRyumin/211717085209386 š Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA šŗšø š Paper: https://huggingface.co/papers/2312.05210 š Github Page: https://neuralbodies.github.io/IntrinsicAvatar/ š Repository: https://github.com/taconite/IntrinsicAvatar šŗ Video: https://www.youtube.com/watch?v=aS8AIxgVXzI
MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition
Paper ā¢ 2407.07284 ā¢ PublishedNote š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.07284 š Github Page: https://aggelinacha.github.io/MIGS šŗ Video: https://www.youtube.com/watch?v=yUhIi3g5chI
WildAvatar: Web-scale In-the-wild Video Dataset for 3D Avatar Creation
Paper ā¢ 2407.02165 ā¢ PublishedNote š Paper: https://huggingface.co/papers/2407.02165 š Github Page: https://wildavatar.github.io š Repository: https://github.com/wildavatar/WildAvatar_Toolbox šŗ Video: https://www.youtube.com/watch?v=T-XafMVKY7E
MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videos
Paper ā¢ 2407.08414 ā¢ PublishedNote š® Post: https://huggingface.co/posts/DmitryRyumin/644671729298990 š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.08414 š Github Page: https://shad0wta9.github.io/meshavatar-page š Repository: https://github.com/shad0wta9/meshavatar šŗ Video: https://www.youtube.com/watch?v=Kpbpujkh2iI
Tri^{2}-plane: Thinking Head Avatar via Feature Pyramid
Paper ā¢ 2401.09386 ā¢ PublishedNote š Paper: https://huggingface.co/papers/2401.09386 š Github Page: https://songluchuan.github.io/Tri2Plane.github.io š Repository: https://github.com/Songluchuan/Tri2plane šŗ Video: https://www.youtube.com/watch?v=qU7zijI2DCQ
CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Images
Paper ā¢ 2407.04345 ā¢ PublishedNote š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.04345 š Repository: https://github.com/jsshin98/CanonicalFusion
iHuman: Instant Animatable Digital Humans From Monocular Videos
Paper ā¢ 2407.11174 ā¢ Published ā¢ 1Note š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.11174 š Github Page: https://pramishp.github.io/iHuman/index.html š Repository: https://github.com/pramishp/ihuman šŗ Video: https://www.youtube.com/watch?v=W5xG2GYfUM0
EmoFace: Audio-driven Emotional 3D Face Animation
Paper ā¢ 2407.12501 ā¢ PublishedNote š Conference: VR, March 16-21, 2024 | Orlando FL, USA šŗšø š Paper: https://huggingface.co/papers/2407.12501 š Github Page: https://sjtu-lucy.github.io/EmoFace š Repository: https://github.com/SJTU-Lucy/EmoFace
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects
Paper ā¢ 2407.12371 ā¢ PublishedNote š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.12371 š Github Page: https://lvxintao.github.io/himo š Repository: https://github.com/LvXinTao/HIMO_dataset
Fast Registration of Photorealistic Avatars for VR Facial Animation
Paper ā¢ 2401.11002 ā¢ Published ā¢ 2Note š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2401.11002 š Github Page: https://chaitanya100100.github.io/FastRegistration š Repository: https://github.com/chaitanya100100/FastRegistration šŗ Video: https://www.youtube.com/watch?v=Jq_KJV3QoJ0
Expressive Whole-Body 3D Gaussian Avatar
Paper ā¢ 2407.21686 ā¢ Published ā¢ 8Note š® Post: https://huggingface.co/posts/DmitryRyumin/144143912433557 š Conference: ECCV, 29 Sep ā 4 Oct, 2024 | Milano, Italy š®š¹ š Paper: https://huggingface.co/papers/2407.21686 š Github Page: https://mks0601.github.io/ExAvatar š Repository: https://github.com/mks0601/ExAvatar_RELEASE
HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors
Paper ā¢ 2408.06019 ā¢ Published ā¢ 15Note š® Post: https://huggingface.co/posts/DmitryRyumin/334746128110541 š Paper: https://huggingface.co/papers/2408.06019 š Github Page: https://headgap.github.io
Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependency
Paper ā¢ 2409.02634 ā¢ Published ā¢ 97Note š Paper: https://huggingface.co/papers/2409.02634 š Github Page: https://loopyavatar.github.io
Instant Facial Gaussians Translator for Relightable and Interactable Facial Rendering
Paper ā¢ 2409.07441 ā¢ Published ā¢ 11Note š Paper: https://huggingface.co/papers/2409.07441 š Github Page: https://dafei-qin.github.io/TransGS.github.io šŗ Video: https://www.youtube.com/watch?v=MQTm3WTQ3KI
Portrait Video Editing Empowered by Multimodal Generative Priors
Paper ā¢ 2409.13591 ā¢ Published ā¢ 17Note š Conference: SIGGRAPH Asia, Dec 3-6, 2024 | Tokyo, Japan šÆšµ š Paper: https://huggingface.co/papers/2409.13591 š Github Page: https://ustc3dv.github.io/PortraitGen š Repository: https://github.com/USTC3DV/PortraitGen-code
-
HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting
Paper ā¢ 2312.02902 ā¢ Published -
TextToon: Real-Time Text Toonify Head Avatar from Single Video
Paper ā¢ 2410.07160 ā¢ Published ā¢ 7 -
DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation
Paper ā¢ 2410.13726 ā¢ Published ā¢ 12 -
IDOL: Instant Photorealistic 3D Human Creation from a Single Image
Paper ā¢ 2412.14963 ā¢ Published ā¢ 6
EmoVOCA: Speech-Driven Emotional 3D Talking Heads
Paper ā¢ 2403.12886 ā¢ PublishedNote š® Post: https://huggingface.co/posts/DmitryRyumin/189065722993769 š Conference: WACV, 28 Feb ā 4 Mar, 2025 | Arizona, USA šŗšø š Paper: https://arxiv.org/abs/2403.12886 š Github Page: https://fedenoce.github.io/emovoca/ š Repository: https://github.com/miccunifi/EmoVOCA
-
TaoAvatar: Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting
Paper ā¢ 2503.17032 ā¢ Published ā¢ 27 -
FRESA:Feedforward Reconstruction of Personalized Skinned Avatars from Few Images
Paper ā¢ 2503.19207 ā¢ Published ā¢ 4 -
FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesis
Paper ā¢ 2504.04842 ā¢ Published ā¢ 35 -
HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animation
Paper ā¢ 2503.18860 ā¢ Published ā¢ 6