businesslion commited on
Commit
7b2481a
·
verified ·
1 Parent(s): 25092f5

fix VAE latent dims: 32 tokens x 32-d (1,024-d total), not 32x1024

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -24,7 +24,7 @@ Single-step, scaffold-dominant diffusion for 3D scene completion on SemanticKITT
24
 
25
  ### SMC 2026 (accepted) — *CloudDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain*
26
  The companion short paper covers:
27
- - **Multi-token Gaussian VAE** (7.1 M params): residual PointNet encoder + 32-query cross-attention pooler producing 32 × 1024-d Gaussian latent tokens; transformer decoder with 5 cross-attention blocks reconstructs 8,000 scene points. Squared CD **0.120 ± 0.026 m²** at **1.6 ms / frame**, no codebook collapse (vs ~16 m² for the VQ-VAE alternative).
28
  - **Anchor-based ICP ground-truth refinement (v2 GT)**: per-scan ICP against a w=17 temporal window (±17, 35-scan context) with displacement-gated acceptance (τ = 0.15 m), SOR/ROR cleanup, 0.1 m voxelisation, over 23,201 frames (considerably denser than the original accumulation).
29
  - **Single-step x₀ coordinate-space diffusion teacher**: completes a scene in one forward pass directly in coordinate space at 209 ms/frame (the SMC paper's efficiency contribution; it does not claim a scaffold-free accuracy win over baselines — that analysis lives in the RA-L paper below).
30
 
@@ -86,7 +86,7 @@ LiDAR vs DA2 (Depth Anything V2 monocular pseudo-LiDAR):
86
  | Parameters | 7.1 M |
87
  | Inference | 1.6 ms / frame |
88
  | Decoded points | 8,000 |
89
- | Latent | 32 tokens × 1024-d |
90
 
91
  ---
92
 
@@ -97,7 +97,7 @@ LiDAR vs DA2 (Depth Anything V2 monocular pseudo-LiDAR):
97
  | `teacher_v2gt/best_model.pth` | 542 MB | Diffusion teacher trained with GT-coordinate scaffold on v2 GT, 30 ep | SMC + RA-L Tables I, IV, V, VI |
98
  | `teacher_v2gt_ft/best_model.pth` *(NEW)* | 470 MB | Mixed-scaffold fine-tune (3 ep, 45 min, 30 % LIDAR-cropped scaffold mix), seed 42 reference; 6-seed evaluation in RA-L paper | RA-L Table III (the 0.968 m² row) |
99
  | `teacher_v1gt/best_model.pth` | 542 MB | Same architecture trained on v1 (standard) GT — for the 16× refinement comparison | SMC + RA-L Table I |
100
- | `vae_v3/best_point_vae.pth` | ~85 MB | Multi-token Gaussian VAE (7.1 M params, 32 × 1024-d latent, 8,000 pts) — produced by `models/point_cloud_vae.py` (class `PointCloudVAE`), **not** the deprecated `point_cloud_vae_v2.py` FoldingNet design | SMC §III-B, Table II |
101
 
102
  All four share the frozen Sonata / PTv3 encoder (108 M params), loaded from the upstream Sonata release; only the small denoiser / VAE heads are trained.
103
 
 
24
 
25
  ### SMC 2026 (accepted) — *CloudDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain*
26
  The companion short paper covers:
27
+ - **Multi-token Gaussian VAE** (7.1 M params): residual PointNet encoder + 32-query cross-attention pooler producing 32 × 32-d Gaussian latent tokens (1,024-d latent total); transformer decoder with 5 cross-attention blocks reconstructs 8,000 scene points. Squared CD **0.120 ± 0.026 m²** at **1.6 ms / frame**, no codebook collapse (vs ~16 m² for the VQ-VAE alternative).
28
  - **Anchor-based ICP ground-truth refinement (v2 GT)**: per-scan ICP against a w=17 temporal window (±17, 35-scan context) with displacement-gated acceptance (τ = 0.15 m), SOR/ROR cleanup, 0.1 m voxelisation, over 23,201 frames (considerably denser than the original accumulation).
29
  - **Single-step x₀ coordinate-space diffusion teacher**: completes a scene in one forward pass directly in coordinate space at 209 ms/frame (the SMC paper's efficiency contribution; it does not claim a scaffold-free accuracy win over baselines — that analysis lives in the RA-L paper below).
30
 
 
86
  | Parameters | 7.1 M |
87
  | Inference | 1.6 ms / frame |
88
  | Decoded points | 8,000 |
89
+ | Latent | 32 tokens × 32-d (1,024-d total) |
90
 
91
  ---
92
 
 
97
  | `teacher_v2gt/best_model.pth` | 542 MB | Diffusion teacher trained with GT-coordinate scaffold on v2 GT, 30 ep | SMC + RA-L Tables I, IV, V, VI |
98
  | `teacher_v2gt_ft/best_model.pth` *(NEW)* | 470 MB | Mixed-scaffold fine-tune (3 ep, 45 min, 30 % LIDAR-cropped scaffold mix), seed 42 reference; 6-seed evaluation in RA-L paper | RA-L Table III (the 0.968 m² row) |
99
  | `teacher_v1gt/best_model.pth` | 542 MB | Same architecture trained on v1 (standard) GT — for the 16× refinement comparison | SMC + RA-L Table I |
100
+ | `vae_v3/best_point_vae.pth` | ~85 MB | Multi-token Gaussian VAE (7.1 M params, 1,024-d latent (32 tokens × 32-d), 8,000 pts) — produced by `models/point_cloud_vae.py` (class `PointCloudVAE`), **not** the deprecated `point_cloud_vae_v2.py` FoldingNet design | SMC §III-B, Table II |
101
 
102
  All four share the frozen Sonata / PTv3 encoder (108 M params), loaded from the upstream Sonata release; only the small denoiser / VAE heads are trained.
103