blob: a1ee9a215f639842a12f629440a85a3a717eef61 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
|
# To-Do List
**High-level task tracker.** See individual design docs for implementation details.
**Completed tasks:** `doc/COMPLETED.md`
---
## Priority 1: Spectral Brush Editor (Task #5) [IN PROGRESS]
Procedural spectrogram tool: 50-100× compression (5 KB .spec → ~100 bytes C++).
**Design:** `doc/SPECTRAL_BRUSH_EDITOR.md`
---
## ~~Priority 2: Workspace System (Task #77)~~ [COMPLETED]
Self-contained workspaces for parallel demo development.
**Design:** `doc/WORKSPACE_SYSTEM.md`
**Usage:** `cmake -B build -DDEMO_WORKSPACE=main`
---
## Priority 2: CNN v2 - Parametric Static Features (Task #85) [COMPLETE]
Enhanced CNN post-processing with multi-dimensional feature inputs.
**Design:** `doc/CNN_V2.md`
**Status:**
- ✅ Phase 1-5: All implementation phases complete
- ✅ Storage buffer architecture (dynamic layer count support)
- ✅ Binary weight format (header + layer info + f16 weights)
- ✅ Training pipeline with live progress display
- ✅ Complete validation tooling (`train_cnn_v2_full.sh --validate`)
- ✅ All tests passing (36/36)
**Features:**
- 7D static feature input (RGBD + UV + sin encoding + bias)
- Storage buffer weights (~3.2 KB for 3-layer, 8→4→4 config)
- Dynamic layer count (not hardcoded)
- Single compute shader with per-layer params
- Patch-based training (harris detector, 32×32 patches)
- Fast training config: 100 epochs, 3×3 kernels
**Performance:**
- Storage buffer overhead: ~10-20% vs constants (negligible @ 60fps)
- Target achieved: <10 KB for 64k demo constraint
**TODO:** 8-bit quantization for 2× size reduction (~1.6 KB). Requires QAT.
---
## Priority 3: 3D System Enhancements (Task #18)
Pipeline for importing complex 3D scenes to replace hardcoded geometry.
**Status:** C++ object data loading complete. Shader SDF integration pending.
---
## Priority 4: WGSL Modularization (Task #50) [RECURRENT]
Ongoing shader code hygiene for granular, reusable snippets.
---
## Future: Size Optimization (64k Target)
- Task #22: Windows Native Platform (Win32)
- Task #28: Spectrogram Quantization
- Task #34: Full STL Removal
- Task #35: CRT Replacement
**Measure:** `./scripts/measure_size.sh`
---
**Backlog:** `doc/BACKLOG.md` for untriaged ideas
|
