diff options
| author | skal <pascal.massimino@gmail.com> | 2026-02-12 11:13:50 +0100 |
|---|---|---|
| committer | skal <pascal.massimino@gmail.com> | 2026-02-12 11:13:50 +0100 |
| commit | 301db1f29137d3db7828e7a0103986cc845b7672 (patch) | |
| tree | 501b6d4a1df51b4eba00c93d21194e2b86b3dfb8 /TODO.md | |
| parent | 17676de7a233215548ff3da13962acc8cb0ed04d (diff) | |
CNN v2: parametric static features - design doc
Design document for CNN v2 with enhanced feature inputs:
- 7D static features: RGBD + UV + sin encoding + bias
- Per-layer configurable kernels (1×1, 3×3, 5×5)
- Float16 weight storage (~6.4 KB vs 3.2 KB)
- Multi-pass architecture with static feature compute
Implementation plan:
1. Static features compute shader (RGBD + UV + sin + bias)
2. C++ effect class (CNNv2Effect)
3. Training pipeline (train_cnn_v2.py, export_cnn_v2_shader.py)
4. Validation tooling (validate_cnn_v2.sh)
Files:
- doc/CNN_V2.md: Complete technical design (architecture, training, export)
- scripts/validate_cnn_v2.sh: End-to-end validation script
- TODO.md: Add CNN v2 as Priority 2 task
- doc/HOWTO.md: Add CNN v2 validation usage
Target: <10 KB for 64k demo constraint
handoff(Claude): CNN v2 design ready for implementation
Diffstat (limited to 'TODO.md')
| -rw-r--r-- | TODO.md | 21 |
1 files changed, 21 insertions, 0 deletions
@@ -24,6 +24,27 @@ Self-contained workspaces for parallel demo development. --- +## Priority 2: CNN v2 - Parametric Static Features (Task #85) [PLANNING] + +Enhanced CNN post-processing with multi-dimensional feature inputs. + +**Design:** `doc/CNN_V2.md` + +**Implementation phases:** +1. Static features compute shader (RGBD + UV + sin encoding + bias) +2. C++ effect class (multi-pass layer execution) +3. Training pipeline (PyTorch f32 → f16 export) +4. Validation tooling (end-to-end checkpoint testing) + +**Key improvements over v1:** +- 7D static feature input (vs 4D RGB) +- Per-layer configurable kernels (1×1, 3×3, 5×5) +- Float16 weight storage (~6.4 KB vs 3.2 KB) + +**Target:** <10 KB for 64k demo constraint + +--- + ## Priority 3: 3D System Enhancements (Task #18) Pipeline for importing complex 3D scenes to replace hardcoded geometry. |
