summaryrefslogtreecommitdiff
path: root/workspaces/main/shaders/cnn_v2_static.wgsl
diff options
context:
space:
mode:
authorskal <pascal.massimino@gmail.com>2026-02-12 11:34:50 +0100
committerskal <pascal.massimino@gmail.com>2026-02-12 11:34:50 +0100
commit91d42f2d057e077c267d6775cc109a801aa315c0 (patch)
tree18cd67c9ce11f24149e6dafa65d176ca7143fcbb /workspaces/main/shaders/cnn_v2_static.wgsl
parent301db1f29137d3db7828e7a0103986cc845b7672 (diff)
CNN v2: parametric static features - Phases 1-4
Infrastructure for enhanced CNN post-processing with 7D feature input. Phase 1: Shaders - Static features compute (RGBD + UV + sin10_x + bias → 8×f16) - Layer template (convolution skeleton, packing/unpacking) - 3 mip level support for multi-scale features Phase 2: C++ Effect - CNNv2Effect class (multi-pass architecture) - Texture management (static features, layer buffers) - Build integration (CMakeLists, assets, tests) Phase 3: Training Pipeline - train_cnn_v2.py: PyTorch model with static feature concatenation - export_cnn_v2_shader.py: f32→f16 quantization, WGSL generation - Configurable architecture (kernels, channels) Phase 4: Validation - validate_cnn_v2.sh: End-to-end pipeline - Checkpoint → shaders → build → test images Tests: 36/36 passing Next: Complete render pipeline implementation (bind groups, multi-pass) Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
Diffstat (limited to 'workspaces/main/shaders/cnn_v2_static.wgsl')
-rw-r--r--workspaces/main/shaders/cnn_v2_static.wgsl47
1 files changed, 47 insertions, 0 deletions
diff --git a/workspaces/main/shaders/cnn_v2_static.wgsl b/workspaces/main/shaders/cnn_v2_static.wgsl
new file mode 100644
index 0000000..c3a2de7
--- /dev/null
+++ b/workspaces/main/shaders/cnn_v2_static.wgsl
@@ -0,0 +1,47 @@
+// CNN v2 Static Features Compute Shader
+// Generates 7D features + bias: [R, G, B, D, uv.x, uv.y, sin10_x, 1.0]
+
+@group(0) @binding(0) var input_tex: texture_2d<f32>;
+@group(0) @binding(1) var input_tex_mip1: texture_2d<f32>;
+@group(0) @binding(2) var input_tex_mip2: texture_2d<f32>;
+@group(0) @binding(3) var depth_tex: texture_2d<f32>;
+@group(0) @binding(4) var output_tex: texture_storage_2d<rgba32uint, write>;
+
+@compute @workgroup_size(8, 8)
+fn main(@builtin(global_invocation_id) id: vec3<u32>) {
+ let coord = vec2<i32>(id.xy);
+ let dims = textureDimensions(input_tex);
+
+ if (coord.x >= i32(dims.x) || coord.y >= i32(dims.y)) {
+ return;
+ }
+
+ // Sample RGBA from mip 0
+ let rgba = textureLoad(input_tex, coord, 0);
+ let r = rgba.r;
+ let g = rgba.g;
+ let b = rgba.b;
+
+ // Sample depth
+ let d = textureLoad(depth_tex, coord, 0).r;
+
+ // UV coordinates (normalized [0,1])
+ let uv_x = f32(coord.x) / f32(dims.x);
+ let uv_y = f32(coord.y) / f32(dims.y);
+
+ // Multi-frequency position encoding
+ let sin10_x = sin(10.0 * uv_x);
+
+ // Bias dimension (always 1.0)
+ let bias = 1.0;
+
+ // Pack 8×f16 into 4×u32 (rgba32uint)
+ let packed = vec4<u32>(
+ pack2x16float(vec2<f32>(r, g)),
+ pack2x16float(vec2<f32>(b, d)),
+ pack2x16float(vec2<f32>(uv_x, uv_y)),
+ pack2x16float(vec2<f32>(sin10_x, bias))
+ );
+
+ textureStore(output_tex, coord, packed);
+}