demo.git - Vide-coded 64k demo system

Age	Commit message (Collapse)	Author
13 hours	feat: Audio playback stability, NOTE_ parsing fix, sample caching, and debug ↵	skal
	logging infrastructure MILESTONE: Audio System Robustness & Debugging Core Audio Backend Optimization: - Fixed stop-and-go audio glitches caused by timing mismatch - Core Audio optimized for 44.1kHz (10ms periods), but 32kHz expected ~13.78ms - Added allowNominalSampleRateChange=TRUE to force OS-level 32kHz native - Added performanceProfile=conservative for 4096-frame buffers (128ms) - Result: Stable ~128ms callbacks, <1ms jitter, zero underruns Ring Buffer Improvements: - Increased capacity from 200ms to 400ms for tempo scaling headroom - Added comprehensive bounds checking with abort() on violations - Fixed tempo-scaled buffer fill: dt * g_tempo_scale - Buffer maintains 400ms fullness during 2.0x acceleration NOTE_ Parsing Fix & Sample Caching: - Fixed is_note_name() checking only first letter (A-G) - ASSET_KICK_1 was misidentified as A0 (27.5 Hz) - Required "NOTE_" prefix to distinguish notes from assets - Updated music.track to use NOTE_E2, NOTE_G4 format - Discovered resource exhaustion: 14 unique samples → 228 registrations - Implemented comprehensive caching in tracker_init() - Assets: loaded once from AssetManager, cached synth_id - Generated notes: created once, stored in persistent pool - Result: MAX_SPECTROGRAMS 256 → 32 (88% memory reduction) Debug Logging Infrastructure: - Created src/util/debug.h with 7 category macros (AUDIO, RING_BUFFER, TRACKER, SYNTH, 3D, ASSETS, GPU) - Added DEMO_ENABLE_DEBUG_LOGS CMake option (defines DEBUG_LOG_ALL) - Converted all diagnostic code to use category macros - Default build: macros compile to ((void)0) for zero runtime cost - Debug build: comprehensive logging for troubleshooting - Updated CONTRIBUTING.md with pre-commit policy Resource Analysis Tool: - Enhanced tracker_compiler to report pool sizes and cache potential - Analysis: 152/228 spectrograms without caching, 14 with caching - Tool generates optimization recommendations during compilation Files Changed: - CMakeLists.txt: Add DEBUG_LOG option - src/util/debug.h: New debug logging header (7 categories) - src/audio/miniaudio_backend.cc: Use DEBUG_AUDIO/DEBUG_RING_BUFFER - src/audio/ring_buffer.cc: Use DEBUG_RING_BUFFER for underruns - src/audio/tracker.cc: Implement sample caching, use DEBUG_TRACKER - src/audio/synth.cc: Use DEBUG_SYNTH for validation - src/audio/synth.h: Update MAX_SPECTROGRAMS (256→32), document caching - tools/tracker_compiler.cc: Fix is_note_name(), add resource analysis - assets/music.track: Update to use NOTE_ prefix format - doc/CONTRIBUTING.md: Add debug logging pre-commit policy - PROJECT_CONTEXT.md: Document milestone - TODO.md: Mark tasks completed Verification: - Default build: No debug output, audio plays correctly - Debug build: Comprehensive logging, audio plays correctly - Caching working: 14 unique samples cached at init - All tests passing (17/17) handoff(Claude): Audio system now stable with robust diagnostic infrastructure. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
18 hours	docs: Update project state with event-based tracker and WAV dump	skal
	Updated PROJECT_CONTEXT.md and TODO.md to reflect recent milestones: PROJECT_CONTEXT.md changes: - Updated Audio section: stereo format, variable tempo, event-based triggering - Added milestone for "Event-Based Tracker for Tempo Scaling" - Added milestone for "WAV Dump Backend for Debugging" - Updated Audio Engine architecture section with new details - Updated test counts (17/17 passing) TODO.md changes: - Added "Event-Based Tracker for Tempo Scaling" to Recently Completed * Refactored from pattern compositing to individual event triggering * Dynamic beat calculation enables notes to respect tempo scaling * ActivePattern tracking with start_music_time and next_event_idx * All 17 tests pass, WAV dump confirms correct behavior - Added "WAV Dump Backend for Debugging" to Recently Completed * WavDumpBackend for offline rendering to .wav files * Fixed critical stereo format bug (mono/stereo mismatch) * Added regression test with stereo format assertion * Command-line option: --dump_wav output.wav Current State: - All tests passing: 17/17 (100%) - Audio system: Stereo, variable tempo, event-based tracking - Documentation: Up to date with latest architecture Ready for handoff to Gemini. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
19 hours	feat(audio): Variable tempo system with music time abstraction	skal
	Implemented unified music time that advances at configurable tempo_scale, enabling dynamic tempo changes without pitch shifting or BPM dependencies. Key Changes: - Added music_time tracking in main.cc (advances by dt * tempo_scale) - Decoupled tracker_update() from physical time (now uses music_time) - Created comprehensive test suite (test_variable_tempo.cc) with 6 scenarios - Verified 2x speed-up and 2x slow-down reset tricks work perfectly - All tests pass (100% success rate) Technical Details: - Spectrograms remain unchanged (no pitch shift) - Only trigger timing affected (when patterns fire) - Delta time calculated per frame: dt = current_time - last_time - Music time accumulates: music_time += dt * tempo_scale - tempo_scale=1.0 → normal speed (default) - tempo_scale=2.0 → 2x faster triggering - tempo_scale=0.5 → 2x slower triggering Test Coverage: 1. Basic tempo scaling (1.0x, 2.0x, 0.5x) 2. 2x speed-up reset trick (accelerate to 2.0x, reset to 1.0x) 3. 2x slow-down reset trick (decelerate to 0.5x, reset to 1.0x) 4. Pattern density swap at reset points 5. Continuous acceleration (0.5x to 2.0x over 10s) 6. Oscillating tempo (sine wave modulation) Test Results: - After 5s physical at 2.0x tempo: music_time=7.550s (expected ~7.5s) ✓ - Reset to 1.0x, advance 2s: music_time delta=2.000s (expected ~2.0s) ✓ - Slow-down reset: music_time delta=2.000s (expected ~2.0s) ✓ Enables future dynamic tempo control without modifying synthesis engine. handoff(Claude): Variable tempo system complete and verified Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
20 hours	feat(audio): Tracker timing test suite (Tasks #51.3 & #51.4)	skal
	Comprehensive tracker timing verification using MockAudioBackend. Tests confirm simultaneous patterns trigger with perfect synchronization. Changes: - Created test_tracker_timing.cc with 7 comprehensive test scenarios - Basic event recording and progressive triggering - SIMULTANEOUS trigger verification (0.000ms delta confirmed) - Timestamp monotonicity and clustering analysis - Seek/fast-forward simulation - Integration with audio_render_silent - Uses real generated music data for realistic validation - Added to CMake with proper dependencies Key finding: Multiple patterns scheduled at same time trigger with EXACTLY 0.000ms delta, confirming perfect audio synchronization. All 15 tests pass (100% success rate). handoff(Claude): Task #51 complete, tracker timing fully verified Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
20 hours	feat(audio): Implement mock audio backend for testing (Task #51.2)	skal
	Created MockAudioBackend for deterministic audio event recording and timing verification. Enables robust tracker synchronization testing. Changes: - Created VoiceTriggerEvent structure (timestamp, spec_id, volume, pan) - Implemented MockAudioBackend with event recording capabilities - Added time tracking: manual (advance_time) and automatic (on_frames_rendered) - Created test_mock_backend.cc with 6 comprehensive test scenarios - Verified synth integration and audio_render_silent compatibility - Added to CMake test builds All test infrastructure guarded by #if !defined(STRIP_ALL). Zero size impact on production build. All 14 tests pass. handoff(Claude): Task #51.2 complete, mock backend ready for tracker tests Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
20 hours	feat(audio): Implement audio backend abstraction (Task #51.1)	skal
	Created interface-based audio backend system to enable testing without hardware. This is the foundation for robust tracker timing verification. Changes: - Created AudioBackend interface with init/start/shutdown methods - Added test-only hooks: on_voice_triggered() and on_frames_rendered() - Moved miniaudio implementation to MiniaudioBackend class - Refactored audio.cc to use backend abstraction with auto-fallback - Added time tracking to synth.cc (elapsed time from rendered frames) - Created test_audio_backend.cc to verify backend injection works - Fixed audio test linking to include util/procedural dependencies All test infrastructure guarded by #if !defined(STRIP_ALL) for zero size impact on final build. Production path unchanged, 100% backward compatible. All 13 tests pass. handoff(Claude): Task #51.1 complete, audio backend abstraction ready Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
21 hours	docs: Update project context and state for handoff	skal

21 hours	feat(gpu): Implement recursive WGSL composition and modularize shaders (Task ↵	skal
	#50) - Updated ShaderComposer to support recursive #include "snippet_name" with cycle detection. - Extracted granular WGSL snippets: math/sdf_shapes, math/sdf_utils, render/shadows, render/scene_query, render/lighting_utils. - Refactored Renderer3D to use #include in shaders, simplifying C++ dependency lists. - Fixed WGPUShaderSourceWGSL usage on macOS to correctly handle composed shader strings. - Added comprehensive unit tests for recursive composition in test_shader_composer. - Verified system stability with test_3d_render and full test suite. - Marked Task #50 as recurrent for future code hygiene.
21 hours	docs(3d): Plan BVH, Physics, and WGSL modularization (Task #49, #50)	skal
	- Added detailed design for dynamic BVH and GPU traversal in 3D.md. - Outlined SDF-based collision detection and semi-implicit Euler physics loop. - Updated TODO.md with atomic tasks for physics implementation and granular WGSL refactoring.
22 hours	test(coverage): Improve Audio coverage (Task #48)	skal
	Added unit tests for DCT and procedural audio generation. Enhanced synth tests to cover rendering and resource management. Audio subsystem coverage increased to 93%.
22 hours	test(coverage): Improve Asset Manager coverage (Task #47)	skal
	Added tests for runtime error handling in Asset Manager (unknown function, generation failure). Updated asset_packer to warn instead of fail on unknown functions to facilitate testing. Increased coverage from 71% to 88%.
22 hours	feat(tooling): Add directory filtering to coverage report script (Task #46)	skal
	Updated gen_coverage_report.sh to accept an optional argument for targeting specific directories using lcov --extract.
22 hours	test(procedural): Improve test coverage (Task #45)	skal
	Added tests for gen_perlin and make_periodic. Improved parameter handling checks. Coverage for src/procedural/generator.cc increased to 96%.
23 hours	feat(tooling): Implement code coverage reporting (Task #44)	skal
	Added CMake support for coverage builds and a script to generate HTML reports using lcov on macOS. Also cleaned up .gitignore.
23 hours	add a TODO about coverage script	skal

23 hours	handoff(Claude): Stabilize 3D renderer with rotating skybox and two-pass ↵	skal
	architecture - Fixed black screen by ensuring clear operations in Pass 2 when Skybox pass is skipped. - Resolved WebGPU validation errors by synchronizing depth-stencil state. - Implemented rotating skybox using world-space ray unprojection (inv_view_proj). - Improved procedural noise generation (multi-octave Value Noise). - Restored scene integrity by correcting object indexing and removing artifacts. - Updated documentation (TODO.md, PROJECT_CONTEXT.md).
38 hours	docs: number all tasks for reference	skal
	Assigned reference numbers to all remaining tasks in documentation: - Task #34: Full STL Removal - Task #35: CRT Replacement - Task #36: Blender Exporter - Task #37: Asset Ingestion - Task #38: Runtime Loader - Task #39: Visual Debugging System - Task #40: Advanced Lighting & Transparency - Task #41: Spectrogram Editor HTML Tool - Task #42: Vectorial Spectrogram Reader (C++) - Task #43: Spectrogram Drawing Bricks Ensured consistent task numbering across PROJECT_CONTEXT.md and TODO.md.
38 hours	docs: defer full STL removal to Phase 2	skal
	Lowered the priority of the 'replace STL' task. It will be addressed in the final optimization phase (Phase 2) to simplify current development. Hot paths in AssetManager and Procedural remain optimized. handoff(Gemini): STL usage is now permitted for non-critical paths until the final optimization phase. PROJECT_CONTEXT.md and TODO.md updated accordingly.
38 hours	refactor: Task #20 - Platform & Code Hygiene	skal
	- Consolidated all WebGPU shims and platform-specific logic into src/platform.h. - Refactored platform_init to return PlatformState by value and platform_poll to automatically refresh time and aspect_ratio. - Removed STL dependencies (std::map, std::vector, std::string) from AssetManager and Procedural subsystems. - Fixed Windows cross-compilation by adjusting include paths and linker flags in CMakeLists.txt and updating build_win.sh. - Removed redundant direct inclusions of GLFW/glfw3.h and WebGPU headers across the project. - Applied clang-format and updated documentation. handoff(Gemini): Completed Task #20 and 20.1. Platform abstraction is now unified, and core paths are STL-free. Windows build is stable.
44 hours	feat(audio): Fix tracker bugs and implement rock demo track	skal
	Critical Bug Fixes: - Fixed pool exhaustion: Tracker slots never freed after use, music stopped after 8 patterns. Implemented round-robin allocation with cleanup. - Fixed note name parsing: Added automatic note-to-frequency conversion in tracker_compiler. Bass and melody now play correctly. - Fixed timing mismatch: Patterns are 2 seconds but triggered every 4 seconds, causing silence gaps. Updated SCORE to trigger every 2 seconds. Improvements: - Implemented dynamic resource sizing in tracker_compiler: Analyzes score to determine optimal MAX_VOICES/MAX_SPECTROGRAMS values. - Created comprehensive rock track: 11 patterns with drums, bass, power chords, and lead melody over 25 seconds. - Added 213 lines of asset system documentation with 8 prioritized tasks. Known Issues for next session: - Audio quality could be improved (some artifacts remain) - Note synthesis uses default parameters, needs tuning - Pattern overlaps might cause voice exhaustion under heavy load Files Changed: - src/audio/tracker.cc: Round-robin pool allocation, cleanup logic - tools/tracker_compiler.cc: Note name parser, resource usage analysis - src/audio/synth.h: Increased limits to 16 based on analysis - assets/music.track: 230-line rock arrangement - doc/ASSET_SYSTEM.md: Comprehensive documentation + 8 tasks - TODO.md: Updated with recent completions and known issues handoff(Gemini): Music system now functional but needs quality improvements. Audio artifacts and synthesis tuning remain. See TODO.md for details. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
46 hours	docs: Finalize documentation and store project statev0.1	skal
	Consolidated 'Recently Completed' sections in PROJECT_CONTEXT.md and TODO.md. Verified all recent tasks (Build System, Asset Pipeline, Shader Testing) are correctly recorded. Making a final commit to preserve current progress before moving to Platform Hygiene.
46 hours	test(shader): Add ShaderComposer and WGSL asset validation tests (Task #26)	skal
	Implemented comprehensive unit tests for ShaderComposer and a validation test for production WGSL shader assets. This ensures the shader asset pipeline is robust and that all shaders contain required entry points and snippets. Also improved InitShaderComposer to be more robust during testing.
47 hours	docs: Add sub-task for Shader Asset Testing & Validation (Task #26)	skal
	Added a new sub-task to the project roadmap for developing comprehensive tests for ShaderComposer and WGSL shader code assets. This will ensure robustness and correctness of the shader asset pipeline.
47 hours	docs: Update project status and task lists	skal
	Updated PROJECT_CONTEXT.md and TODO.md to reflect the completion of the asset conversion sub-task and the build system consolidation (Task #25).
47 hours	chore: Finalize Build System Consolidation (Task #25)	skal
	Updated project roadmap and to-do list to reflect the completion of the modular build system refactor.
48 hours	refactor(build): Modularize build system with static libraries	skal
	Completed the first part of Task #25. Created static libraries for each subsystem (audio, gpu, 3d, util, procedural) and refactored all executables to link against them. This improves modularity and simplifies the build process. Also fixed linker errors related to glfw, wgpu, and miniaudio.
2 days	docs: Mark Shader Asset Integration (Task #24) as completed	skal
	Updates status in PROJECT_CONTEXT.md and TODO.md.
2 days	docs: Plan Shader Asset Integration (Task #24)	skal
	Updates ASSET_SYSTEM.md to describe shader asset handling. Adds Task #24 to TODO.md and PROJECT_CONTEXT.md to extract hardcoded shaders and integrate them with the AssetManager and ShaderComposer.
2 days	docs: Update project context and re-prioritize task list	skal
	This commit finalizes the session by updating the project documentation to reflect recent progress and future priorities. - Recently Completed: Summarized the finalization of the audio tracker, implementation of build stripping (STRIP_ALL), and resolution of WebGPU stability issues on macOS. - Re-prioritization: Promoted 'Platform & Code Hygiene' (Task #20) to Priority 1 and established '3D System Enhancements' (Task #18) as Priority 2, focusing on Blender integration. - Session Summary: Appended a detailed summary of the session's key achievements to SESSION_NOTES.md.
2 days	docs: Update TODO.md with tracker asset sample integration progress	skal

2 days	docs: Update TODO.md with completed Minimal Audio Tracker task	skal

3 days	fix TODO.md	skal

3 days	docs: Clean up TODO.md to reflect completed shader optimization attack plans	skal

3 days	update TODO and fix shaders.cc	skal

3 days	docs: Update TODO.md and PROJECT_CONTEXT.md after completing shader ↵	skal
	optimization tasks
3 days	docs: Mark SDF Macros attack plan as completed in TODO.md	skal

3 days	chore: Add BUILD.md, Task 23 to TODO.md, and GPU perf define placeholder	skal

3 days	docs: Finalize session task tracking and project context	skal

3 days	docs: Record Task 21.2 completion and update session priorities	skal

3 days	docs: Prioritize next session tasks and update project context	skal
	- Consolidated recent 3D and High-DPI fixes into PROJECT_CONTEXT.md. - Generated a prioritized task list in TODO.md with detailed attack plans. - Moved completed tasks to the 'Recently Completed' section. - Set up roadmap for Task #8 (Stripping), Task #20 (Code Hygiene), and Task #21 (Shader Optimization).
3 days	more sub-tasks	skal

3 days	docs: Finalize session state in TODO.md with unified SDF shadow fix details	skal

3 days	flesh out extra details in the MD files	skal

3 days	docs: Update TODO.md with recent bug fixes and formatting pass	skal

3 days	tune TODO and PROJECT_CONTEXT with new micro-tasks	skal

3 days	feat(3d): Implement scene query shadows (POC)	skal
	- Updated Renderer3D shader to include 'map_scene' and 'calc_shadow' functions. - Shader now iterates over all objects (up to kMaxObjects) to evaluate the scene SDF globally. - Implemented hard/soft shadows from a fixed directional light. - Updated GlobalUniforms struct with proper packing/padding for WebGPU compatibility. - Captured 'GPU BVH & Shadows' task in PROJECT_CONTEXT.md for future optimization.
3 days	add new tasks	skal

3 days	docs(todo): Add README quick start task	skal
	- Incorporated the new task to add a 'Quick Start' section to README.md into the 'Next Up' section of TODO.md as Task #19.
3 days	docs: Deprioritize Linux cross-compilation (Task #4a)	skal
	- Moved Task #4a from TODO.md (Next Up) to PROJECT_CONTEXT.md (Future Optimizations). - This reflects its current status as a lower-priority, long-term goal.
3 days	docs(todo): Archive completed tasks #4b and #10	skal
	- Moved the descriptions for tasks #4b (check_all script) and #10 (spectool optimization) to the 'Past Tasks' section in TODO.md. - This adheres to the rule of archiving completed tasks to keep the 'Next Up' list focused.