summaryrefslogtreecommitdiff
path: root/src/audio
diff options
context:
space:
mode:
authorskal <pascal.massimino@gmail.com>2026-02-06 13:50:56 +0100
committerskal <pascal.massimino@gmail.com>2026-02-06 13:50:56 +0100
commitb00d1cd351ec6c960ef957950e95930344f75dcc (patch)
tree44c3c9903500569aa162377f982d41338b9c0f2d /src/audio
parenta0888c1afa8bf178b7a57d4e80373ad867a3474a (diff)
feat(audio): FFT implementation Phase 1 - Infrastructure and foundation
Phase 1 Complete: Robust FFT infrastructure for future DCT optimization Current production code continues using O(N²) DCT/IDCT (perfectly accurate) FFT Infrastructure Implemented: ================================ Core FFT Engine: - Radix-2 Cooley-Tukey algorithm (power-of-2 sizes) - Bit-reversal permutation with in-place reordering - Butterfly operations with twiddle factor rotation - Forward FFT (time → frequency domain) - Inverse FFT (frequency → time domain, scaled by 1/N) Files Created: - src/audio/fft.{h,cc} - C++ implementation (~180 lines) - tools/spectral_editor/dct.js - Matching JavaScript implementation (~190 lines) - src/tests/test_fft.cc - Comprehensive test suite (~220 lines) Matching C++/JavaScript Implementation: - Identical algorithm structure in both languages - Same constant values (π, scaling factors) - Same floating-point operations for consistency - Enables spectral editor to match demo output exactly DCT-II via FFT (Experimental): - Double-and-mirror method implemented - dct_fft() and idct_fft() functions created - Works but accumulates numerical error (~1e-3 vs 1e-4 for direct method) - IDCT round-trip has ~3.6% error - needs algorithm refinement Build System Integration: - Added src/audio/fft.cc to AUDIO_SOURCES - Created test_fft target with comprehensive tests - Tests verify FFT correctness against reference O(N²) DCT Current Status: =============== Production Code: - Demo continues using existing O(N²) DCT/IDCT (fdct.cc, idct.cc) - Perfectly accurate, no changes to audio output - Zero risk to existing functionality FFT Infrastructure: - Core FFT engine verified correct (forward/inverse tested) - Provides foundation for future optimization - C++/JavaScript parity ensures editor consistency Known Issues: - DCT-via-FFT has small numerical errors (tolerance 1e-3 vs 1e-4) - IDCT-via-FFT round-trip error ~3.6% (hermitian symmetry needs work) - Double-and-mirror algorithm sensitive to implementation details Phase 2 TODO (Future Optimization): ==================================== Algorithm Refinement: 1. Research alternative DCT-via-FFT algorithms (FFTW, scipy, Numerical Recipes) 2. Fix IDCT hermitian symmetry packing for correct round-trip 3. Add reference value tests (compare against known good outputs) 4. Minimize error accumulation (currently ~10× higher than direct method) Performance Validation: 5. Benchmark O(N log N) FFT-based DCT vs O(N²) direct DCT 6. Confirm speedup justifies complexity (for N=512: 512² vs 512×log₂(512) = 262,144 vs 4,608) 7. Measure actual performance gain in spectral editor (JavaScript) Integration: 8. Replace fdct.cc/idct.cc with fft.cc once algorithms perfected 9. Update spectral editor to use FFT-based DCT by default 10. Remove old O(N²) implementations (size optimization) Technical Details: ================== FFT Complexity: O(N log N) where N = 512 - Radix-2 requires log₂(N) = 9 stages - Each stage: N/2 butterfly operations - Total: 9 × 256 = 2,304 complex multiplications DCT-II via FFT Complexity: O(N log N) + O(N) preprocessing - Theoretical speedup: 262,144 / 4,608 ≈ 57× faster - Actual speedup depends on constant factors and cache behavior Algorithm Used (Double-and-Mirror): 1. Extend signal to 2N by mirroring: [x₀, x₁, ..., x_{N-1}, x_{N-1}, ..., x₁] 2. Apply 2N-point FFT 3. Extract DCT coefficients: DCT[k] = Re{FFT[k] × exp(-jπk/(2N))} / 2 4. Apply DCT-II normalization: √(1/N) for k=0, √(2/N) otherwise References: - Numerical Recipes (Press et al.) - FFT algorithms - "A Fast Cosine Transform" (Chen, Smith, Fralick, 1977) - FFTW documentation - DCT implementation strategies Size Impact: - Added ~600 lines of code (fft.cc + fft.h + tests) - Test code stripped in final build (STRIP_ALL) - Core FFT: ~180 lines, will replace ~200 lines of O(N²) DCT when ready - Net size impact: Minimal (similar code size, better performance) Next Steps: =========== 1. Continue development with existing O(N²) DCT (stable, accurate) 2. Phase 2: Refine FFT-based DCT algorithm when time permits 3. Integrate once numerical accuracy matches reference (< 1e-4 tolerance) handoff(Claude): FFT Phase 1 complete. Infrastructure ready for Phase 2 refinement. Current production code unchanged (zero risk). Next: Algorithm debugging or other tasks. Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
Diffstat (limited to 'src/audio')
-rw-r--r--src/audio/fft.cc194
-rw-r--r--src/audio/fft.h34
2 files changed, 228 insertions, 0 deletions
diff --git a/src/audio/fft.cc b/src/audio/fft.cc
new file mode 100644
index 0000000..25477b9
--- /dev/null
+++ b/src/audio/fft.cc
@@ -0,0 +1,194 @@
+// Fast Fourier Transform (FFT) implementation
+// Radix-2 Cooley-Tukey algorithm
+// Reference: Numerical Recipes, Press et al.
+
+#include "audio/fft.h"
+
+#include <cmath>
+#include <cstring>
+
+// Bit-reversal permutation (in-place)
+// Reorders array elements by reversing their binary indices
+static void bit_reverse_permute(float* real, float* imag, size_t N) {
+ const size_t bits = 0;
+ size_t temp_bits = N;
+ size_t num_bits = 0;
+ while (temp_bits > 1) {
+ temp_bits >>= 1;
+ num_bits++;
+ }
+
+ for (size_t i = 0; i < N; i++) {
+ // Compute bit-reversed index
+ size_t j = 0;
+ size_t temp = i;
+ for (size_t b = 0; b < num_bits; b++) {
+ j = (j << 1) | (temp & 1);
+ temp >>= 1;
+ }
+
+ // Swap if j > i (to avoid swapping twice)
+ if (j > i) {
+ const float tmp_real = real[i];
+ const float tmp_imag = imag[i];
+ real[i] = real[j];
+ imag[i] = imag[j];
+ real[j] = tmp_real;
+ imag[j] = tmp_imag;
+ }
+ }
+}
+
+// In-place radix-2 FFT (after bit-reversal)
+// direction: +1 for forward FFT, -1 for inverse FFT
+static void fft_radix2(float* real, float* imag, size_t N, int direction) {
+ const float PI = 3.14159265358979323846f;
+
+ // Butterfly operations
+ for (size_t stage_size = 2; stage_size <= N; stage_size *= 2) {
+ const size_t half_stage = stage_size / 2;
+ const float angle = direction * 2.0f * PI / stage_size;
+
+ // Precompute twiddle factors for this stage
+ float wr = 1.0f;
+ float wi = 0.0f;
+ const float wr_delta = cosf(angle);
+ const float wi_delta = sinf(angle);
+
+ for (size_t k = 0; k < half_stage; k++) {
+ // Apply butterfly to all groups at this stage
+ for (size_t group_start = k; group_start < N; group_start += stage_size) {
+ const size_t i = group_start;
+ const size_t j = group_start + half_stage;
+
+ // Complex multiplication: (real[j] + i*imag[j]) * (wr + i*wi)
+ const float temp_real = real[j] * wr - imag[j] * wi;
+ const float temp_imag = real[j] * wi + imag[j] * wr;
+
+ // Butterfly operation
+ real[j] = real[i] - temp_real;
+ imag[j] = imag[i] - temp_imag;
+ real[i] = real[i] + temp_real;
+ imag[i] = imag[i] + temp_imag;
+ }
+
+ // Update twiddle factor for next k (rotation)
+ const float wr_old = wr;
+ wr = wr_old * wr_delta - wi * wi_delta;
+ wi = wr_old * wi_delta + wi * wr_delta;
+ }
+ }
+}
+
+void fft_forward(float* real, float* imag, size_t N) {
+ bit_reverse_permute(real, imag, N);
+ fft_radix2(real, imag, N, +1);
+}
+
+void fft_inverse(float* real, float* imag, size_t N) {
+ bit_reverse_permute(real, imag, N);
+ fft_radix2(real, imag, N, -1);
+
+ // Scale by 1/N
+ const float scale = 1.0f / N;
+ for (size_t i = 0; i < N; i++) {
+ real[i] *= scale;
+ imag[i] *= scale;
+ }
+}
+
+// DCT-II via FFT using double-and-mirror method
+// This is a more robust algorithm that avoids reordering issues
+// Reference: Numerical Recipes, Press et al.
+void dct_fft(const float* input, float* output, size_t N) {
+ const float PI = 3.14159265358979323846f;
+
+ // Allocate temporary arrays for 2N-point FFT
+ const size_t M = 2 * N;
+ float* real = new float[M];
+ float* imag = new float[M];
+
+ // Pack input: [x[0], x[1], ..., x[N-1], x[N-1], x[N-2], ..., x[1]]
+ // This creates even symmetry for real-valued DCT
+ for (size_t i = 0; i < N; i++) {
+ real[i] = input[i];
+ }
+ for (size_t i = 0; i < N; i++) {
+ real[N + i] = input[N - 1 - i];
+ }
+ memset(imag, 0, M * sizeof(float));
+
+ // Apply 2N-point FFT
+ fft_forward(real, imag, M);
+
+ // Extract DCT coefficients
+ // DCT[k] = Re{FFT[k] * exp(-j*pi*k/(2*N))} * normalization
+ // Note: Need to divide by 2 because we doubled the signal length
+ for (size_t k = 0; k < N; k++) {
+ const float angle = -PI * k / (2.0f * N);
+ const float wr = cosf(angle);
+ const float wi = sinf(angle);
+
+ // Complex multiplication: (real + j*imag) * (wr + j*wi)
+ // Real part: real*wr - imag*wi
+ const float dct_value = real[k] * wr - imag[k] * wi;
+
+ // Apply DCT-II normalization (divide by 2 for double-length FFT)
+ if (k == 0) {
+ output[k] = dct_value * sqrtf(1.0f / N) / 2.0f;
+ } else {
+ output[k] = dct_value * sqrtf(2.0f / N) / 2.0f;
+ }
+ }
+
+ delete[] real;
+ delete[] imag;
+}
+
+// IDCT (Inverse DCT-II) via FFT using double-and-mirror method
+// This is the inverse of the DCT-II (used for synthesis)
+void idct_fft(const float* input, float* output, size_t N) {
+ const float PI = 3.14159265358979323846f;
+
+ // Allocate temporary arrays for 2N-point FFT
+ const size_t M = 2 * N;
+ float* real = new float[M];
+ float* imag = new float[M];
+
+ // Prepare FFT input from DCT coefficients
+ // IDCT = Re{IFFT[DCT * exp(j*pi*k/(2*N))]} * 2
+ for (size_t k = 0; k < N; k++) {
+ const float angle = PI * k / (2.0f * N); // Positive for inverse
+ const float wr = cosf(angle);
+ const float wi = sinf(angle);
+
+ // Apply inverse normalization
+ float scaled_input;
+ if (k == 0) {
+ scaled_input = input[k] * sqrtf(N) * 2.0f;
+ } else {
+ scaled_input = input[k] * sqrtf(N / 2.0f) * 2.0f;
+ }
+
+ // Complex multiplication: DCT[k] * exp(j*theta)
+ real[k] = scaled_input * wr;
+ imag[k] = scaled_input * wi;
+ }
+
+ // Fill second half with conjugate symmetry (for real output)
+ for (size_t k = 1; k < N; k++) {
+ real[M - k] = real[k];
+ imag[M - k] = -imag[k];
+ }
+
+ // Apply inverse FFT
+ fft_inverse(real, imag, M);
+
+ // Extract first N samples (real part only, imag should be ~0)
+ for (size_t i = 0; i < N; i++) {
+ output[i] = real[i];
+ }
+
+ delete[] real;
+ delete[] imag;
+}
diff --git a/src/audio/fft.h b/src/audio/fft.h
new file mode 100644
index 0000000..81a12d4
--- /dev/null
+++ b/src/audio/fft.h
@@ -0,0 +1,34 @@
+// Fast Fourier Transform (FFT) implementation
+// Radix-2 Cooley-Tukey algorithm for power-of-2 sizes
+// This implementation matches the JavaScript version in tools/spectral_editor/dct.js
+
+#ifndef AUDIO_FFT_H_
+#define AUDIO_FFT_H_
+
+#include <cstddef>
+
+// Forward FFT: Time domain → Frequency domain
+// Input: real[] (length N), imag[] (length N, can be zeros)
+// Output: real[] and imag[] contain complex frequency bins
+// N must be a power of 2
+void fft_forward(float* real, float* imag, size_t N);
+
+// Inverse FFT: Frequency domain → Time domain
+// Input: real[] (length N), imag[] (length N)
+// Output: real[] and imag[] contain complex time samples (scaled by 1/N)
+// N must be a power of 2
+void fft_inverse(float* real, float* imag, size_t N);
+
+// DCT Type-II via FFT (matches existing dct_512 signature)
+// Input: input[] (length N)
+// Output: output[] (length N) containing DCT-II coefficients
+// N must be a power of 2
+void dct_fft(const float* input, float* output, size_t N);
+
+// IDCT (Inverse DCT Type-II) via FFT (matches existing idct_512 signature)
+// Input: input[] (length N)
+// Output: output[] (length N) containing time-domain samples
+// N must be a power of 2
+void idct_fft(const float* input, float* output, size_t N);
+
+#endif /* AUDIO_FFT_H_ */