Tolqyn
FlagshipWorking PrototypeCreative CodingAI Experiment
Verified summary
Audio-responsive generative visual system in Processing P3D with sensor-influenced node behavior.
Problem or experiment question
How can live audio, camera motion, and gyroscope input shape a real-time generative visual field?
What was actually built
- Processing P3D sketch with approximately 3,000 visual nodes and edge relationships
- FFT analysis and beat detection driving procedural musical behavior
- Webcam frame-difference centroid and gyroscope input
- Camera/orientation fusion with UDP/serial interaction paths
Architecture or workflow
- Input layer: audio FFT, webcam motion, gyroscope
- Graph layer: nodes and edges with generative updates
- Output layer: real-time P3D rendering
Important technical decisions
- Monolithic P3D sketch keeps the experiment self-contained
- Beat detection triggers procedural note behavior
- Multi-source fusion prioritizes expressive output over modular services