Terra Tones: The Nature Sonification Engine

Описание: Terra Tones: The Nature Sonification Engine
https://www.seanpeoples.me/terra-tones

Turn organic motion into generative music.
Terra Tones is an audio-first analysis system that transforms video data into a musical score in real-time. By scanning visual motion within a digital grid, the tool translates the kinetic energy of nature—falling rain, rushing water, striking lightning—into a rhythmic, generative soundscape.
It is not a video player; it is an instrument where nature is the musician.
🎛 How It Works
The application overlays a 16x12 sensory grid onto the video feed. It analyzes the luminance and velocity of pixels within each cell 60 times per second.
Motion Detection: When movement (like a bird flying or a leaf trembling) crosses a cell, it triggers a "voice."
Pitch Mapping: Vertical position determines pitch. Higher movement triggers higher notes; lower movement triggers bass tones. All notes are quantized to a C Minor Pentatonic scale, ensuring that no matter how chaotic the video, the result is always musical and harmonic.
Velocity: The speed and intensity of the visual motion control the volume and attack of the sound.
🚀 Key Features
Signal Bank (Presets & Upload):
Start immediately with the curated library of nature loops (Birds, Lightning, Leaves, Lava, etc.).
Bring Your Own Signal: Use the [ ↑ UPLOAD ] button to sonify your own videos. Try it with footage of traffic, ocean waves, or even a webcam feed to hear what your environment sounds like.
Instrument Palette:
Choose from 9 distinct synthesis engines, including Analog Synth, FM Bells, Deep Bass, Marimba, and a Rhythm Grid that turns motion into percussion.
Generative Modifiers:
Bio-Chaos: Introduces random probability to the trigger algorithm, creating unpredictable, evolving textures.
Harmonic Drift: Applies subtle, tape-style detuning and pitch wobbles for a nostalgic, organic feel.
Effects Chain:
Shape the sound with a studio-grade effects rack including Reverb, Delay, Low-Pass Filter, and Distortion.
🕹 Quick Start Guide
Select a Signal: Click a preset like "RAIN" or upload your own video.
Set Sensitivity: This is the most important control.
High Sensitivity: Creates a wall of sound (good for subtle motion like clouds).
Low Sensitivity: Picks out specific accents (good for high-contrast motion like lightning).
Choose a Voice: Swap between "Bells" for a meditative vibe or "Drums" to hear the rhythm of the video.
Experiment: Slow down the playback speed to stretch the sound, or increase "Bio-Chaos" to let the machine improvise along with the video.
💡 Why Use It?
For Meditation: Create an endless, non-looping ambient background track that is visually and aurally hypnotic.
For Sound Design: Generate unique, organic textures that are impossible to program by hand.
For Exploration: Discover the hidden rhythms in your own video clips.
Built with React and the Web Audio API. No external samples—all audio is synthesized live in the browser.