
I created an audiovisual installation by gradually adding electronic components and programming skills. Starting with simple codes, I progressed to using sensors such as ultrasonic sensor HC-SR04 and MPU6050 gyroscope, which provided seven different values. I mapped values from each axis to sound waves and added potentiometers to control the volume of each wave and buttons to play chords. Corresponding LEDs light up with each musical note, driven by the buttons, and the ultrasonic sensor controls the frequency of four sawtooth waves.
I created an algorithm that uses audio frequencies to change parameters of visual objects. I used two songs and the fiddle~ object to obtain pitch and amplitude data. For visuals, I experimented with different shapes and colors for different frequencies. I discovered that overlapping low-transparency colors creates dynamic patterns and shapes, especially during the song's drop. The video has two parts, both with similar objects and colors driven by frequencies. I overcame timing issues by creating a clock using a metro and counter. The if then object sends bangs to ggate objects when the counters reach a particular count, and counters are reset to prevent unwanted triggers.
