GENERATIVE SYNESTHESIA

As a group, our journey into generative aesthetics, inspired by the intriguing connections between synesthesia and music, began with a shared passion for music and live visualizations. We set out to create a code that could dynamically respond to musicians playing instruments in real-time, offering a live visual representation of the unique character of their music. Drawing inspiration from chromesthesia, a fascinating form of synesthesia where non-visual stimuli evoke vivid visual experiences, we found ourselves particularly inspired by the works of interdisciplinary artist Timothy Layden. His exploration in "The Shapes of Sound" resonated deeply with our vision, showcasing how the invisible realm of sound can manifest visually through a fusion of senses.

To bring our vision to life, we tinkered with variables, amplifying the sensitivity of sound collection. The brightness of particles shifted with sound amplitude, and as the number of inputs increased, lines transformed into dense particles or dots.
We discovered that when the sound was clear and condensed, particles naturally coalesced into intricate patterns.

Initially, we aimed to create a visual akin to smoke particles, dynamically reacting to the volume and pitch of the background music, aligning with the visual aesthetics
of synesthesia. While our particle system responded to volume and pitch, merging
it with the position adjustment proved challenging due to the differing systems
of FFT analysis and amplitude detection.

For the final display, we merged two visuals, each with distinct colours and sensitivities to sounds, crafting an immersive audio-visual experience. Collaborating with our friend Jarrett, who lent his guitar skills to provide live input for the code, added a layer of authenticity to our project.

Experimenting with three songs spanning different genres—ranging from the softer, slower tones of "Somebody Else" by The 1975 to the louder, rock-infused melodies of "Stairway to Heaven" by Led Zeppelin and "Comfortably Numb" by Pink Floyd—allowed us to showcase the versatility of our creation.

We meticulously adjusted the colors of our code to match the mood and energy of each song, culminating in outcomes that exceeded our expectations.

Somebody Else - The 1975

Final display

Stairway to Heaven - Led Zeppelin

Final display

Comfortably Numb - Pink Floyd

Final display

Somebody Else - The 1975

Final display

Our project stands as a testament to the powerful synergy between art, technology,
and sensory perception, bridging the gap between sound and sight in a
mesmerizing exploration of generative aesthetics.

↑BACK TO TOP