Rong Shi

Statement of Symphony of the Cosmos: Explorations on Planetary Molecular Music, June 2023

Rong Shi's "Symphony of the Cosmos: Explorations on Planetary Molecular Music" project delves into the profound interplay between the universe and sound, enveloping audiences in multi-sensory experiences while unearthing the captivating melodies of the solar system's eight planets.

"Symphony of the Cosmos" consist of an immersive audio-visual experience and an interactive installation. The moving image showcases a fusion of motion images and synchronised sound, projected onto the "Molecular Symphony Orchestra" installation. In the interactive portion, the audience is invited to select a planet to position at the centre of the installation. By utilising a pressure sensor, they can then trigger vibrations in the surrounding chemical element balls. Each of the 8 planets corresponds to 18 chemical element balls, generating a symphony of vibrations. Concurrently, the visual representation of the chosen planet's vibration is projected throughout the entire space.

Throughout this process, the audience assumes the role of conductor, empowering a specific planet to lead the "molecular symphony orchestra" and convey performance instructions to the entire ensemble at any given moment. The 18 surrounding chemical element balls act as players, continuously vibrating and producing a harmonious yet resonant ensemble until the planet is changed.

Through the art of data sonification, Shi composes a symphony that resonates with the molecular harmonies of our celestial neighbours. By meticulously collecting the chemical compositions to get the spectral data of each planet, Shi unveils the frequencies of molecular vibrations. With deftness and creativity, these frequencies are transmuted into pitch and volume using the visual programming language, birthing a distinct "Molecular Music" for each planetary element. Through projection, the installation creates dynamic images that map the entire space into a molecular core resembling a planet. The visual experience constantly evolves, mirroring the molecular vibrations through a captivating display of sine wave patterns. 

Statement of Data Sonification of Symphony of the Cosmos, December 2022

This project begins with the question of what the universe sounds like. By understanding that sound is the combination of vibrations at different frequencies, the project aims to capture the essence of sound in the cosmos. The vibrations of chemical elements create distinct sounds, and by determining the vibration frequencies of each chemical component on different planets, the project seeks to recreate their unique sounds.

The process of data sonification involved collecting data for each chemical component and calculating the frequency of molecular vibrations based on that data. Collaborating with Dr. Wen from Imperial College London, I obtained spectral data pertaining to diverse chemical compositions. With his assistance, I conducted calculations to determine the frequencies of molecular vibrations. However, the vibrations of these molecules occurred at such rapid and high rates that they were imperceptible to the human ear. To overcome this limitation, I scaled down the frequencies to an audible range, enabling me to extract the necessary data.

The project then mapped these molecular vibrations to pitch and volume, converting the data into audible sine waves. The objective was to faithfully represent the true nature of each planet's sound and ensure that the mapping process was devoid of human subjectivity.

To facilitate the mapping process, I employed Pure Data, a visual programming language for generating interactive computer sounds. Taking Mercury as an illustration, I associated its frequency with pitch and its proportion with volume. As an instance, if the molecular frequency of oxygen measures 466.8Hz, with a proportion of 42 percent, the corresponding pitch would be set at 466.8Hz, while the volume would be adjusted to 42 percent. Employing this approach consistently, I created distinct sound channels for each chemical constituent present in Mercury, eventually amalgamating them to unveil the captivating auditory experience termed as the "Sound of Mercury.

I received a gracious invitation from Juice, the Curator of Sound Design at the University of the Arts London, to contribute to the Polyphonic exhibition held at the Crypt Gallery in London. 

Within this space, visitors were treated to a multisensory experience that combined auditory and visual elements. Using my molecular music, I crafted a soundscape that harmoniously blended with visual projections. The result was an immersive environment where sound and visuals seamlessly intertwined, captivating the senses and transporting the audience to a realm where molecular compositions came to life.

By participating in the Polyphonic exhibition, I aimed to enrich the artistic landscape by offering a unique fusion of molecular music and audiovisual projections. The immersive audiovisual projection space provided visitors with an extraordinary opportunity to engage with the interplay of sound and visuals, creating a truly unforgettable experience within the hallowed halls of the Crypt Gallery.

Statement of Symphony of the Cosmos Performance at Kensington Theatre, March 2023

In March 2023, I had the opportunity to showcase my work in a live performance called the Murmation Show, hosted at the Kensington Theatre. My aim was to ensure that the audience truly grasped the essence of my creation, so I integrated the programming aspects directly into the performance itself. By revealing the intricacies of my programming techniques during the show, I provided a glimpse into the inner workings of my artistic process.

To further enhance engagement and foster a sense of participation, I actively encouraged audience involvement throughout the performance. This interactive element allowed attendees to become an integral part of the artistic journey, making the overall experience more immersive and inclusive. By combining the showcase of programming techniques with audience participation, my performance aimed to captivate and enlighten the viewers, leaving them with a deeper understanding and appreciation for my work.

Statement of Symphony of the Cosmos in RCA WIP Show, February 2023

This sound environment comprises two distinct systems that create an immersive experience. The first system is a spatial instrument, consisting of eight physical sculptures, Bela multi-channel output equipment, and eight mini speakers. Within this space, visitors have the freedom to move around and interact with the sculptures by taking down the speakers positioned close to their ears. This allows them to listen to the unique sounds associated with each planet. Additionally, an ensemble of sounds from the eight planets of our solar system is harmoniously blended, creating a captivating auditory experience.

For those intrigued by the specific sound composition of a particular planet, the second system provides an avenue for exploration. By wearing headphones and utilizing Pure Data on their laptops, visitors can engage in real-time interaction with the sounds. This interactive feature allows them to selectively listen to the sound produced by a specific chemical composition within a particular planet or opt for a curated ensemble of sounds.

In essence, this sound space provides a multi-faceted experience, inviting visitors to physically engage with the sculptures, explore individual planet sounds, and actively participate in the composition and arrangement of the auditory elements using Pure Data.