Sound Sculpt Interactive Music Synthesizer by Yiqi Zhao |
Home > Winners > #168315 |
 |
|
||||
| DESIGN DETAILS | |||||
| DESIGN NAME: Sound Sculpt PRIMARY FUNCTION: Interactive Music Synthesizer INSPIRATION: SoundSculpt is inspired by the tactile art of sculpting, where shaping materials evokes profound emotional expression. Echoing ancient pottery, where your hands transform raw material into art, SoundSculpt revolutionizes this dynamic by turning it inside out, empowering users to become integral to the creative process. By integrating spatial audio and visual art, I offer you an immersive experience that blurs the boundaries between creator and creation, redefining interaction for a new era. UNIQUE PROPERTIES / PROJECT DESCRIPTION: Revolutionizing Perception through Immersive Music Making Imagine sculpting with sound, where body movement generates a mesmerizing audio visual landscape. SoundSculpt is an innovative, generative music tool that fuses spatial sound, motion, and visual art, redefining the boundaries of creative expression. By harnessing the power of Bose AR Frame, this interface enhances perception performance, providing a novel medium for artistic exploration, emotional regulation, and mental well being. OPERATION / FLOW / INTERACTION: SoundSculpt immerses users within a virtual bubble, enabling them to shape its surface through intuitive gestures. As they tilt their heads or press buttons, Bose Frames capture these actions, converting them into dynamic audio-visual feedback. This interaction fosters a seamless cycle of "listen," "sculpt," and "art generation," empowering users to transform their environment. The system's innovative design ensures a fluid, captivating experience that boosts creativity and emotional well-being. PROJECT DURATION AND LOCATION: The project began in fall 2019 at the MIT Media Lab in Cambridge, MA, and concluded in summer 2020. It was subsequently exhibited to the Bose Frame AR team at Bose Corporation in Framingham, MA. |
PRODUCTION / REALIZATION TECHNOLOGY: SoundSculpt employs XR tech, integrating spatial audio and visual processing for immersive experiences. Bose Frames, with gyro sensors, capture 6 dof head movements, translating them into real-time audio modulation via a MIDI framework. Developed on Unity with C# scripts, it enables real-time user interaction. Mesh deformation and vertex manipulation allow dynamic bubble surface control, creating a responsive interface that enhances engagement and emotional connection. SPECIFICATIONS / TECHNICAL PROPERTIES: The system uses a MIDI framework to map Bose Frames' head orientation data to sound pitch and volume, then transferred to virtual bubble manipulation is achieved through touch inputs with C# scripts. The integration of synesthesia principles enhances sensory perception, creating a holistic flow that bridges the gap between physical and digital art forms. Size: 7.2 x 3.1 x 2.9 inches Weight: 12.31 ounces Lenses: Polarized Water Resistance: IPX2 rating Battery Life: Up to 5.5 hours Bluetooth Range: 30ft TAGS: AI, generative AI, spatial audio, digital media, unity, music, wearable tech, Bose, XR, AR RESEARCH ABSTRACT: This HCI research aims to develop an immersive tool for emotion regulation. Using a mixed reality approach, data was collected via user testing and biometric feedback with Bose Glasses and Real-time 3D engine. Participants included designers and non-designers. Results showed enhanced perception of spatial volume, sound, and motion, with a more stable emotion stage. Insights suggest adoption in psychiatry with art therapy, impacting society by improving emotional well-being with playful creation. CHALLENGE: The hardest part was integrating multi sensory feedback into a seamless flow. Creatively, it was challenging to synchronize audio-visual elements with inputs in real-time. Internally, balancing human vulnerabilities, historical concepts with modern tech required innovative thinking. Externally, limitations in sensor accuracy and data processing posed obstacles. Overcoming these required iterative testing and leveraging cutting-edge XR technology to ensure fluid interaction and emotional impact. ADDED DATE: 2025-02-12 03:40:13 TEAM MEMBERS (1) : IMAGE CREDITS: Image 1: Yiqi Zhao, 2024. Image 2: Yiqi Zhao, 2024. Image 3: Yiqi Zhao, 2024. Image 4: Yiqi Zhao, 2024. Image 5: Yiqi Zhao, 2024. Video Credits: Yiqi Zhao, 2024. PATENTS/COPYRIGHTS: Copyrights belong to Yiqi Zhao, 2025. |
||||
| Visit the following page to learn more: https://www.yiqizhao.design/ | |||||
| CLIENT/STUDIO/BRAND DETAILS | |
 |
NAME: MIT Media Lab PROFILE: Founded to accelerate the nation’s industrial revolution, MIT is profoundly American. With ingenuity and drive, our graduates have invented fundamental technologies, launched new industries, and created millions of American jobs. At the same time, and without the slightest sense of contradiction, MIT is profoundly global. Our community gains tremendous strength as a magnet for talent from around the world. Through teaching, research, and innovation, MIT’s exceptional community pursues its mission of service to the nation and the world. Every day, we imagine, design, and invent a future in which everyone has the opportunity to thrive. The Media Lab is a dynamic interdisciplinary creative sandbox, firmly grounded in academic excellence, where innovation thrives through the collaboration of dozens of research groups, initiatives, and centers on hundreds of transformative projects. We focus not only on creating and commercializing transformational future technologies, but also on their potential to impact society for good. For forty years, we've harnessed interdisciplinary collaboration to create transformative technologies and ideas imagining what we can become as we shape a future where creativity, innovation, and compassion empower everyone to thrive and drive meaningful change in the world. |
| AWARD DETAILS | |
 |
Sound Sculpt Interactive Music Synthesizer by Yiqi Zhao is Winner in Digital Art Category, 2024 - 2025.· Read the interview with designer Yiqi Zhao for design Sound Sculpt here.· Press Members: Login or Register to request an exclusive interview with Yiqi Zhao. · Click here to register inorder to view the profile and other works by Yiqi Zhao. |
| SOCIAL |
| + Add to Likes / Favorites | Send to My Email | Comment | Testimonials | View Press-Release | Press Kit |
Did you like Yiqi Zhao's Digital Art Design?
You will most likely enjoy other award winning digital art design as well.
Click here to view more Award Winning Digital Art Design.
  |
 |
