Synesthesia

Dynamic Transformation

Jianing Zhou
MLA II 2024
Senmiao Yang
MLA II 2024
Sichang Huang
MLA II 2024
Image
1 Ribbon generated from the pianist’s hand’s movement

Painting can possess the same potency as music with its abstraction. We see music and painting as originating from the same root and are integrated, both aimed at capturing inner spirit and conveying intense emotions. It’s possible to visualize music through certain interpretations.

This project is an intriguing experiment in synthesizing melody, rhythm, color, lines, forms, and the pianist’s hands’ motions into a single seamless whole.

The project’s process entails recording the graceful movements of the pianist’s left hand when playing Liszt’s La chasse (French: Hunting) with Fologram. The goal is to translate this recorded motion, including movement speed on various axes, accents, and the palm’s angle, into a ribbon with changing widths, surface orientation, and color. This is achieved using Vanilla Grasshopper and C# programming.

Project video
Image
2 Sheet music is the most common visual representation of music
Image
3 Pianist’s hand motion - High position
Image
4 Pianist’s hand motion - Low position
Image
5 A selection of screenshots of form generating and explorations with C# and Grasshopper