The Music of Memory

Emotional Expression Through Gaming

Rebecca Rolland
Harvard Graduate School of Education 2024
Image
1 This project explores emotional expression through gaming.

Can music capture the unique essence of our memories, like an auditory fingerprint? This project explores the intersection of emotion, memory, and sound, creating a playful and interactive experience that invites users to explore their emotional landscape.

Using Processing, I developed an algorithm that maps emotional words to specific frequencies, generating a personalized symphony of sound and visuals. This ongoing, exploratory approach transforms emotional memories into tangible experiences, promoting self-reflection and emotional expression. Through an iterative design process, I experimented with various sonic representations, ranging from single tones to chords and harmonics. A key challenge was capturing mixed emotions, such as the simultaneous experience of gratitude and anxiety. I developed a system that blends multiple frequencies, creating a layered soundscape to mimic the complexity of human emotion.

Subsequently, I incorporated features to support individuals with varying language abilities.

Project video
Image
2 Project iterations explored mapping sounds and images to words.
Image
3 A range of experiments allowed for color and visual shifts based on emotion words used.