Name
Visual Sound: Bridging New Discoveries through Piano, Art, and AI Collaboration
Date & Time
Tuesday, July 28, 2026, 4:05 PM - 5:05 PM
Description
Visual Sound: Bridging New Discoveries through Piano, Art, and AI Collaboration AbstractVisual Sound is a reciprocal multisensory learning dynamic integrating live piano performance, fine-art exhibition, filmed art-making, and generative AI animation to cultivate active listening and shared artistic discovery. Students and teachers co-create by describing what they hear, translating musical qualities into visual language, and directing digital imagery as artistic reflection. Grounded in arts-integration theory (Bresler, 1995), narrative learning (Bruner, 1990), and AI-supported cognition (Luckin, 2018), it provides a practice-based framework connecting artistic direction, digital literacy, and inclusive pedagogy. Piloted during the 2024-2025 school year and expanded in summer 2025 through a public piano-arts collaboration concert and exhibition, Visual Sound has engaged over 600 elementary students (K-5) through integrated lessons combining listening, art-making, and reflection. Surveys and observations indicated significant gains in expressive understanding and engagement as auditory-visual pairing transformed listening into a creative act of imagination and interpretation. Students demonstrated increased empathy, attention to phrasing and tone color, and a sense of shared authorship between sound and image. For piano students, this process deepens musical and technical understanding. Translating tone, motion, and phrasing into visual form requires intentional listening and expressive awareness, reinforcing control of dynamics, articulation, and pedaling. Directing imagery parallels shaping tone and form, guiding students to interpret with imagination and emotional depth. Not only does creating this work together foster shared discovery, but presenting it from teacher to student also invites active listening and helps students visualize sound more vividly and meaningfully. The 50-minute workshop unfolds in three interactive stages.Stage 1 - Storytime Model (10 min): participants experience guided listening as a volunteer connects narrative imagery with piano phrasing, demonstrating how story and sound interact. The group observes, listens, and responds to feel the relationship between imagery, tone, and expression.Stage 2 - Guided Listening & Artmaking (20 min): groups translate short musical excerpts into sketches and keywords describing tone color, motion, and mood.Stage 3 - AI Toolkit: Prompt as Performance (20 min): participants generate synchronized visuals using accessible AI tools and share reflections on how these visuals enhance musical interpretation. All participants receive a digital AI Prompt Design Guide to adapt the process for their own classrooms. By transforming listening into creative direction and reflective authorship, Visual Sound embodies ISME 2026’s theme of “Building Bridges,” uniting educators, students, and artists through technology as partners in artistic discovery.Keywords: Multisensory Learning; AI Collaboration; Active Listening
Location Name
514B
Full Address
Palais des Congres - Montréal Convention Centre
1001, Place Jean-Paul-Riopelle
Montreal QC H2Z 1H2
Canada
1001, Place Jean-Paul-Riopelle
Montreal QC H2Z 1H2
Canada
Session Type
Workshop
Presenting Author(s)
Jung Eun Hong