[1H3-OS-40] OS-40

1:55 PM - 2:10 PM JST(4:55 AM - 5:10 AM UTC)

[1H3-OS-40-02] A Human-in-the-Loop Examination of AI-Assisted Staff Notation for Shinobue PerformanceFocusing on Communications Between a Music Specialist and an Engineering Expert

〇Masatoshi Yamada¹, Motoi Ohtake², Takemi Mochizuki¹, Kyouji Tamura² (1. Tokoha University, 2. KONICA MINOLTA , INC.)

Keywords:

Traditional performing art,The Japanese transverse bamboo flute “shinobue”,Staff notation,Tacit knowledge,Human-in-the-Loop

AI-based transcription of shinobue performances holds great potential; however, prior research has noted that full automation remains difficult due to the unique tonal structures and subtle expressive fluctuations characteristic of Japanese folk performing arts. This study conducts a qualitative analysis of the communication that occurs when an engineer and a music specialist collaborate within a Human-in-the-Loop framework to transcribe shinobue performances into Western staff notation. The analysis reveals that the music specialist's long-cultivated senses, embodied know-how, and performance heuristics, conceptualized here as "musical tacit-knowledge concepts," were formalized by the engineer into "notation-generation technical concepts," mediated through a process of "empathetic understanding." This interaction constituted a knowledge co-creation process through which the engineer acquired novel "emergent perspectives." Taken together, these findings suggest that mutual respect for each participant's expertise facilitates smooth collaboration in cross-disciplinary work. Moreover, they indicate the importance of intentionally incorporating the specialist's tacit and experiential perspectives within a Human-in-the-Loop framework in order to foster emergent and creative outcomes.