Virtual mixing allows a separate, detailed control over the volume of a single instrument/voice in a recording. Normally, the balance between the instruments is done by the sound engineers at the mixing phase after multitrack recording of all instruments. Allowing the user to change the mixing parameters offers a greater involvement in the musical content and creates an enriched and active listening experience. For example, when a user listens to a musical piece that contains several instruments, he (she) might wish to adjust the balance between the individual instruments. Furthermore, he (she) might wish to isolate an instrument from the rest.
This separation method can separate the violin string vibration from the bow noise given a monophonic violin sound. This method has several advantages, but the most important is that it could work in real time so it could be integrated in real-time systems.
Responsible partner/team: Ben Gurion University
- Ben-Shalom, A. and Dubnov, S. "Optimal Filtering of an Instrument Sound in a Mixed Using Harmonic Model and Score Alignment" Proceedings of International Computer Music Conference, November 2004, Miami