SoundScopePhone app for iPhone and iPad

RIKEN’s Sound Scope Phone introduces a new way of actively listening to music by enabling you to focus on the part you want to listen to. All you need is an iPhone and earphones or headphones for this active music listening experience using spatial sound and AI.

- Spatial acoustic experience
Put on your earphones or headphones and press the play button on Sound Scope Phone. You will hear performers playing instruments around you. If you hold your iPhone in front of you, youll see the application tracking your face on the display. By turning your head left and right, you can follow the sound of the performers on their respective sides. Likewise, if you turn around with your iPhone in hand, you will be able to face the performers behind you.

- Active music listening experience
This app provides an active music listening experience by enabling you to focus on the certain performers you want to hear. If you turn to face the performer of your choice, it will sound as if they are directly in front of you. By moving your left or right palm closer or further from your ears, you can adjust the range of the performance that you want to focus on. You can highlight one part or multiple parts such as the horn section and the rhythm section. You can check the direction of the performer and the direction you are facing on the position display.

- Mixing console and boost mode
Press the settings button at the bottom right to open the mixing console. The mixing console enables you to operate the faders to fine-tune the volume of each part. When the boost switch is turned on, the targeted sound will be more amplified. You can lower the boost limit fader to adjust the level.

- Development history
The Music Information Intelligence Team, part of the RIKEN Center for Advanced Intelligence Project, is exploring potential new ways of creating and listening to music using AI. When listening to classical music, for example, you may want to hear the first violin a little more clearly, or suppress the sound of the trombone sound, or only hear the flute. Sound Scope Phone is an app that enables you to specify the sections you want to listen to.

The app is available to the public to gauge the overall interest in such a way of listening to music. We ask that users the app who are prompted to fill out a questionnaire to please submit their responses. We plan to add songs in the future. If you are interested in the app and technology, please contact us at the support URL.