Sound : Past & Future Project

Virtual Band ︎

WebVR-based collaboration visual-audio composition frameworks.

This project is web-based collaboration visual-audio composition frameworks. Users can meet in a virtual space as random characters. The sound made by one user through a microphone can be heard by all other users. Based on this, they can play together and make one music. The user can be a performer and also a singer by selecting a menu. The instruments include piano, cello, guitar, etc. and the voice can be changed by choosing Pitch shifter, Autowah, Pinged and Apollo options. Alos users can change the virtual background. A user's voice has a relative volume and positional audio, depending on where the user is located in the virtual space. For example, if another user is close to my left, the user's voice will be heard loud from my left. Virtual Band is available on any VR device.

Getting started


1. Open https://virtualband2.glitch.me/
2. Put on VR device
3. Select options
4. Make music with friends


 ︎ Recommend to use firefox
︎ Access microphone



Options


1. Environment
2. Voice
3. Instruments



Set Environment
| menu



Set Instruments
| keyboard







Set Voice
| microphone


                                                               

How it works


WebVR
  • Aframe
  • Glitch

Networked-Aframe
  • Support for EasyRTC and/or WebSocket connections.
  • Audio streaming to let users talk in-app.
  • Bandwidth sensitive. Only send network updates when things change.
  • Cross-platform. Works on all modern Desktop and Mobile browsers. Oculus Rift, Oculus Quest, HTC Vive and Google Cardboard.

Tonejs-Instruments
  • A small instrument sample library with quick-loader for tone.js

Shift audio input

effect.addLinearControls( [leftDelay.delayTime, rightDelay.delayTime], "Delay", 0.01, 2.0, 0.01, delayTime );
effect.addLinearControls( [leftFeedback.gain, rightFeedback.gain], "Feedback", 0.01, 1.0, 0.01, feedback );

hyeonah choi