Performing music over the internet
Tips and information to perform music over the internet through Zoom or other real-time networked methods.
If you've ever tried singing "Happy Birthday" with someone during a video conference, you'll be well aware of the challenges involved with playing or performing music over the internet. Latency (also known as delay) as well as a reduction in audio fidelity are two of the biggest hurdles to overcome but with some know-how can be addressed.
Two people performing together over a video conferencing application (such as Zoom) will inherently be out of sync anywhere from 300ms to one second, depending on the location of the participants.
The good news is that getting remote performers to play in real-time (with a one-way latency of 20-30ms) is possible, however this requires considerable setup and patience to work through. Anyone interested in exploring this area is encouraged to check out the document Networked Music performance: A step-by-step guide to real-time musical collaboration over the internet using Jacktrip.
For anyone wanting a quick way to play music with a standard computer setup, here are the two things you can do to improve the experience of playing music over the internet when using Zoom.
- Enable 'Original Sound' in Zoom to improve the audio quality
- Have participants mute their microphones so their out-of-time audio doesn't distract the other performers.
Improving the quality of audio through Zoom with 'Original Sound'
Zoom is designed to process spoken words by default and does its best to remove all other background sounds, including music. As Zoom squashes away musical frequencies the result is often a washy mess of audio that dips in and out. By using the ‘Original Sound' feature you can bypass this aspect to help get the best sound from your microphone or input device. When doing so, it’s also best to use headphones to avoid any unwanted artefacts. The following frequency graph comparison shows the difference enabling the 'Original Sound' setting makes to a piano excerpt.
Step by step process to enabling 'Original Sound'
- Select the up (^) icon in the bottom left hand side section of the Zoom application when you are in a Zoom session and select Audio Settings…
- Select the Advanced button.
- Check the box Show in-meeting option to “Enable Original Sound” from microphone. Leave the other audio processing options at the Auto level.
- In the main Zoom window, an option will now appear to Turn On Original Sound. Selecting this will enable the sound directly from your microphone or audio interface.
- When the option is active the text will show Turn Off Original Sound. Click this again to toggle the original sound to off again.
- You can also select a microphone to always use original sound to make switching between voice and musical sources more efficient.
You don't need to enable original sound if you are sharing an audio source via the screen sharing feature.
How to manage playing with audio latency in Zoom
Muting participant audio
In a leader-follower performance where one person is setting the tempo and others are following, having all participant (not the host/leader) microphones muted will avoid the distractions of out-of-time audio being sent back around to the participants. Participants will hear both their own audio and that of the instructor in real-time. The downside is that the leader will not hear anybody else’s audio so they will be essentially playing solo.
Group playing (asynchronous)
Any music style that don’t require synchronous playing can be performed online with all mics unmuted. These can include free jamming, drone-singing, textural music elements or asynchronous activities where exact timings are less important. This type of activity is useful in a situation where both video and audio latency isn't going to negatively affect the performance.
Using pre-recorded performances to simulate a live performance
Pre-recording a single musical part then sending it out and having participants record their part is a common way to produce a multi-part musical piece. Here's an example by the University of Melbourne Symphony Orchestra of Ravel's Boléro (from home).
Other pre-recorded music examples
- Couch Choir (Close to You)
- Dua Lipa - Dont Start Now (The Late Late Show with James Corden). However in this example it's not mentioned that it's prerecorded so there's an implication that it is happening in real time.
- Apple Group Facetime advertisement. It could be interpreted that using this feature allows synchronous musical performance from all parts of the world (when in fact it's not possible).
Teaching music in Zoom
Along with enabling 'Original Sound', there are a few other techniques that can assist with teaching music in Zoom.
- Use a second camera to show hand positions. For example an 'over the shoulder' shot of hands plating on a piano. Be sure to mute the microphone and speaker from the second device otherwise feedback will occur.
- You can share a second webcam into a Zoom recording by going to Share Screen, selecting Advanced and choosing Content from a 2nd Camera.
- Provide the student with permission to record the session locally on their computer. This will allow them to review later on as well as reducing the time you need to spend providing any videos.
- Have the student play along with a pre-recorded accompaniment track. This is best done from the computer being used for Zoom since smart devices are not able to share the inbuilt sound playback.
- Get students to use headphones when participating in the lesson.
- If you want to share sound only in the session, you can do this via the advanced feature of screen sharing.
- The original sound setting is also available on iOS devices within the meeting settings.
- Music across the balconies - online music and dance engagement happening around the world
- Experiments with Google (lots of music examples)
- Teach Anywhere (University of Melbourne only)
- Virtual Events Directory - production tools and events.