Put instruments in players' hands and let them busk #168

Open
opened 2026-10-25 02:38:27 +00:00 by sermuns · 0 comments
Owner

The soundtrack is generated, but it only ever comes from the world. A player can dance, but cannot make a note. An instrument turns a body into a sound source: hold a guitar, an accordion or a nyckelharpa, and the keys become notes; nearby players hear it from where you stand, through the same proximity mix as voice. A loop pedal lets one player lay down a phrase and build on it, which is the difference between a toy and a performance.

How it fits. liuverse-music::instrument already has the voices; liuverse-audio already places a source in space; liuverse-voice already mixes proximity audio and owns the output device. An instrument is a small new pose field (which instrument, if any) plus a low-rate note message relayed to nearby peers, exactly like voice but much cheaper. The model is a held prop in liuverse-scene and the arms follow the strum in liuverse-world::avatar. No samples ship: the note is synthesized.

Scope.

  • Instrument selection and a held model, with the hands on the strings or keys.
  • Note input mapped to a scale, with a quantized timing grid so strangers can jam.
  • Proximity relay and mix, with the local score ducking under a nearby performance.
  • A loop pedal that records and repeats one phrase.
  • Offline, the local player hears themselves and the loop.

Related. #170 (another music source), #204 (voice performance), #175 (shared timing), #194 (room acoustics).

The soundtrack is generated, but it only ever comes from the world. A player can dance, but cannot make a note. An instrument turns a body into a sound source: hold a guitar, an accordion or a nyckelharpa, and the keys become notes; nearby players hear it from where you stand, through the same proximity mix as voice. A loop pedal lets one player lay down a phrase and build on it, which is the difference between a toy and a performance. **How it fits.** `liuverse-music::instrument` already has the voices; `liuverse-audio` already places a source in space; `liuverse-voice` already mixes proximity audio and owns the output device. An instrument is a small new pose field (which instrument, if any) plus a low-rate note message relayed to nearby peers, exactly like voice but much cheaper. The model is a held prop in `liuverse-scene` and the arms follow the strum in `liuverse-world::avatar`. No samples ship: the note is synthesized. **Scope.** - Instrument selection and a held model, with the hands on the strings or keys. - Note input mapped to a scale, with a quantized timing grid so strangers can jam. - Proximity relay and mix, with the local score ducking under a nearby performance. - A loop pedal that records and repeats one phrase. - Offline, the local player hears themselves and the loop. **Related.** #170 (another music source), #204 (voice performance), #175 (shared timing), #194 (room acoustics).
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
elsie/liuverse#168
No description provided.