My virtual band played their first live gig! (Streaming live mocap using Unreal Engine).

Описание: A few months ago I performed a short prototype live show for Big Sand. This 'party in the desert' allowed me to appear in a real world music venue (The Lab at LIGHT ADL) as the band's lead singer Taal, and interact with an audience. And because I'm a sucker for punishment, I wanted to stream my live performance remotely, from the Flinders University motion capture stage (called The Void).

Developing this prototype was a huge learning curve for me, and although there's plenty of room for improvement I want to share my process so far. Hopefully it's helpful for the handful of indie performers out there working across live performance and motion capture!

There's also some helpful takeaways if you're a VTuber, Twitch streamer or just interested in live streaming from Unreal Engine. For reference, I'm using UE 4.27 for this performance.

If you're working on a similar project, I'd love to hear about it - please drop a comment or get in touch ([email protected])!

Lead Videographer: Tim Cheeseman
Additional footage: Vipop Coombs

Useful links:
Off World Live (Spout Plugin and Unreal Streaming Toolkit): https://offworld.live/

Touch Designer (lining up the 6 virtual camera outputs side-by-side): https://derivative.ca/

Resolume (mapping the Touch Designer output onto the LED Walls): https://resolume.com/

Ableton Max for Live (comes with MIDI to OSC Plugin): https://www.ableton.com/en/live/max-f...

Unreal Engine Blueprint - using an OSC music note to trigger a Cinematic Sequence: https://blueprintue.com/blueprint/4iq...

Mod Studio: https://mod.studio/

OBS Studio (comes with Virtual Camera output for video conferencing): https://obsproject.com/

VB Audio Virtual Cable: https://vb-audio.com/Cable/

With Additional Thanks:
Cameron Mackness & Jason Bevan from The Void at Flinders University
Fraz, Oscar, Aphra, Nick & Liam from The Lab at LIGHT ADL
Michela Ledwidge from Mod Studio
Trish and Joel from Far Land Creative (sound design)
James, Brecon and the team at CDW Animation
Australia Council for the Arts for their support of this prototype
APRA AMCOS x Australia Council for the Arts for helping me to document the process