3D Online Concert
Solo-produced 1.5-hour VTuber 3D concert streaming on Youtube
Performance
2025
About
VTuber 3D concert built in Unreal Engine with motion capture, featuring six guest singers
Embers We Hold is an online streaming 3D concert featuring Tokyo-based musician Unnämed, produced in collaboration with StillSameShark as a continuation of the live 3D concert Trail of Flame.
I extended the original stage design to adapt for YouTube streaming, delivering a 1.5-hour show as a solo production. What initially appeared simpler than a live LED panel show became an entirely different technical and creative challenge, as the workflows and production priorities between live performance and online streaming did not directly translate.
Embers We Hold is an online streaming 3D concert featuring Tokyo-based musician Unnämed, produced in collaboration with StillSameShark as a continuation of the live 3D concert Trail of Flame.
I extended the original stage design to adapt for YouTube streaming, delivering a 1.5-hour show as a solo production. What initially appeared simpler than a live LED panel show became an entirely different technical and creative challenge, as the workflows and production priorities between live performance and online streaming did not directly translate.
6 Guest singers are featured in this 3D show.
The core challenge is synchronizing and retargeting motion data for 7 performers within a compressed production timeline — 2 months . I had to ensure frame-accurate sync across motion capture, audio stems, and live band footage from recording through to final sequence assembly.
Credit | Guests |
Banzoin Hakka https://x.com/banzoinhakka
NANO https://x.com/nanonano_me
Ayunda Risu https://x.com/ayunda_risu
Michi Mochievee https://x.com/MichiMochievee
ironmouse https://x.com/ironmouse
Dacapo https://x.com/dacapo_arp
Shoto https://x.com/shxtou
I maintained the stylized rendering pipeline with a hybrid approach: toon-shaded avatars against a semi-realistic background environment. Using Unreal Engine's Cinematic Pipeline, I integrated the OffWorld Live toolkit to output multiple render targets and scene captures for direct encoding.
Unlike a one-time live show driven by atmosphere and adrenaline, an online concert watched alone at home demanded intentional visual storytelling and camera choreography to keep audiences emotionally engaged.
I maintained the stylized rendering pipeline with a hybrid approach: toon-shaded avatars against a semi-realistic background environment. Using Unreal Engine's Cinematic Pipeline, I integrated the OffWorld Live toolkit to output multiple render targets and scene captures for direct encoding.
Unlike a one-time live show driven by atmosphere and adrenaline, an online concert watched alone at home demanded intentional visual storytelling and camera choreography to keep audiences emotionally engaged.
Motion Capture
We partnered with Riff Studio in Bangkok.
I am handling the retargeting of body motion capture data on-site with Motion Builder, streaming into Unreal Engine in Real-time to pre-vis with the Avatar alongside the cloth-physics simulation. Retargeting data to avatars with proportions drastically different from real performers required constant iteration and manual polish, balancing motion fidelity against rig limitations to preserve gestural intent while avoiding mesh penetration and clipping.
Motion Capture
We partnered with Riff Studio in Bangkok.
I am handling the retargeting of body motion capture data on-site with Motion Builder, streaming into Unreal Engine in Real-time to pre-vis with the Avatar alongside the cloth-physics simulation. Retargeting data to avatars with proportions drastically different from real performers required constant iteration and manual polish, balancing motion fidelity against rig limitations to preserve gestural intent while avoiding mesh penetration and clipping.
Capturing Authenticity in Virtual Performance
During production of Ember We Hold, I am fascinated by the contradiction at the heart of Virtual Identity Performers—wavering between authenticity and virtualness.
While "virtualness" and "fantasy" provide the foundation, leaving room for imagination, I've realized the most significant charm point that differentiates performers is actually authenticity — after all, we resonate with the beliefs and emotions of a human being.
As I bridge the dimensions of the Performer and the Virtual world, I sometimes feel frustrated and lost: no matter how hard I try, the sense of losing authenticity during performance capture is inevitable. This led to my own realization: I am the one making the decision on how to reform and reconstruct the fragment of authenticity. I am adding another virtual layer to broken authenticity to boost the charm. Just as I always fall for the shape of vulnerability of humankind, fascinated by the charm brought about by human imperfections. Standing on-site watching the talents perform with full commitment, I constantly asked myself: Which moment matters? Which details reveal their true energy?
Hence, my focus was on dynamic camera sequence animation to capture and enhance the expressiveness of each singer's delivery, bridging raw motion data and compelling emotional storytelling in this 3D Online Concert.
Capturing Authenticity in Virtual Performance
During production of Ember We Hold, I am fascinated by the contradiction at the heart of Virtual Identity Performers—wavering between authenticity and virtualness.
While "virtualness" and "fantasy" provide the foundation, leaving room for imagination, I've realized the most significant charm point that differentiates performers is actually authenticity — after all, we resonate with the beliefs and emotions of a human being.
As I bridge the dimensions of the Performer and the Virtual world, I sometimes feel frustrated and lost: no matter how hard I try, the sense of losing authenticity during performance capture is inevitable. This led to my own realization: I am the one making the decision on how to reform and reconstruct the fragment of authenticity. I am adding another virtual layer to broken authenticity to boost the charm. Just as I always fall for the shape of vulnerability of humankind, fascinated by the charm brought about by human imperfections. Standing on-site watching the talents perform with full commitment, I constantly asked myself: Which moment matters? Which details reveal their true energy?
Hence, my focus was on dynamic camera sequence animation to capture and enhance the expressiveness of each singer's delivery, bridging raw motion data and compelling emotional storytelling in this 3D Online Concert.
latest update [2025.04.13]
latest update [2025.10.01]
More Work
Know Me More
More Work
Know Me More
More Work
Know Me More
More Work
Know Me More
More Work
Know Me More
More Work
Know Me More
Contact