【XR Animator】Play your instrument as a VTuber!🎸🎻

Описание: Ever imagine you can play your instrument as a VTuber with realistic mocap and stream it live? The latest "hand gesture control" feature of XR Animator allow you to not only use hand gesture to control props, but also mocap your guitar or violin performance in real time, all with just a simple webcam!

Below is the gesture control demo used in this video, with 3D props and "scene.json" configured for XR Animator.
https://ko-fi.com/s/e2f1959b3d

---------------

"XR Animator" is an AI-based (MediaPipe) full-body mocap solution which supports image, video and webcam as input. Both browser and Windows version are available. Windows version supports the VMC-protocol which allows beaming realtime motion data to external apps such as VSeeFace, Unity and Unreal Engine. The browser version supports AR (Augmented Reality) mode on Android.

🌐 XR Animator - browser version
https://sao.animetheme.com/XR_Animato...

🖥️ XR Animator - Windows app version
https://github.com/ButzYung/SystemAni...

---------------

Features:

Support full-body AI motion tracking using a single webcam or media file (image/video)

Support using any MMD/VRM model as your 3D avatar

Record mocap motion and export it to VMD motion format

Support loading VMD/BVH/FBX format 3D motions

Export BVH/FBX motions to VMD format

Customize the background and 3D scene with 2D image/video , 3D panorama, 3D objects (.x/.glb format), or a plain simple green screen for VTubing and video recording with a transparent background

Support VMC-protocol to animate a 3D model elsewhere in other VMC-enabled applications such as VSeeFace, Unity and Unreal Engine (Electron mode only)

Support frameless window with transparent background on video capture apps such as OBS (Electron mode only) (*)

Support AR (Augmented Reality) on Chrome browser (Android only)

---------------

Contact:

Ko-fi☕
https://ko-fi.com/butzyung

Twitter
  / butz_yung  

Facebook:
  / animethemegadgets  

YouTube:
   / animethemegadget  

Homepage:
http://www.animetheme.com/sidebar/

---------------

Demo credits:
・九条フレカ「©ATS」
・生駒ミル「©ATS」
・Mocap source (guitar/violin cover):
  / 1718962418997739537  
   • Perfect // Ed Sheeran (Violin Cover)  
   • Larissa Liveir - Redbone  
   • An unforgettable melody🎶🎻