Skip to content

Releases: ButzYung/SystemAnimatorOnline

XR Animator 0.11.0 - Windows and Linux version

21 Jul 20:17
Compare
Choose a tag to compare

Changes

  • Add Streamer Mode, a one-take shortcut that automatically enables everything you need to start your mocap session, including selecting a webcam, changing your avatar's pose, loading the mocap AI, and turning on VMC protocol (if enabled in last session). Your preferences in webcam, pose, mocap and VMC will be saved and applied automatically (video demo)
  • Add the experimental "Hands web worker" under mocap option, which loads hands mocap AI on a separated thread, independent of the pose AI. Practically speaking, this will allocate more system resources to the pose AI, and less to the hands AI, resulting in higher body pose fps (but lower hands fps)
  • Improve the benefits to hide 3D avatar (under the VMC protocol options) when using VMC protocol, by skipping unnecessary processings and saving extra CPU usage
  • Improve the look of hand rotations in full body mocap, by automctially limiting their angles when the user is far away from the webcam
  • Fix "Reset all settings" to reset custom pose order and motion

XR Animator 0.10.1b - Windows and Linux version

17 Jul 15:36
Compare
Choose a tag to compare

Changes

  • Change all thumb bone names to match VRM0 naming when using VMC protocol to ensure maximum compatibility. This fixes thumb glitches when connecting to Warudo, and potentially missing thumb metacarpal rotation when connecting to other VMC apps
  • Run VMC protocol in a timeout function, off the main rendering loop, for performance improvement

XR Animator 0.10.1 - Windows and Linux version

16 Jul 18:39
Compare
Choose a tag to compare

Changes

  • Improve fingers tracking accuracy, especially thumb movement
  • Reduce jitters in upper body mocap, especially hand movement
  • Update MMD facial morph list to support more MMD models out of the box with proper blendshape and expression mapping without resorting to user-defined mapping
  • Enable ground shadow for upper body mocap
  • Fix thumb bone names for VMC protocol
  • Fix error when dropping VRM model after app start
  • Fix webcam listing to display only the first 7 webcam available

XR Animator 0.10.0 - Windows and Linux version

12 Jul 20:19
Compare
Choose a tag to compare

Changes

  • Add "AI model quality" mocap option to allow loading the heavy version of AI model for improved detection quality at the expense of extra GPU usage
  • Add "Z-depth scale" option to scale the z-depth detection when the heavy AI model is used
  • Smoothen the transition of avatar's position when the hip is on and off the webcam
  • Saved custom motions are now loaded on demand instead of preloaded on app start
  • Improve error handling when saved custom motion no longer exists
  • Fix bug in loading MediaPipe Tasks Vision when not using web worker
  • Update MediaPipe Tasks Vision library (v0.10.2)
  • Remove unused AI models

XR Animator 0.9.7 - Windows and Linux version

07 Jul 17:02
Compare
Choose a tag to compare

Changes

  • Optimize full-body mocap to reduce jitters when user is close to the webcam (video demo)
  • Fix window resizing and disappearing bug
  • Fix regression in "Miscellaneous Options" messing up the settings export/reset options
  • Fix settings reset option to reset "Camera face-locking" option properly
  • Update "UnrealBloomPass.js" with improved performance
  • Update "readme.txt" with information on transferring settings from previous version

XR Animator 0.9.6 - Windows and Linux version

05 Jul 20:01
Compare
Choose a tag to compare

Changes

  • Add "Shoulder adjust" option (under Pose section) for poses and mocap (video demo)
  • Smoothen arm-to-leg animations
  • Update camera options to use default resolution and aspect ratio for webcam source when "no limit" is selected

XR Animator 0.9.5 - Windows and Linux version

27 Jun 17:57
Compare
Choose a tag to compare

Changes

  • Add support for Linux (video demo)
  • Add ignore-gpu-blocklist flag for electron
  • Increase eye blink responsiveness
  • Fix camera options to allow literally unlimited resolution on local media source when "no limit" is selected
  • Fix typos in motion config regarding arm-to-leg controls
  • Update electron version (v22.3.14)

XR Animator v0.9.2 - Windows app version

24 Jun 17:26
Compare
Choose a tag to compare

Changes

  • Add pause function for mocap (toggling with the Pause key), useful for cases like when you want to do a pose capture, or need to leave the webcam for a while during live streaming (video demo)
  • Reduce false positives in arm motion detection during upper only mocap, by validating with associated hand detection
  • Improve compatibility of different ARKit blendshapes naming, by ignoring casing of the initial letter
  • Fix various UI issues
  • Update motion config to allow shoulder rotation blending
  • Update motion config to allow elbow lock based on smallest angle
  • Update N8AO library
  • Disable pose changing when the avatar model is hidden

XR Animator v0.9.0 - Windows app version

14 Jun 21:02
Compare
Choose a tag to compare

Changes

  • Update "Explorer mode" to support all features of XR Animator (video demo)
  • Add support for connecting "Explorer mode" to VNyan via VMC-protocol (video demo)
  • Add new poses and movement motions for "Explorer mode"
  • Add halfRes support to SSAO visual effect, which significantly improves the rendering speed
  • Add support for saving up to 10 custom motions
  • Change default skybox geometry to use fewer segments/polygons, as depth-enabled skybox may actually look better/smoother with fewer polygons. This can be overriden by "panorama.json" for each individual skybox if necessary.
  • Change mocap data filter parameters for better motion response
  • Hide avatar model when it is very close to the camera
  • Hide long item info when user interface is off
  • Fix hand camera to work properly with "Explorer mode"
  • Fix head rotation in non-holistic mode when face detection failed, by proper blending with rotation calculated from pose data or using the last detected data, instead of immediatelly returning to the default state
  • Fix issues in switching pose mocap web workers, by enforcing reload on module switch
  • Fix the VRM camera see-thru regression in hand camera mode by changing camera.near back to 0.1 during hand camera mode
  • Fix camera glitches in hand camera mode by ignoring camera-mesh collision during hand camera mode
  • Fix "Explorer mode" when using full body mocap, by enforcing all poses to use only upper body mocap while the mode is active
  • Fix bugs in mesh collision calculations
  • Fix speech bubble with reduced clippings with other meshes
  • Update MediaPipe library (v0.10.1)
  • Update three.js (r151) and three-vrm (v1.0.10)

XR Animator v0.8.0 - Windows app version

30 May 11:01
Compare
Choose a tag to compare

Changes

  • Add support for skybox with depth map and depth-converted (automatic) alpha map. Multiple skyboxes can be loaded via 3D scene builder (video demo)
  • Add SSAO and depth-of-field visual effects (video demo)
  • Add auto calibration to face mocap with ARKit blendshapes
  • Add auto "look at camera" option for face mocap (can be used with Ctrl+E hotkey) (video demo)
  • Add extra data filter to further stablize body rotations for upper body mocap
  • Update non-holistic full body mocap to use a holistic-like concept to fine tune the ROI of hand detection, increasing the chance of successful hand detection
    (NOTE: For upper-only mocap, you can pretty much just use the new MediaPipe Tasks Vision. However, if you want to do a full body mocap from head to feet, especially if you are far away from the camera, I still recommend legacy holistic mode for now, mainly for hand detection)
  • Update pose data filter to dynamically change settings based on mocap type and distance from camera
  • Update visual effects GUI to allow changing camera parameters (fov)
  • Update "explorer mode" in 3D scene builder to be usable even after leaving 3D scene builder
  • Fix the happy/joy expression naming issue value when using VMC-protocol
  • Fix "center_view_lookAt" being incorrect when the avatar is rotated