page_type | name | description | languages | products | ||||
---|---|---|---|---|---|---|---|---|
sample |
HoloBodyTracking sample |
Sample Holographic UWP application that demonstrates full-body tracking with a remote server. |
|
|
This sample is a Holographic UWP application that demonstrates full-body tracking with a remote server. The application is based on the sensor visualization sample. How-to video: https://youtu.be/4nZ91RuB40E (in Japanese)
File/folder | Description |
---|---|
CommonBT |
C++ common files for full-body tracking. |
HoloBodyTracking |
C++ client application files and assets for hololens 2. |
PCBodyTracking |
C++ server application files for server PC. |
PCBodyTrackingSender |
C++ client application files for onsite PC. |
HoloBodyTracking.sln |
Visual Studio solution file. |
README.md |
This README file. |
- Install the latest Mixed Reality tools
- After cloning and opening the HoloBodyTracking.sln solution in Visual Studio 2019, build (ARM64), and deploy for hololens 2. And build (x64), and deploy for server.
- Enable Device Portal and Research Mode
- Modify strings for server IP address.
- Build and deploy to a device (HoloLens 2 or onsite PC).
- HoloLens 2: Launch HoloBodyTracking from the start menu (Accept access to the camera for the first time).
- Onsite PC: Launch PCBodyTrackingSender.
Note:
- App for onsite PC need azure kinect runtime libraries (e.g., k4a.dll etc.)
- The firewall settings must be configured before or at run time.
- Build and deploy to a server.
- Launch PCBodyTracking with client IP address as an argument.
Note:
- App for server need runtime libraries for body tracking (e.g., k4abt.dll etc.)
- The firewall settings must be configured before or at run time.
- For stable frame rates, we recommend to run with high-performance GPUs (e.g., the N-series of Azure VMs).
Refer to the Docs/ResearchMode-ApiDoc.pdf documentation, and pay special attention to the sections on:
- Consent Prompts
- Main Sensor Reading Loop
- Camera Sensors
- Sensors > Sensor Frames