Research: Track2Rig
From 3D tracks of a moving creature to a fully rigged, animated result. In each clip, left: the 3D point tracks the model receives, with the skeleton it predicts. Right: the creature's mesh, skinned by the model and moved only by the model's bone motion. Every animal shown was held out of training.
Results
- In a blind side-by-side review of 51 held-out clips, the current version was preferred 30 times and the previous version 7 times (14 no preference); on real animal motion it was 25 to 1.
- On 43 held-out real-animal motions, the share of bones that stay inside one real limb rose from 51% to 68%.
- Input: 3D point tracks of a moving creature. Output: a skeleton, skin weights and per-frame bone motion, shown here driving the creature's mesh.
Try it on your own video
Upload a short video of one animal or person. You get its motion on a 3D skeleton as GLB, FBX and BVH files, plus a preview video.
About 3 minutes per 5-second clip when warm, about 7 minutes from cold, up to about 13 minutes when capacity is busy. Feet can slide and the body can drift about 9 to 12% of its length. Experimental.
For approved evaluation accounts. The video-to-rig demo plays here once your company is approved for a free evaluation.
Request access Approved already? This account is not approved yet.