Markerless Motion Capture with SynthPose
SynthPose is a new approach that enables finetuning of pre-trained 2D human pose models to predict an arbitrarily denser set of keypoints for accurate kinematic analysis through the use of synthetic data.
More details are available in OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics.
This particular variant was finetuned on a set of keypoints usually found on motion capture setups, and include coco keypoints as well.
The keypoints part of the skeleton are the COCO keypoints, and the pink ones the anatomical markers.
Simply upload a video, and press run to start the inference! You can also try the examples below. 👇
Examples
Examples