mmpose/configs/body_3d_keypoint/motionbert/README.md

2.9 KiB

MotionBERT: A Unified Perspective on Learning Human Motion Representations

Motionbert proposes a pretraining stage in which a motion encoder is trained to recover the underlying 3D motion from noisy partial 2D observations. The motion representations acquired in this way incorporate geometric, kinematic, and physical knowledge about human motion, which can be easily transferred to multiple downstream tasks.

Results and Models

Human3.6m Dataset

Arch MPJPE P-MPJPE ckpt log Details and Download
MotionBERT* 35.3 27.7 ckpt / motionbert_h36m.md
MotionBERT-finetuned* 27.5 21.6 ckpt / motionbert_h36m.md

Human3.6m Dataset from official repo 1

Arch MPJPE Average MPJPE P-MPJPE ckpt log Details and Download
MotionBERT* 39.8 39.2 33.4 ckpt / motionbert_h36m.md
MotionBERT-finetuned* 37.7 37.2 32.2 ckpt / motionbert_h36m.md

1 Please refer to the doc for more details.

Models with * are converted from the official repo. The config files of these models are only for validation. We don't ensure these config files' training accuracy and welcome you to contribute your reproduction results.