Most of the HPE methods are based on recording an RGB image with the optical sensor to detect body parts and the overall pose. The essence of the technology lies in detecting points of interest on the limbs, joints, and even face of a human. MobiDev looked at Human Pose Estimation technology capabilities in 2022.

The overall flow of a body pose estimation system starts with capturing the initial data and uploading it for a system to process. Different software modules are responsible for tracking 2D key points, creating a body representation, and converting it into a 3D space. So generally, when we speak about creating a body pose estimation model, we mean implementing two different modules for 2D and 3D planes.

Depending on the chosen algorithm, the HPE system will provide different performance and accuracy results. Two of the most popular human pose estimation models would be VideoPose3D and BlazePose. We’ve tested BlazePose and VideoPose3D models on the same hardware using a 5-second video with 2160*3840 dimensions and 60 frames per second. VideoPose3D got a total time of 8 minutes for video processing and a good accuracy result. In contrast, BlazePose processing time reached 3-4 frames per second, which allows the use in real-time applications. But the accuracy results shown below don’t correspond to the objectives of any HPE task.

Whether we deal with a fitness app, an app for rehabilitation, face masks, or surveillance, real-time processing is highly required. Of course, the performance of the model will depend on the chosen algorithm and hardware. While models like BlazePose are able to provide real-time processing, the accuracy of its tracking is not suitable for commercial use or complex tasks. Generally, the accuracy of model predictions will depend on the training and the chosen architecture. 

Read about Human Pose Estimation Use Cases here:
https://mobidev.biz/blog/human-pose-estimation-technology-guide

MobiDev is an international software engineering company with offices in Poland and Ukraine. The company is focused on helping visionaries create their products. MobiDev invests into technology research and has years of experience building AI-powered solutions, implementing machine learning, augmented reality, and IoT.