How AI Is Changing Fitness — From Wearables to Real-Time Form Judging

For most of the last decade, 'AI in fitness' meant a wearable estimating your heart rate and calories. Useful, but passive — it measured what already happened. The more interesting shift over the last few years is active: computer vision models that watch your body move, in real time, from an ordinary camera, and judge the movement itself.

What pose estimation actually does

Pose estimation models map the human body to a skeleton of key points — shoulders, elbows, hips, knees, ankles — dozens of times per second, from a normal 2D video feed. From that skeleton, software can calculate joint angles, depth, tempo, and symmetry: exactly the inputs a human coach would use to judge a rep, just measured with far more precision and consistency than an eye can manage.

Why on-device matters

A meaningful design choice in modern pose-estimation is running the model directly in the browser or on-device, rather than uploading video to a server. It's faster (no round-trip latency), cheaper to run at scale, and — importantly for user trust — means your actual video never has to leave your device for the scoring to happen. REPPED's rep-counting and form-scoring runs entirely client-side for exactly this reason; only the final numeric result is ever sent anywhere.

Where this is heading

• Real-time form correction during a workout, not after it
• Objective scoring that removes subjective 'that counts, right?' arguments
• Fair matchmaking based on measured performance, not self-reported fitness level
• Competitive formats that weren't possible when judging required a human referee for every rep

The honest limitations

Camera-based pose estimation isn't a medical device and isn't perfect in poor lighting, unusual camera angles, or with the body partially out of frame — which is why fair systems build in visibility checks and graceful fallbacks rather than pretending to be flawless. REPPED, for instance, flags a rep when a player isn't sufficiently visible rather than guessing. Read our full explanation of how the AI judges every rep for the specifics.