Technology

MMAGPT + Carnegie Mellon: Next-Gen AI Pose Estimation for Combat Sports

mmaGPT is partnering with researchers tied to Carnegie Mellon University to pioneer 3D pose estimation and monocular reconstruction built for martial arts velocity and occlusion.

By Collin J. Smith7 min read

The Future of Combat Sports: MMAGPT Partners with Carnegie Mellon Researchers to Revolutionize AI Pose Estimation

How do you train an artificial intelligence to accurately judge the micro-mechanics of an Olympic-level Taekwondo spinning hook kick or a high-level Brazilian Jiu-Jitsu transition?

At the mmaGPT AI martial arts coach, we have built a powerful foundation for real-time visual coaching. But capturing high-velocity, multi-axis human movement in combat sports pushes standard computer vision to its absolute limits. To solve this, we are taking our technology to the global epicenter of computer vision research.

We are proud to announce our roadmap to collaborate with researchers associated with Carnegie Mellon University's (CMU) world-renowned computer vision and robotics ecosystems to pioneer the next generation of 3D human pose estimation specifically tailored for martial arts.

The Challenge of Combat Sports Computer Vision

Most commercial fitness apps rely on basic 2D pose estimation. They track structural data points on a flat plane, like standard jumping jacks or squats. Martial arts mechanics are hyper-complex and highly volatile:

  • Severe Occlusion: In grappling, BJJ, or clinch work, limbs frequently cross or become entirely hidden from a single camera view.
  • Hyper-Velocity Rotation: A championship-level kick can reach blistering speeds, causing severe motion blur on standard mobile devices.
  • Micro-Axial Pivots: The difference between a safe joint alignment and an injury-inducing mistake comes down to millimeters and degrees.

By aligning our development pipeline with the foundational methodologies pioneered at CMU — the birthplace of legendary multi-person tracking tools like OpenPose — we are upgrading our architecture from standard visual tracking to true Physical AI. Our engineering roadmap builds on the same principles behind our existing computer vision fight analysis work.

[Standard 2D App Tracking] ──> Flattens depth, loses track during fast pivots or ground grappling
[MMAGPT + CMU Vision R&D]   ──> Predictive 3D mesh modeling, managing severe limb occlusion

Engineering Advanced 3D Pose Reconstruction

Our collaborative engineering goals focus heavily on monocular 3D reconstruction. This technology allows our app to take a single, flat smartphone video feed and translate it into a fully articulated 3D digital skeleton.

This R&D map leverages advanced neural network architectures similar to those studied at CMU's newly established Robotics Innovation Center. By training our models on deep biomechanical datasets and physical simulation engines, the mmaGPT vision engine will soon be able to predictively fill in the blanks when a limb becomes occluded during a heavy scramble on the mats.

Whether you are executing a fast combination in your living room or using our B2B gym infrastructure software in a live class setting, the platform will track your joint angles, balance centers, and strike metrics with clinical accuracy. This is the same engine powering our real-time video technique analysis module today.

Forging the Future of Martial Arts Technology

This partnership bridges elite academic research with real-world athletic application. By taking advanced spatial computing concepts out of the laboratory and embedding them directly into a mobile app architecture, we are democratizing world-class martial arts coaching.

The research push complements our on-the-mats validation work, including Grandmaster Michael Caruso's ATA validation of our AI coach in Murrysville, PA. Academic depth plus grandmaster-level field testing is how we make sure the models hold up under real competition mechanics.

We are excited to work alongside minds from the historic Pittsburgh institution to establish a brand-new standard for how martial artists interact with technology.

Stay tuned for upcoming beta updates featuring these advanced spatial tracking models. To try the current real-time feedback modules, explore our AI Taekwondo coaching platform or start dialing in your hands with our AI Boxing Coach today.

Want feedback on your own training? Upload a clip to mmaGPT and get a frame-by-frame breakdown in about a minute.

First analysis free with full feedback. Plans from $9 a month after that.

About the author

Two-time Taekwondo World Champion.

Stop guessing. Start grading.

Your first analysis is free with full feedback. No card, no subscription, no trial countdown. Upload one clip and read what the AI flags.

Or see how the AI MMA coach works.