Explore Real-Time Processing Software

All-in-one solution for professional real-time motion capture, capable of tracking full body, fingers, and facial expressions.

CapturyLive is a turnkey software and hardware solution that processes video images tracking humans in real-time. The system is scalable, ranging from four to 12 or more cameras, based on the number of individuals you need to track and the size of your performance space.

The Setup

For real-time motion capture, Captury favors Gigabit Ethernet cameras that can support various frame rates and resolutions. These cameras are connected to a computer through Ethernet cables and a network switch, enabling them to transmit synchronized video images to the vision processor. Upon reception, the images are processed, and 3D data is generated. For optimal performance, our systems are shipped with the Ubuntu operating system pre-installed.

How It Works

Our motion capture technology utilizes a unique blend of implicit volumetric optimization-based template matching and two advanced AI techniques. This combination enables fast processing and smooth results, ensuring both speed and stability in our method. By expertly merging these methods, we have developed a cutting-edge motion capture solution that is unmatched in the industry. CapturyLive is capable of tracking either a single performer or multiple performers, depending on the number of cameras employed.

Ease of Use

CapturyLive allows for the seamless visualization, streaming, and reporting of movement data. Our user-friendly system can be operated by a single person, providing instant access with no special preparation required. With a non-intrusive and non-invasive approach, our technology captures natural and authentic human movements, ensuring a more fluid and genuine performance.

Interfacing / Integration

Elevate your motion capture workflow with CapturyLive's seamless integration with leading game engine and animation platforms. Our system also supports additional streaming protocols to industrial applications. For ultimate customization, our APIs enable you to build your own real-time streaming pipeline.

Accuracy

Experience unmatched accuracy and consistency with CapturyLive's validated technology, providing precise and repeatable motion data that captures even the subtlest nuances of movement. Our system minimizes jitter and accurately tracks even the most complex situations, such as two actors in close proximity, rolling on the ground, sitting in chairs, or holding objects.

Flexibility

Setups are no longer restricted to controlled environments, such as those featuring green-screens or uniformly lit studios with plain walls and floors. The system can now be configured in complex and cluttered environments, and even with dynamic backgrounds (like moving vehicles or people) if the initial setup is appropriately planned. Similarly, performers are not limited to wearing special skin-tight suits. Everyday apparel, such as jeans and t-shirts, is sufficient.

CapturyLive Functions

  • Full-Body Tracking
  • Finger Tracking
  • Camera Calibration:
  • Actor Model Calibration:
  • Streaming
  • Record & Export
  • Motion Data analysis

Full-Body Tracking

Full-Body Tracking

With CapturyLive, starting the tracking process is easy and flexible. You can either manually place a 'skeleton' on top of a person visible in any of the video cameras, or let the system automatically search and find the person for you. The system adapts to changes in room brightness, and can track even when other people or objects are in the space.

Finger Tracking

Finger Tracking

The Finger Tracking module is offered as an add-on for CapturyLive. Finger Tracking is fully integrated with the full body tracking capabilities of the system and captures all finger segments.

Camera Calibration:

Camera Calibration:

Effortlessly calibrate your system with CapturyLive's streamlined three-step process. Begin by focusing the cameras, followed by lens calibration to measure lens distortion parameters and focal length for each camera. Finally, perform a volume calibration to establish a global world coordinate system and measure the relative position of each camera. While focusing and lens calibration are one-time events, volume calibration should be repeated each time the cameras are moved. With the entire process taking only 5-10 minutes, calibration is a breeze with CapturyLive.

Actor Model Calibration:

Actor Model Calibration:

To acquire and scale a new person, a two-stage process is employed. Firstly, a skeleton is overlaid onto the person in all video views and scaled to match their body dimensions. This is either done via an automatic search feature or the operator can drag and drop the skeleton on top of any person visible in the tracking area. In a second stage, the person is required to move around and perform various movements such as flexing their knees or arms. This helps to establish bone lengths and joint centers more accurately. The entire process only takes seconds.

Streaming

Streaming

Captury Live supports a wide range of streaming protocols through its easy-to-use plugins. Whether you choose to use one of our existing protocols or create your own, we have you covered. Our current list of supported real-time streaming formats includes: Unreal: Streaming into Unreal Engine uses our proprietary protocol to stream skeletons to Unreal. The data is then made available inside Unreal Engine by implementing a Live Link Plugin called Captury Live Link. You also can stream live into Unity, Motion Builder, and BoB. Additional streaming protocols include OSC, VRPN, ROS, and OSVR. For ultimate customization, our APIs enable you to build your own real-time streaming pipeline.

Record & Export

Record & Export

CapturyLive provides the ability to record motion and/or videos of your take, and offers a user-friendly framework for organizing the recordings according to your workflow and data management preferences. Additionally, it offers various export options, including FBX, BVH, C3D, or CSV formats, allowing you to export the specific data you require. This provides unmatched flexibility and adaptability for your motion capture requirements.

Motion Data analysis

Motion Data analysis

CapturyLive provides a comprehensive selection of charting tools for motion analysis and visualization. It enables the measurement of 3D kinematics, including the rotation and position of all primary bones and joints, including fingers. The user has the flexibility to add, delete, or modify charts according to their needs. Force plates from AMTI or Bertec or EMG from Noraxon are supported.

Face Tracking Solution

Our face tracking solutions are offered as an add-on to our full-body tracking solutions, CapturyLive or CapturyStudio, or as a stand-alone version.

How It Works

CapturyFace utilizes blendshapes for facial tracking and is compatible with the 52 blendshapes available in Apple's ARKit. Unlike many other systems that first predict keypoints and then calculate facial animation from them, CapturyFace directly predicts the extend to which the blendshapes should be activated. This streamlined approach allows for more efficient and accurate tracking of facial expressions.

Multiple Versions

We offer three distinct face capture models, each designed for different scenarios. The first model is a helmet-based system that is best suited for capturing high-quality facial data in large spaces. The second model is a static camera setup that is ideal for capturing detailed facial expressions and can be implemented using a simple webcam for pure face capture sessions. Lastly, our multi-camera setup utilizes cameras originally intended for body and finger tracking, which are also utilized to capture and track facial movements. Ultimately, the choice of your face capture system will depend on the specific needs and goals of your mocap project. Each system has its own strengths and limitations, and it's important to choose the system that best fits the context of the project.

Why use it

Combining facial mocap with full body and finger tracking can provide several benefits such as leading to more realistic and believable character animation, making the process more efficient and reducing the need for separate capture sessions. By capturing all aspects of the performance, including facial expressions, body movements, and finger motions, it is possible to achieve a higher level of detail in the final animation.

CapturyFace Functions

  • ARKit Compatible
  • Webcam Performance Capture
  • Headcam Support
  • Real-time Streaming

ARKit Compatible

ARKit Compatible

With CapturyFace, you have the freedom to utilize any ARKit-compatible character for your facial performance capture needs. Leveraging the power of Apple's 52 blendshapes, we deliver highly accurate activations, enabling you to capture nuanced facial expressions with ease.

Webcam Performance Capture

Webcam Performance Capture

With just a hd-webcam, you can seamlessly capture high-fidelity facial expressions without the need for specialized equipment or complex setups. Whether you're an animator, game developer, or content creator, our solution makes it easy to bring your characters' faces to life and focus on creating captivating content.

Headcam Support

Headcam Support

Additionally to supporting tracking with any quality webcam, we also support tracking footage of head-mounted cameras. Whether you prefer a webcam or a head-mounted camera, our solution ensures accurate tracking and precise motion capture for lifelike and immersive facial animations.

Real-time Streaming

Real-time Streaming

Seamlessly integrating into your existing workflow, our facial performance capture solution enables you to directly stream your captures into leading game engines and animation software. This streamlined process not only saves you time and effort but also ensures that you can immediately visualize and refine your facial performances within your familiar environments, accelerating your creative iterations and enhancing your overall production workflow.

Custom-Built, High-End Solutions for Larger Spaces and Tracking of 5+ People

CapturyInGame is a customized motion capture solution designed to track athletes in real-time during actual in-game situations, whether they are on the court or on the field.

How It Works

CapturyInGame is a motion capture solution specifically designed to track athletes in real-time during in-game situations. This system utilizes high resolution, high frame rate video cameras that are strategically placed around the court or field to track athletes movements. To process all the data in real-time, CapturyInGame requires multiple camera and tracking servers.

Why to Use it

CapturyInGame provides unrestricted motion capture and delivers reproducible and quantifiable 3D data quickly, providing significant benefits to coaches and players. The comprehensive human movement data can help professionals make decisions around high performance, injury prevention, risk management, and rehabilitation.

Real-Time or Offline

CapturyInGame offers versatile tracking capabilities suitable for various settings, whether indoor or outdoor. With real-time and post-processing versions available, it provides flexibility in acquiring and analyzing tracking data. For indoor basketball tracking, the real-time version of CapturyInGame delivers instant tracking data, enabling real-time monitoring of player movement and performance. When it comes to outdoor soccer tracking on a grass field, the post-processing version of CapturyInGame comes into play. This version allows you to capture game footage for later analysis, extracting tracking data at your convenience.