Sony Corp. has unveiled a mobile motion capture system that allows for real-time motion input to motion capture and virtual reality (VR) for use in the metaverse.
The system, called Mocopi, captures a user’s movements through small sensors that are placed on the head, wrists, hip and ankles. The system allows users to create avatars, videos and motion data using whole-body movements both indoors and outdoors through a motion input device such as a smartphone or VR headset.
The avatars could be used for gaming such as “VRChat,” VTube movies, shopping or fashion or other areas in the metaverse. It is also possible the system could be used in movie and animation production.
Sony said motion capture typically requires dedicated equipment and operators; however, Mocopi uses a proprietary algorithm to mimic motion measurement with its sensors.
Sony has released a mobile motion capture "mocopi" that realizes real-time motion input to motion capture and VR with only a small and lightweight sensor using proprietary technology and a smartphone (dedicated application).
The system will be available in Japan after its initial launch in mid-December. Sony is also planning a software development kit (SDK) that can link the motion data to the metaverse services and 3D development software. The SDK expands the use of motion data for activities such as full-body tracking, which could translate to new applications in the metaverse and fitness, Sony said.
In the video, a user straps on the sensors and creates an avatar in their home. Another user is shown outside doing a similar activity using the same sensors. Examples of how the sensors are able to motion capture the users are then shown and how these avatars can interact with the real-world in a mixed reality format.
