Audio and Video

Video: Sony enters the metaverse with mobile motion capture wearables

02 December 2022

Sony Corp. has unveiled a mobile motion capture system that allows for real-time motion input to motion capture and virtual reality (VR) for use in the metaverse.

The system, called Mocopi, captures a user’s movements through small sensors that are placed on the head, wrists, hip and ankles. The system allows users to create avatars, videos and motion data using whole-body movements both indoors and outdoors through a motion input device such as a smartphone or VR headset.

The avatars could be used for gaming such as “VRChat,” VTube movies, shopping or fashion or other areas in the metaverse. It is also possible the system could be used in movie and animation production.

Sony said motion capture typically requires dedicated equipment and operators; however, Mocopi uses a proprietary algorithm to mimic motion measurement with its sensors.

Sony has released a mobile motion capture "mocopi" that realizes real-time motion input to motion capture and VR with only a small and lightweight sensor using proprietary technology and a smartphone (dedicated application).

The system will be available in Japan after its initial launch in mid-December. Sony is also planning a software development kit (SDK) that can link the motion data to the metaverse services and 3D development software. The SDK expands the use of motion data for activities such as full-body tracking, which could translate to new applications in the metaverse and fitness, Sony said.

In the video, a user straps on the sensors and creates an avatar in their home. Another user is shown outside doing a similar activity using the same sensors. Examples of how the sensors are able to motion capture the users are then shown and how these avatars can interact with the real-world in a mixed reality format.

To contact the author of this article, email PBrown@globalspec.com


Powered by CR4, the Engineering Community

Discussion – 0 comments

By posting a comment you confirm that you have read and accept our Posting Rules and Terms of Use.
Engineering Newsletter Signup
Get the Engineering360
Stay up to date on:
Features the top stories, latest news, charts, insights and more on the end-to-end electronics value chain.
Advertisement
Weekly Newsletter
Get news, research, and analysis
on the Electronics industry in your
inbox every week - for FREE
Sign up for our FREE eNewsletter
Advertisement
Find Free Electronics Datasheets
Advertisement