Shared Scene Mesh Data Synchronization

摘要

A user device within a communication architecture, the user device comprising: an image capture device configured to determine image data and intrinsic/extrinsic capture device data for the creation of a video channel defining a shared scene; a surface reconstruction entity configured to determine surface reconstruction data associated with the image data from the image capture device; a video channel configured to encode and packetize the image data and intrinsic/extrinsic capture device data; a surface reconstruction channel configured to encode and packetize the surface reconstruction data; a transmitter configured to transmit the video and surface reconstruction channel packets; and a bandwidth controller configured to control the bandwidth allocated to the video channel and the surface reconstruction channel.

主权项

1. A method comprising:
receiving object attribute messages based on object interaction instructions for interacting with interactive objects in a mixed reality scene; determining whether a frame period has ended; responsive to determining that the frame period has not ended:
receiving other object attribute messages; responsive to determining that the frame period has ended:
determining an estimate of a network capacity;determining an object priority for a specified object;setting a limit on a number of interactive object updates during a frame period, the limit being based on at least one of the estimate of the network capacity and the object priority;determining a set of most recent object attribute messages for the specified object in accordance with the limit on the number of interactive object updates during the frame period; anddeleting in a receive path object attribute messages corresponding to the specified object that are not in the set of most recent object attribute messages.