Adaptable framework for cloud assisted augmented reality

摘要

A mobile platform efficiently processes sensor data, including image data, using distributed processing in which latency sensitive operations are performed on the mobile platform, while latency insensitive, but computationally intensive operations are performed on a remote server. The mobile platform acquires sensor data, such as image data, and determines whether there is a trigger event to transmit the sensor data to the server. The trigger event may be a change in the sensor data relative to previously acquired sensor data, e.g., a scene change in an image. When a change is present, the sensor data may be transmitted to the server for processing. The server processes the sensor data and returns information related to the sensor data, such as identification of an object in an image or a reference image or model. The mobile platform may then perform reference based tracking using the identified object or reference image or model.

主权项

1. A method comprising:
acquiring sensor data using a mobile platform, wherein the sensor data comprises at least one captured image of an object; tracking the object with visual based tracking using the at least one captured image of the object; determining whether there is a trigger event comprising a change in the sensor data relative to previously acquired sensor data, wherein the trigger event comprises a scene change in which a different object appears in the at least one captured image with respect to a previous captured image; transmitting the sensor data to a server when there is the trigger event while continuing to track the object with visual based tracking using the at least one captured image of the object; and receiving information related to the sensor data from the server.