Using natural movements of a hand-held device to manipulate digital content

摘要

A mobile device, such as a smart phone, is provided with a camera. Digital content displayed on display screen of the mobile device may be manipulated in response to natural movements of the mobile device by a user. Motion of the mobile device is detected relative to a nearby textured surface by analyzing images of the textured surface. The displayed digital content is manipulated in response to the detected motion of the mobile device.

主权项

1. A mobile device comprising:
processing logic encased in a housing; a user input device coupled to the processing logic; a display screen on a surface of the housing coupled to the processing logic; and a camera mounted to the housing, coupled to the processing logic, and operable to receive an image of a textured surface located nearby to the mobile device, wherein the processing logic is operable to:
display digital content on the display screen of the mobile device;receive the image of the textured surface from the camera;define a virtual world coordinate system that is referenced to the image of the textured surface;transform digital content to the virtual world coordinate system;determine a camera pose of the camera in relationship to the textured surface;track the camera pose periodically as the camera is moved relative to the textured surface to detect motion of the mobile device relative to the textured surface; anddisplay on a display screen of the mobile device a rendered version of the transformed digital content responsive to the camera pose, such that the digital content displayed on the display screen is manipulated in response to the detected motion of the mobile device.