Methods and Systems for Six Degree-of-Freedom Haptic Interaction with Streaming Point Data

摘要

Methods, articles of manufacture, and devices related to generating six degree of freedom (DOF) haptic feedback are provided. A computing device can receive first depth data about an environment. The computing device can generate a first plurality of points from the first depth data. The computing device can determine a virtual tool, where the virtual tool is specified in terms of a translation component for the virtual tool and a rotation component for the virtual tool. The computing device can determine a first force vector between the virtual tool and the first plurality of points. The computing device can send a first indication of haptic feedback based on the first force vector.

主权项

1. A method, comprising:
receiving sensor data collected in a remote environment, wherein the sensor data includes information associated with an object in the remote environment; based on the information associated with the object, determining that the object is a recognized object; applying a label to the information associated with the object to identify the object as the recognized object; based on the sensor data, generating a virtual environment corresponding to the remote environment; creating a virtual fixture within the virtual environment, wherein the virtual fixture is associated with the labeled information; and rendering the virtual environment on a display.