COMPONENT HEALTH MONITORING SYSTEM USING COMPUTER VISION

摘要

A component health monitoring system may include an optical system configured to irradiate an area containing a work implement and including a surface of a component to be inspected in a position mounted on the work implement, and a sensor configured to capture a target image of the area. An image processor may receive the target image from the sensor and analyze the target image, determine a first feature set including directional changes in image intensity for the target image, retrieve a reference image from a memory, and determine a second feature set for the reference image. The image processor may also build and train a model for use by a classifier that segregates feature sets determined from a plurality of target images into a first classification that includes features that characterize a portion of an image including the component with dimensions that fall within acceptable thresholds, and a second classification. A notification module notifies an operator of the machine when the image processor classifies a new target image as falling within the second classification.

主权项

1. A component health monitoring system for use with a machine, the component health monitoring system comprising:
an optical system configured to irradiate an area containing a work implement and including a surface of a component to be inspected in a position mounted on the work implement; a sensor configured to capture a target image of the area; an image processor configured to receive the target image from the sensor and analyze the target image, the image processor further configured to:
determine a first feature set for the target image;retrieve a reference image from a memory, wherein the reference image includes at least one of:
an image of the work implement with the component mounted on the work implement and having dimensions that fall within acceptable thresholds;an image of the work implement with one or more of the component missing from the work implement; andan image of the work implement with the component mounted on the work implement and having dimensions that fall outside of acceptable thresholds;determine a second feature set for the reference image;determine the first and second feature sets by determining a directional change in image intensity for one or more localized cells that each contain a plurality of pixels of the respective image; andbuild and train a model for use by a classifier that segregates feature sets determined from a plurality of target images into a first classification that includes features that characterize a portion of an image including the component with dimensions that fall within acceptable thresholds, and a second classification that includes features that characterize one of:
a portion of the image including the component with dimensions that fall outside of the acceptable thresholds; orthe component missing entirely from the portion of the image; and a notification module that notifies an operator of the machine when the image processor classifies a new target image as falling within the second classification.