Automatic removal of inappropriate content

摘要

The disclosure generally describes computer-implemented methods, software, and systems for automatically removing inappropriate content. One example method includes: identifying a report of inappropriate content received from a user, the report identifying a content item the user has identified as inappropriate and an identification of the user, determining whether to automatically remove the content item based at least in part on the identity of the user, and removing the content item upon determining that the content should be removed. In some instances, the user is associated with a report weight. The report weight can be based, at least in part, on a business role of the user. Determining whether to automatically remove the content item may include determining that the user or a business role of the user is associated with an automatic removal rule, and removing the content item upon determining that the report is associated the user.

主权项

1. A computer-implemented method executed by one or more processors, the method comprising:
identifying a report of inappropriate content received from a user, the report identifying a content item the user has identified as inappropriate and an identification of the user, wherein each user is associated with a report weight associated specifically with the particular user, the report weight based at least in part on a business role of the particular user, and wherein the identified content item is associated with a content item report score; determining whether to automatically remove the content item based at least in part on the identity of the user, wherein determining whether to automatically remove the content item comprises:
determining whether the business role of the user is associated with an automatic removal rule, wherein the business role of the user is associated with an automatic removal rule when the report weight associated with the business role of the user meets or exceeds a predetermined removal threshold;in response to determining that the report weight associated with the business role of the user meets or exceeds the predetermined removal threshold, removing the content item without considering the content item report score; andin response to determining that the report weight associated with the business role of the user does not meet or exceed the predetermined removal threshold:
combining the report weight associated with the user and the content item report score to generate an aggregated content item report score; anddetermining whether the aggregated content item report score meets or exceeds the predetermined removal threshold; andremoving the content item upon determining that the content should be removed, wherein the determination that the content item should be removed is based on the aggregated content item score meeting or exceeding the predetermined removal threshold.