COMPREHENSIVE SAFETY SCHEMA FOR ENSURING APPROPRIATENESS OF LANGUAGE IN ONLINE CHAT

摘要

A method is disclosed for evaluating a chat message sent between users of an online environment. The method may include associating each word in the chat message with metadata. The metadata identifies a word type and usage for each word in the chat message. This method may also include identifying one or more safety rules associated with the metadata. Each safety rule identifies an ordered sequence of one or more sets of words. This method may also include applying the safety rule to the chat message to determine whether a sequence of words in the chat message present in the ordered sequence of sets of words. Upon determining a word, from each set of words in the ordered sequence of sets of words, matches a respective one of the words in the chat message, the chat message is blocked from being sent to a message recipient.

主权项

1. A computer-implemented method for evaluating a chat message sent between users of an online environment, comprising:
associating each word in the chat message with metadata, wherein the metadata identifies a word type and usage for each word in the chat message; identifying one or more safety rules associated with the metadata, wherein each safety rule identifies an ordered sequence of one or more sets of words; applying the safety rule to the chat message to determine whether a sequence of words in the chat message present in the ordered sequence of sets of words; and upon determining a word, from each set of words in the ordered sequence of sets of words, matches a respective one of the words in the chat message, blocking the chat message from being sent to a message recipient.