STRUCTURING OF SEMI-STRUCTURED LOG MESSAGES

摘要

Automated structuring of semi-structured log messages is disclosed. One example is a system including a formatting engine to identify shared file formats for a plurality of semi-structured log messages. A representative message identifier identifies representative messages of the plurality of log messages based on the shared file formats. A message segmenter segments the representative messages where each segment corresponds to a message fragment that repeats in a sub-plurality of the log messages. A message similarity evaluator determines a similarity metric for a pair of representative messages, the similarity metric based on a weighted edit distance between segments of messages in the pair of representative messages. A structured message builder converts each representative message to a structured message comprising a string of tokens, the converting based on the similarity metric. A data analytics portal provides the structured messages for operations analytics.