Speech signal separation and synthesis based on auditory scene analysis and speech modeling

摘要

Provided are systems and methods for generating clean speech from a speech signal representing a mixture of a noise and speech. The clean speech may be generated from synthetic speech parameters. The synthetic speech parameters are derived based on the speech signal components and a model of speech using auditory and speech production principles. The modeling may utilize a source-filter structure of the speech signal. One or more spectral analyzes on the speech signal are performed to generate spectral representations. The feature data is derived based on a spectral representation. The features corresponding to the target speech according to a model of speech are grouped and separated from the feature data. The synthetic speech parameters, including spectral envelope, pitch data and voice classification data are generated based on features corresponding to the target speech.

主权项

1. A method for generating clean speech from a mixture of noise and speech, the method comprising:
deriving speech parameters, based on the mixture of noise and speech and a model of speech, the deriving using at least one hardware processor, wherein the deriving speech parameters comprises:
performing one or more spectral analyses on the mixture of noise and speech to generate one or more spectral representations;deriving, based on the one or more spectral representations, feature data;grouping target speech features in the feature data according to the model of speech;separating the target speech features from the feature data; andgenerating, based at least partially on the target speech features, the speech parameters; and synthesizing, based at least partially on the speech parameters, clean speech.