MossFormer2_SE_48K模型权重适用于ClearerVoice-Studio代码库中的48 kHz语音增强任务。
该模型基于大规模数据集训练而成,其中包括开源数据和私有数据。
它通过去除背景噪音来增强语音音频质量。
克隆代码库
git clone https://github.com/modelscope/ClearerVoice-Studio.git创建 Conda 环境
cd ClearerVoice-Studio
conda create -n clearvoice python=3.8
conda activate clearvoice
pip install -r requirements.txt运行脚本
进入 clearvoice/ 目录并使用以下示例。MossFormer2_SE_48K 模型将从 huggingface 自动下载。
示例 1:使用语音增强模型 MossFormer2_SE_48K 处理 samples/input.wav 这一个音频文件,并将输出音频文件保存至 samples/output_MossFormer2_SE_48K.wav
from clearvoice import ClearVoice
myClearVoice = ClearVoice(task='speech_enhancement', model_names=['MossFormer2_SE_48K'])
output_wav = myClearVoice(input_path='samples/input.wav', online_write=False)
myClearVoice.write(output_wav, output_path='samples/output_MossFormer2_SE_48K.wav')示例 2:使用语音增强模型 MossFormer2_SE_48K 处理 samples/path_to_input_wavs/ 中的所有输入波形文件,并将所有输出文件保存至 samples/path_to_output_wavs
from clearvoice import ClearVoice
myClearVoice = ClearVoice(task='speech_enhancement', model_names=['MossFormer2_SE_48K'])
myClearVoice(input_path='samples/path_to_input_wavs', online_write=True, output_path='samples/path_to_output_wavs')示例 3:使用语音增强模型 MossFormer2_SE_48K 处理 samples/audio_samples.scp 文件中列出的波形文件,并将所有输出文件保存至 samples/path_to_output_wavs_scp/
from clearvoice import ClearVoice
myClearVoice = ClearVoice(task='speech_enhancement', model_names=['MossFormer2_SE_48K'])
myClearVoice(input_path='samples/scp/audio_samples.scp', online_write=True, output_path='samples/path_to_output_wavs_scp')