腾讯混元联合多所高校发布MMAE，首个大规模多任务音频编辑基准，评估模型按指令精确修改音频的能力，当前模型精确匹配率低于5%
多源视角
Can AI truly edit audio, not just generate it? 🎧<br><br>Tencent Hy, in collaboration with SJTU, SII, NTU, TJU, ZODA, PKU, FDU, and other collaborators, introduces MMAE.<br><br>MMA…
查看这条来源Can AI truly edit audio, not just generate it? 🎧<br><br>Tencent Hy, in collaboration with SJTU, SII, NTU, TJU, ZODA, PKU, FDU, and other collaborators, introduces MMAE.<br><br>MMA…
查看这条来源Can AI truly edit audio, not just generate it? 🎧<br><br>Tencent Hy, in collaboration with SJTU, SII, NTU, TJU, ZODA, PKU, FDU, and other collaborators, introduces MMAE.<br><br>MMA…
查看这条来源AI 摘要
腾讯混元联合上海交通大学、新加坡南洋理工大学等多所高校发布MMAE，这是首个大规模多任务音频编辑基准。MMAE要求AI理解现有音频并根据自然语言指令精确修改，而非简单生成。基准包含2000个真实场景样本、17741个细粒度评估项，覆盖7种模态、6级任务复杂度、8种操作类型。当前模型精确匹配率（EMR）低于5%，揭示了可靠音频编辑能力的重大缺口，为开发者提供了明确的评测标准。 核心观点： 1. MMAE包含2000个高保真样本和17741个细粒度评估项，覆盖声音、音乐、语音及其混合共7种模态。 2. 当前模型在MMAE上的精确匹配率（EMR）低于5%，表明音频编辑能力存在显著不足。 3. MMAE设计了6级任务复杂度，从基础修改到多跳推理和多轮编辑，以及8种操作类型覆盖局部和全局粒度。
推荐理由高信息密度，值得细读
原文
Tencent Hy, in collaboration with SJTU, SII, NTU, TJU, ZODA, PKU, FDU, and other collaborators, introduces MMAE.
MMAE--A Massive Multitask Audio Editing Benchmark, is the first comprehensive evaluation benchmark for speech and audio "Banana🍌"
Instead of simply requiring the AI to "generate" audio, it demands that the AI understand an existing audio clip and precisely modify it according to natural language instructions—altering what needs to be changed while leaving the rest untouched.
Current models show an Exact Match Rate (EMR) below 5%, revealing a major gap in reliable audio editing.
MMAE includes: ✅ 2,000 high-fidelity samples from real-world scenarios ✅ 17,741 fine-grained rubric evaluation items ✅ 7 modality settings across sound, music, speech and their mixtures ✅ 6 task complexity from basic modifications to multi-hop reasoning and multi-round editing ✅ 8 operation types across local and global granularities
How to use: arXiv: http://arxiv.org/abs/2606.07229 GitHub: https://github.com/ddlBoJack/MMAE HuggingFace: https://huggingface.co/datasets/BoJack/MMAE Demo: https://youtu.be/6At5nTWhlXI
讨论
暂无评论。