---
格式版本: 2
标题: "Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis"
原文链接: "https://arxiv.org/abs/2609.03992"
发布日期: "2026-09-03"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Thu, 3 Sep 2026 15:30:22 UTC (1,004 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-06T21:25:41+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-06T21:24:50+08:00"
入库时间: "2026-09-06T13:25:41.077Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all"
匹配关键词:
  - "Scale-up"
相关厂家:
  []
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 15
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "该资料为arXiv上一篇关于语音配音与对话合成的学术论文，内容完全不涉及超节点、AI Rack、机柜级AI基础设施、高速互连、供电、液冷等关注范围，仅在搜索词中命中Scale-up但实质无关。判定为无关。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-06T21:25:55+08:00"
AI主题相关性: 0
AI来源权威性: 10
AI新颖性: 0
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "Alignment-Free Text-Audiobox（Text-AB）提出统一框架，基于扩散Transformer和流匹配目标，免强制对齐，用3B参数模型在48万小时语音上预训练，实现高质量配音和全双工对话合成。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-06T23:44:14.839Z"
采集批次: "2026年9月6日19点27分09秒"
采集批次ID: "20260906-192709-237"
去重键: "https://arxiv.org/abs/2609.03992"
---

## Computer Science > Computation and Language

## Title:Alignment-Free Text-Audiobox for Voice Dubbing and Full-Duplex Dialogue Synthesis

[View PDF](https://arxiv.org/pdf/2609.03992) [HTML (experimental)](https://arxiv.org/html/2609.03992v1)

> Abstract:We present Alignment-Free Text-Audiobox (Text-AB), a unified framework for high-quality voice dubbing and full-duplex dialogue synthesis. Building on a Diffusion Transformer trained with a flow-matching objective, Text-AB departs from the Audiobox system along three dimensions. First, it operates in a latent diffusion framework using DAC-VAE features that encode 48 kHz waveforms into a 25 Hz latent sequence, giving over 10x higher compression than previous EnCodec representations while improving resynthesis quality. Second, Text-AB is alignment-free: it consumes raw text via an off-the-shelf text encoder and learns text-speech alignment through cross-attention, removing the need for forced alignment and explicit duration prediction. Third, we scale model and data substantially, pretraining a 3B-parameter model on 480k hours of monolingual speech, followed by supervised fine-tuning on three downstream tasks: cross-lingual voice dubbing, full-duplex dialogue synthesis, and emotional full-duplex dialogue synthesis. At inference, Text-AB supports one-shot generation for up to ~1 min of speech and arbitrarily long-form generation via a multi-diffusion scheme, plus a multi-stage reranking strategy that enhances quality based on automated metrics. On a real-world dubbing benchmark, Text-AB delivers a step-change improvement over the latest internal dubbing system, with large gains in prosody similarity, voice similarity, naturalness, and shareability. For full-duplex dialogue synthesis, it approaches human recordings on short-form conversations and substantially outperforms the latest internal model on long-form human-likeness and expressivity, while natively modeling turn-taking, back-channeling, and emotional dynamics. For emotional dialogue synthesis, emotion conditioning significantly improves emotion alignment and emotional interaction quality over the unconditioned baseline.

| Subjects: | Computation and Language (cs.CL); Audio and Speech Processing (eess.AS) |
| --- | --- |
| Cite as: | [arXiv:2609.03992](https://arxiv.org/abs/2609.03992) \[cs.CL\] |
|  | (or [arXiv:2609.03992v1](https://arxiv.org/abs/2609.03992v1) \[cs.CL\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.03992](https://doi.org/10.48550/arXiv.2609.03992) |

## Submission history

From: Min-Jae Hwang \[[view email](https://arxiv.org/show-email/56fef4ac/2609.03992)\]  
**\[v1\]** Thu, 3 Sep 2026 15:30:22 UTC (1,004 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.03992) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))