---
格式版本: 2
标题: "NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference"
原文链接: "https://arxiv.org/abs/2609.01657"
发布日期: "2026-08-31"
发布时间校准状态: "found"
发布时间需复核: "否"
发布时间来源: "rule:local:strict_original_body"
发布时间证据: "**\\[v1\\]** Mon, 31 Aug 2026 13:08:15 UTC (5,517 KB)"
发布时间校准原因: "规则确认唯一严格发布时间，来源 local:strict_original_body"
发布时间校准置信度: "high"
发布时间候选数量: 18
发布时间严格候选数量: 6
发布时间原页读取状态: "source template page reused from URL open"
发布时间未找到原因: ""
发布时间校准时间: "2026-09-04T01:41:18+08:00"
发布时间仲裁状态: "skipped"
发布时间仲裁尝试次数: 0
发布时间仲裁耗时毫秒: 0
发现时间: "2026-09-04T01:40:33+08:00"
入库时间: "2026-09-03T17:41:18.185Z"
来源平台: "arXiv 学术论文搜索"
搜索渠道: "source_template"
搜索词: "https://arxiv.org/search/?query=NVIDIA&searchtype=all"
匹配关键词:
  - "throughput"
  - "AI"
相关厂家:
  - "NVIDIA"
相关专家:
  []
内容类型: "网页"
抓取工具: "Free Fetch + Defuddle"
清洗工具: "Defuddle Markdown + Defuddle/Readability 正文提取"
原始附件:
  []
AI优质: "否"
AI打分: 15
AI分档: "非优质"
AI质检状态: "不通过"
AI打分理由: "论文主题为多模态编码器NeoMME，仅提及NVIDIA L40S作为测试硬件，未涉及超节点、AI Rack、机柜级基础设施、供电散热互连或量产落地，与项目关注范围无关。"
AI质检模型: "zj-deepseek-v4-flash"
AI质检时间: "2026-09-04T01:41:29+08:00"
AI主题相关性: 0
AI来源权威性: 5
AI新颖性: 5
AI技术细节: 0
AI商业部署信号: 0
AI完整性: 5
AI摘要: "NeoMME 提出一种单塔多模态多语言双向编码器，分别有 260M 和 800M 参数，从零预训练并用多语言文本与原始图像处理视觉文档检索，避免生成式 VLM 的额外开销。"
AI摘要模型: "ali-deepseek-v4-flash"
AI摘要时间: "2026-09-04T00:17:56.257Z"
采集批次: "2026年9月3日22点43分34秒"
采集批次ID: "20260903-224334-406"
去重键: "https://arxiv.org/abs/2609.01657"
---

## Computer Science > Information Retrieval

## Title:NeoMME: A Single-Tower Multimodal-Native Multilingual Foundation Encoder for Efficient Fine-Tuning and Inference

Authors:[Aurélien Lac](https://arxiv.org/search/cs?searchtype=author&query=Lac,+A), [Tony Wu](https://arxiv.org/search/cs?searchtype=author&query=Wu,+T)

[View PDF](https://arxiv.org/pdf/2609.01657) [HTML (experimental)](https://arxiv.org/html/2609.01657v1)

> Abstract:Multimodal models often build on architectures designed for generative vision-language modeling, typically combining separately pretrained vision encoders with causal language models. Visual document retrievers such as ColPali repurpose these models as encoders, carrying over the parameter and compute overhead of a VLM for a non-generative task.  
> We introduce NeoMME, a family of 260M and 800M-parameter Multimodal and Multilingual bidirectional Encoders that process multilingual text and raw image patches in a single bidirectional Transformer encoder. Both models are pretrained from scratch with a masked discrete-diffusion text objective, conditioned on visible image patches for multimodal examples. Both support a 16,384-token context, enough to encode up to two standard 4K UHD images.  
> To demonstrate its downstream capabilities, we fine-tune NeoMME with jointly trained dense and late-interaction heads. On the ViDoRe v3 benchmark, the resulting NeoMME-Retriever 260M outperforms all evaluated models strictly below 800M parameters with 0.523 nDCG@10, while NeoMME-Retriever 800M reaches 0.556. At a matched 2048x2048 image input size on an NVIDIA L40S, NeoMME-260M encodes pages with about 2x the throughput of ColModernVBERT. Hierarchical token pooling and asymmetric quantization compress late-interaction multimodal document embeddings by 255x while preserving over 95% of baseline nDCG@10. We contribute NeoMME to Hugging Face Transformers and release the pretrained backbone and retrieval-compatible checkpoints under Apache 2.0 at [this https URL](https://hf.co/collections/Hcompany/neomme).

| Subjects: | Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV) |
| --- | --- |
| Cite as: | [arXiv:2609.01657](https://arxiv.org/abs/2609.01657) \[cs.IR\] |
|  | (or [arXiv:2609.01657v1](https://arxiv.org/abs/2609.01657v1) \[cs.IR\] for this version) |
|  | [https://doi.org/10.48550/arXiv.2609.01657](https://doi.org/10.48550/arXiv.2609.01657) |

## Submission history

From: Tony Wu \[[view email](https://arxiv.org/show-email/ee8ed6ac/2609.01657)\]  
**\[v1\]** Mon, 31 Aug 2026 13:08:15 UTC (5,517 KB)

[Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2609.01657) | Disable MathJax ([What is MathJax?](https://info.arxiv.org/help/mathjax.html))