论文前沿论文推理模型测试时扩展剪枝Pass@k

[论文] Direct Pass@$k$ Optimization for Thought Pruning: Balancing Quality and Diversity in Test-Time Reasoning

来源:arXiv AI 论文收录:2026/10/23

✦ AI 解读

该论文研究测试时推理中的候选解剪枝问题。现有方法分为基于质量(预测正确性)和基于多样性(覆盖不同推理路径)两类,二者存在权衡。作者提出 Direct Pass@k 优化方法,旨在剪枝时同时平衡最终答案的质量与多样性,从而在减少计算量的同时保持推理性能。对关注推理模型测试时扩展和高效推理的研究者与工程师有参考价值。

Test-time scaling has emerged as a key inference strategy for reasoning models, where a model generates a large number of candidate solutions in the hope of finding at least one correct solution. Running all candidate solutions to completion can be computationally demanding, so recent work prunes the candidate pool after generating only a short prefix, committing further computation only to the surviving candidates. Existing pruning strategies divide broadly into two categories: Quality-based methods assign a score to each partial solution and discard those predicted to ultimately lead to an incorrect final solution, while diversity-based methods select partial solutions that follow different reasoning trajectories and are therefore likely to cover different final solutions. The tension be
查看原文 ↗

相关推荐

Rapidly scaling online storage to serve over 1 billion ChatGPT users (Part II)
✦ AI 摘要OpenAI 发布技术博客第二部分,详解如何通过可靠的多租户架构、全局缓存和 Azure Cosmos DB 扩展 Habitat 在线存储系统,以支撑超过 10 亿 ChatGPT 用户,并实现读取速度提升 12 倍。文章聚焦大规模分布式存储的工程实践,对 AI 基础设施从业者具有参考价值。
AI Is Getting Good at Math. Here’s Why.
✦ AI 摘要文章探讨了AI模型在数学问题求解上日益增强的能力,并指出这些成功案例中正浮现出一种模式,该模式有望帮助预测AI接下来能解决哪些数学问题。内容涉及模型推理能力的评估与趋势分析,对关注AI数学推理进展的研究者和从业者具有参考价值。
AI Article Reviews Dominate Human Peer Reviews at Their Best [pdf]
✦ AI 摘要哈佛大学 Gary King 等人发布论文《Peerless》,研究 AI 文章评审与人类同行评审的对比。研究发现,在最佳情况下,AI 评审的表现优于人类同行评审,引发对学术评审流程中 AI 应用的讨论。该论文为 PDF 格式,在 Hacker News 上获得 1 分、0 条评论。