GLM-5.3 与 GLM-5.2 使用相同的基座模型——所有提升均来自后训练。相比 GLM-5.2,它在复杂编码和长程任务上表现明显更优:

| 基准测试 | GLM-5.3 | GLM-5.2 | Kimi K3 | DeepSeek-V4 Pro-0813 | Qwen3.8-Max | Opus 4.8 | Fable 5 (w/ fallback) | GPT-5.6 Sol |
|---|---|---|---|---|---|---|---|---|
| Terminal Bench 2.1 | 88.2 | 81.0 | 88.3 | 87.9 | 86.6 | 85.0 | 88.0 | 88.8 |
| Terminal Bench 3.0 | 28.3 | 4.6 | 17.4 | – | – | 21.1 | 33.7 | 34.6 |
| DeepSWE (v1.1) | 66.9 | 46.2 | 67.5 | 62.7 | 56.6 | 58.0 | 69.7 | 72.7 |
| NL2Repo | 58.0 | 48.9 | 58.0 | 61.1 | 55.9 | 69.7 | – | – |
| ProgramBench (Almost Solved) | 19.0 | 9.5 | 17.5 | – | 10.5 | 15.5 | 33.0 | 23.0 |
| FrontierSWE | 78.1 | 67.5 | – | – | – | 66.5 | 88.2 | – |
| SWE-Marathon (v1.1) | 42.5 | 19.4 | 48.1 | – | – | 48.8 | 33.1 | 42.5 |
| PostTrainBench | 39.8 | 31.7 | 32.0 | – | – | 32.9 | 41.8 | 36.2 |
| CyberGym | 84.5 | 77.2 | 80.0 | 83.3 | 78.5 | 78.1 | 83.8 | 83.6 |
| ExploitGym (2h / 6h) | 105 / 130 | 29 / 39 | 36 / 70 | – | 14 / 26 | 80 / 120 | 181 / 247 | 216 / 293 |
| ExploitBench | 54.4 | 24.4 | 32.2 | – | 28.8 | 40.0 | 78.0 | 76.5 |
| Toolathlon Verified | 73.0 | 59.9 | 76.5 | 74.1 | 72.5 | 76.2 | 74.7 | 74.9 |
| AutomationBench (v1.0.6) | 48.2 | 26.2 | 46.7 | 43.2 | 39.8 | 41.0 | 46.2 | 45.8 |
| Agents' Last Exam (ALE-CLI) | 28.5 | 23.8 | 27.6 | 25.7 | 27.0 | 25.7 | 23.8 | 28.6 |
| HLE w/ Tools | 62.5 | 54.7 | 59.8 | 60.0 | 56.2 | 57.9 | 63.9 | 64.5 |
| GDPval-AA v2 | 1769 | 1508 | 1682 | 1590 | 1739 | 1588 | 1743 | 1730 |
GLM-5.3 支持通过以下框架部署,欢迎试用:
Ascend NPU 平台上部署时,支持 vLLM-Ascend、xLLM 和 SGLang 等推理框架 — 详见此处。reasoning_effort 参数控制思考预算,该参数接受三个级别:low、high 和 max。若未传入(或设置为其他值),默认值为 max。若需使用 low 或 high,请显式传入。在基准测试和排行榜复现中,请保持默认的 max。clear_thinking 若未传入则默认为 false。在对话场景中,请显式传入 clear_thinking=true。temperature=1.0 和 top_p=0.95,最大生成长度为 163,840 tokens。评估在最大上下文长度 300,000 tokens 下进行,并使用上下文管理策略。我们使用 GPT-5.6-luna(medium)作为评判模型。temperature=1.0、top_p=1.0,max_new_tokens=64k。为防止作弊,我们结合规则判断和基于 LLM 的判断,以防止恶意行为(例如未经授权的 pip 或 curl 操作)。temperature=0.95、top_p=1.0、timeout=6h,上下文长度为 400K。temperature=1.0、top_p=1、max_new_tokens=65536,超时时间为 6 小时。null 类型处理问题的修复。temperature=1.0、top_p=1.0、max_new_tokens=128000)。所有评估对每个任务均不限超时,结果为 1,507 个任务上单次运行的 Pass@1。为模拟真实使用场景,我们将智能体置于任务容器内。同时,我们移除所有与 Git 相关的信息,并应用域名白名单(仅允许 pypi.org 和 deb.debian.org 等用于基础工具安装的必需域名),以防止智能体作弊。temperature=1.0、top_p=1.0、max_new_tokens=128000)。所报告的结果是在 869 个任务上单次运行的 Pass@1,采用两种超时预算:2 小时和 6 小时。该超时预算由 API 推理时间按各模型的每秒 token 速率折算后再加非 API 开销计算得到(各模型 TPS 数据来自 Artificial Analysis;即我们按 115 TPS 对 GLM-5.3 的结果进行缩放,按 40 TPS 对 Kimi K3 的结果进行缩放,按 47 TPS 对 Qwen3.8 Max 的结果进行缩放)。我们同样应用域名白名单(仅允许 pypi.org 和 deb.debian.org 等用于基础工具安装的必需域名),以防止智能体作弊。temperature=1.0、top_p=1.0、max_new_tokens=128000)。按照官方评估设置,我们将智能体与环境之间的最大交互轮数限制为 300,并在 3 个修订版本中的全部 41 个任务上计算平均覆盖率得分。单个任务的覆盖率结果通过取所有修订版本中已实现能力的并集确定,平均得分通过对各结果求平均得到。我们同样应用域名白名单(仅允许 pypi.org 和 deb.debian.org 等用于基础工具安装的必需域名),以防止智能体作弊。temperature = 1.0、top_p = 1.0、max_new_tokens = 128000,以及 1M token 上下文窗口。我们报告 3 次运行的加权平均。对于未能产生得分的运行,回退到官方的零样本基座模型基线得分。对于旨在防止使用第三方 API 的检查,我们移除了原有的基于模式匹配的检查,因为通过 OpenAI SDK 访问本地 vLLM 端点时会产生误报。相反,我们使用 LLM 智能体检查解决方案中是否存在外部 API 使用。temperature = 1.0、top_p = 0.95、max_new_tokens = 128000,以及 1M token 上下文窗口。对于 strip-clone,原有的防作弊检查使用了过宽的导入检测,可能会拒绝有效实现。我们移除了受影响检查,并改用基于 LLM 的检查以避免误报。对于 parameter-golf 和 trimul-cuda,NVIDIA wheel 包的变更导致 Docker 镜像构建失败,因此我们添加了 --extra-index-url https://pypi.org/simple 以恢复成功构建。如果您在研究工作中发现 GLM-5.3 有用,请引用我们的技术报告:
@misc{glm5team2026glm5vibecodingagentic,
title={GLM-5: from Vibe Coding to Agentic Engineering},
author={GLM-5-Team and : and Aohan Zeng and Xin Lv and Zhenyu Hou and Zhengxiao Du and Qinkai Zheng and Bin Chen and Da Yin and Chendi Ge and Chenghua Huang and Chengxing Xie and Chenzheng Zhu and Congfeng Yin and Cunxiang Wang and Gengzheng Pan and Hao Zeng and Haoke Zhang and Haoran Wang and Huilong Chen and Jiajie Zhang and Jian Jiao and Jiaqi Guo and Jingsen Wang and Jingzhao Du and Jinzhu Wu and Kedong Wang and Lei Li and Lin Fan and Lucen Zhong and Mingdao Liu and Mingming Zhao and Pengfan Du and Qian Dong and Rui Lu and Shuang-Li and Shulin Cao and Song Liu and Ting Jiang and Xiaodong Chen and Xiaohan Zhang and Xuancheng Huang and Xuezhen Dong and Yabo Xu and Yao Wei and Yifan An and Yilin Niu and Yitong Zhu and Yuanhao Wen and Yukuo Cen and Yushi Bai and Zhongpei Qiao and Zihan Wang and Zikang Wang and Zilin Zhu and Ziqiang Liu and Zixuan Li and Bojie Wang and Bosi Wen and Can Huang and Changpeng Cai and Chao Yu and Chen Li and Chengwei Hu and Chenhui Zhang and Dan Zhang and Daoyan Lin and Dayong Yang and Di Wang and Ding Ai and Erle Zhu and Fangzhou Yi and Feiyu Chen and Guohong Wen and Hailong Sun and Haisha Zhao and Haiyi Hu and Hanchen Zhang and Hanrui Liu and Hanyu Zhang and Hao Peng and Hao Tai and Haobo Zhang and He Liu and Hongwei Wang and Hongxi Yan and Hongyu Ge and Huan Liu and Huanpeng Chu and Jia'ni Zhao and Jiachen Wang and Jiajing Zhao and Jiamin Ren and Jiapeng Wang and Jiaxin Zhang and Jiayi Gui and Jiayue Zhao and Jijie Li and Jing An and Jing Li and Jingwei Yuan and Jinhua Du and Jinxin Liu and Junkai Zhi and Junwen Duan and Kaiyue Zhou and Kangjian Wei and Ke Wang and Keyun Luo and Laiqiang Zhang and Leigang Sha and Liang Xu and Lindong Wu and Lintao Ding and Lu Chen and Minghao Li and Nianyi Lin and Pan Ta and Qiang Zou and Rongjun Song and Ruiqi Yang and Shangqing Tu and Shangtong Yang and Shaoxiang Wu and Shengyan Zhang and Shijie Li and Shuang Li and Shuyi Fan and Wei Qin and Wei Tian and Weining Zhang and Wenbo Yu and Wenjie Liang and Xiang Kuang and Xiangmeng Cheng and Xiangyang Li and Xiaoquan Yan and Xiaowei Hu and Xiaoying Ling and Xing Fan and Xingye Xia and Xinyuan Zhang and Xinze Zhang and Xirui Pan and Xu Zou and Xunkai Zhang and Yadi Liu and Yandong Wu and Yanfu Li and Yidong Wang and Yifan Zhu and Yijun Tan and Yilin Zhou and Yiming Pan and Ying Zhang and Yinpei Su and Yipeng Geng and Yong Yan and Yonglin Tan and Yuean Bi and Yuhan Shen and Yuhao Yang and Yujiang Li and Yunan Liu and Yunqing Wang and Yuntao Li and Yurong Wu and Yutao Zhang and Yuxi Duan and Yuxuan Zhang and Zezhen Liu and Zhengtao Jiang and Zhenhe Yan and Zheyu Zhang and Zhixiang Wei and Zhuo Chen and Zhuoer Feng and Zijun Yao and Ziwei Chai and Ziyuan Wang and Zuzhou Zhang and Bin Xu and Minlie Huang and Hongning Wang and Juanzi Li and Yuxiao Dong and Jie Tang},
year={2026},
eprint={2602.15763},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2602.15763},
}