Search results

使用swe_bench_verified测试集评测，会拉取docker hub的镜像，可是国内拉不下来

Status: Open.

#1320 In modelscope/evalscope;

· Wayne-Bfx opened on Apr 30, 2026

【SWE-bench】评测方式 && SWE-Bench Pro

Status: Open.

#1319 In modelscope/evalscope;

· twilighgt opened on Apr 29, 2026

如何自定义多模态大模型的视频评测数据集

Status: Open.

#1318 In modelscope/evalscope;

· JNlike opened on Apr 29, 2026

RuntimeError: Dataset scripts are no longer supported, but found code_generation_lite.py

Status: Open.

#1316 In modelscope/evalscope;

· Wayne-Bfx opened on Apr 29, 2026

关于对视频的支持

Status: Open.

#1313 In modelscope/evalscope;

· TidesFlow opened on Apr 27, 2026

【tau2-bench】用例个数与官方对不上 && retail领域数据偏低

Status: Open.

#1312 In modelscope/evalscope;

· twilighgt opened on Apr 27, 2026

random数据集下--max-tokens 参数无效

Status: Open.

#1304 In modelscope/evalscope;

· lixiaochong123 opened on Apr 20, 2026

部分数据集评测实际结果比官方低很多（在差值为30%的情况下，无法复现/接近官方数据）

Status: Open.

#1302 In modelscope/evalscope;

· twilighgt opened on Apr 20, 2026

是否能增加预热和爬坡功能

enhancementNew feature or requestNew feature or request

Status: Open.

#1299 In modelscope/evalscope;

· IssacLin opened on Apr 17, 2026

最近很多新模型在toolcall / 代码生成等任务上表现优异，希望evalscope能集成更多相关数据集的支持

enhancementNew feature or requestNew feature or request

Status: Open.

#1278 In modelscope/evalscope;

· fankexinxin opened on Apr 8, 2026

可以增加tau3-bench吗

enhancementNew feature or requestNew feature or request

Status: Open.

#1272 In modelscope/evalscope;

· zheng1xiao opened on Apr 7, 2026

perf-性能压测 1并发压测出现很长时间没有响应导致超时

Status: Open.

#1257 In modelscope/evalscope;

· jackqdldd opened on Mar 30, 2026