Discussions

• 1 You must be logged in to vote

  🙏

  使用��置文件运行时，如何指定并发任务量？

  qing-yuan233 asked Feb 24, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  ppl和gen模式有什么区别，可以用通俗的语言解释一下吗

  xealml asked Nov 15, 2023 in Q&A · Answered

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  主观评测中AlpacaEval数据集来源

  wangxu0820 asked Oct 15, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  按照文档中用大模型做为JudgeLLM进行客观评测的指导，运行时报错，SubjectiveSizePartitioner.__init__() got an unexpected keyword argument 'mode'，貌似是SubjectiveSizePartitioner这个类里面不支持mode这个初始化参数，请教下该怎么修改

  lilirm asked Oct 22, 2024 in Q&A · Answered

  

  

  9
• 1 You must be logged in to vote

  🙏

  flame 数据集设置配不明白，文档部分没看懂

  Redias asked Sep 9, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  为什么运行到一半出现oom的情况？

  AriesHaa asked Jun 20, 2024 in Q&A · Answered

  

  

  

  

  4
• 2 You must be logged in to vote

  🙏

  为什么--max-partition-size从opencompass/cli/main.py的参数中被移除了？Why max-partition-size is removed in #1098?

  airaria asked May 28, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  如何���opencompass输出的评测结果与leaderboard上的比较？

  CSammyfd asked May 29, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  如何单独进行infer和eval

  IcyFeather233 asked Apr 3, 2024 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  How to cancel a running job? 怎么停止一个任务？

  Spico197 asked Dec 22, 2023 in Q&A · Answered

  

  

  5
• 1 You must be logged in to vote

  🙏

  Are all leaderboard results evaluated under 0-shot?

  zhimin-z asked Dec 11, 2023 in Q&A · Answered

  

  

  6
• 1 You must be logged in to vote

  🙏

  How to evaluate chat-based models on examination datasets (e.g. C-Eval) properly?

  Owen-Qin asked Dec 7, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Why the inference always fallback to CPU?

  magic282 asked Dec 4, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  配置好自定义api后运行python run.py xx_api.py，始终报json错误这是什么原因？

  shensj12 asked Nov 29, 2023 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Regarding PPL and GEN modes, could you please provide more details or clarify your question? Thanks

  niexufei asked Nov 29, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  What is GAOKAO-2023?

  zhimin-z asked Nov 22, 2023 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to Load and Evaluate a Local HF-Formatted Model.

  liu904-61 asked Nov 20, 2023 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Where can I download the MMBench-test-CN and MMBench-dev-CN benchmark

  laserwave asked Sep 28, 2023 in Q&A · Answered

  

  

  

  

  10
• 1 You must be logged in to vote

  🙏

  如何设置模型推理时的参数，如top_k? How to set the generation config of the model, like the temperature.

  royny asked Aug 29, 2023 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Can the evaluation continue after modifying the model configuration? 模型配置更改后，评测是否能够继续？

  niexufei asked Sep 11, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  About the evaluation of OpenChat-13b-V3.2 etc.

  niexufei asked Sep 1, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  测试llama-7b的指标与opencompass贴出来的指标不一致

  yangjianxin1 asked Aug 23, 2023 in Q&A · Answered

  

  

  12
• 1 You must be logged in to vote

  🙏

  有办法用 4090 跑 13b 模型吗

  Darmody asked Aug 24, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  关于c-eval评测的结果

  L-hongbin asked Aug 18, 2023 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  adding new dataset - registry error

  ycYiwei asked Aug 4, 2023 in Q&A · Answered

  

  

  2