Comments (3)
We recommend using English or English & Chinese for issues so that we could have broader discussion.
from opencompass.
You can resume the experiment with -r
. Read https://opencompass.readthedocs.io/en/latest/user_guides/experimentation.html#launching-an-evaluation-task for details
from opencompass.
thank u I'll have a try
from opencompass.
Related Issues (20)
- [Bug] 为什么按官方文档跑会报错? HOT 4
- [Bug] Partition tasks sometimes fail due to occupied ports
- [Feature] Can we find the config version that is used to produce the score displayed on leaderboard?
- [Bug] The case in Figure 11 is not in the MMBench? HOT 1
- 在进行MPT-7B模型的评测时运行[Bug]
- [Bug] checkpoint load bug HOT 4
- [Bug] Medbench dataset HOT 6
- [Bug] about cil_em_evaluator.py
- [Bug] ERROR: opencompass/tasks/openicl_eval.py - _score - 236 - Task [opt125m/siqa]: No predictions found. HOT 4
- [Bug] HOT 1
- [Bug] Error when using multiple GPUs HOT 1
- [doc] Link check failed
- [Bug] HOT 3
- [Bug] 2.0 Rankings, Hover score cannot view configuration items. HOT 1
- [Feature] 如何在此项目上测试openai接口部署的模型在数据集上的表现 HOT 1
- [Feature] Support for Multi-Turn Inference Dataset HOT 3
- [Bug] Official website ranking page, unable to view configuration items when hovering over scores with mouse HOT 2
- [Bug] 运行成功后在summary文件夹中的结果都是为空的
- 多卡推理,内存溢出[Bug]
- [Feature] Add some examples in the documentation of how to sandbox the humaneval code execution
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opencompass.