Comments (1)
Thanks for the attention. We will update the rank of 13B models in this week.
from opencompass.
Related Issues (20)
- 有没有一些能够减少显存的操作,我在推理128k的needlebench时,8张A100仍然显存爆炸[Feature] HOT 1
- 官网上每个数据集所使用的config文件的版本如何知道? HOT 1
- /home/wumao/opencompass-main/opencompass/summarizers/needlebench.py 的sizes是不是少了一个128k [Bug] [Feature] HOT 1
- [Bug] 使用自定义数据集对讯飞API模型进行评测,为何得分是 0 HOT 2
- [Feature] 8卡A100*80G评测Qwen1.5-72B推荐的参数设置是怎么样的呢
- cmb_gen [bug]
- 测试本地hf模型,怎么确定合适的max-out-len,比如storycloze[Feature] HOT 1
- CMB + Qwen1.5-72B-Chat got empty answers HOT 1
- storycloze_gen 测试不通过,显示torch.distributed.elastic.multiprocessing.api.SignalException [Feature]
- [Feature] Typos in the official document HOT 1
- [Bug] math_gen数据集评估随机失败 HOT 4
- 可以创建一个微信群吗? HOT 2
- [Feature] AGIEval数据集是否可以支持few-shot评测设置?
- [Bug] run with transformers==4.40.2, error "HuggingFacewithChatTemplate does not support ppl-based evaluation".
- the prompt for triviaqa dataset
- [Feature] MMLU-PRO HOT 1
- [Bug] RACE数据集在hf-llama-7b上的评测结果异常
- 自定义的模型API都要配置步骤有哪些,除了写config文件外 HOT 2
- [Bug] 评测 Hellaswag 失败 HOT 1
- [Bug] 根据官方的Quick Start运行,输出结果为空 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opencompass.