Comments (3)
theagolden
commented on June 12, 2024
我遇到了相同的问题请问您是否已将问题解决
from opencompass.
HuntZhaozq
commented on June 12, 2024
可以把summary的调用注释掉就能解决
from opencompass.
theagolden
commented on June 12, 2024
您好您可以具体说一下是哪个summary吗，能否发一个代码片段
from opencompass.
Related Issues (20)
- [Feature] 支持openai/GPT4-o的评测seting HOT 1
- GenInferencer PPLInferencer 不能集成到一起吗[Feature] HOT 2
- [Feature] 如何在needlebench 中使用api model？ HOT 1
- [Feature] config的bug，提示下载configs，然后下载了又出现以下bug
- [Bug] unrecognized arguments: --no-batch-padding HOT 1
- opencompass榜单更新情况 HOT 2
- [Bug] hf_chatglm3_6b评测AFQMC数据集时，自测结果与官方不一致。且自测结果不稳定。 HOT 1
- No module named 'opencompass' HOT 9
- [Bug] Unable to use tutorial methods properly——KeyError: 'opt125m'or'opt350m' HOT 1
- [Bug] opencompass/cli和opencompass/datasets/IFEval下缺少__init__.py所以release版本是不能导入这两个包的 HOT 1
- [Bug] configs/datasets/agieval/agieval_mixed_713d14.py not found
- [Bug] llm-compression task faild at eval stage with latest version HOT 3
- [Bug] which version of the dataset should be selected When evaluating the Llama3 model,
- [Bug] run pytorch Qwen-7B-Chat with ARC-c ppl under CPU ,and result is not good HOT 1
- 大海捞针数据集初始化报错（ Failed to get opencompass.datasets.needlebench.origin.NeedleBenchOriginDataset）
- opencompass公开榜单更新[Feature] HOT 1
- [Bug] When testing on gen datasets, even if the output is empty or incorrect, unexpected scores can be obtained
- [Bug] Passing `trust_remote_code=True` will be mandatory to load this dataset from the next major release of `datasets`.
- [Bug] 不支持python3.10以上安装
- [Bug] ValueError: not enough values to unpack
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opencompass.