Comments (1)
Hi @dingjingzhen, thanks for your support in LLMLingua and your suggestion. The best-performing compressor currently is “llmlingua-2-xlm-roberta-large-meetingbank.” I believe your idea is promising, but implementing it will require some design and experiments. We may attempt this in the future, and if you are interested in conducting some experiments, we would be happy to collaborate.
from llmlingua.
Related Issues (20)
- Meaningless tokens generation HOT 3
- [Feature Request]: Lingua2 can discards tokens based on a probability threshold HOT 1
- [Bug]: 返回中文会出现乱码 HOT 2
- Troubleshooting Issues in LlamaIndex RAG Demo after Updating to Version 0.10
- [Question]: Reproduce LLMLingua-2 results with Mistral-7B HOT 3
- [Question]: Reproducing the score of official microsoft/llmlingua-2-xlm-roberta-large-meetingbank HOT 6
- [Question]: LongBench BM25 reproduce HOT 3
- [Question]: How to combine longllmlingua and llmlingua2 ? HOT 1
- [Question]: longbench数据集测试对context和question的压缩 HOT 2
- Experiments[Question]: HOT 2
- [Question]: Token indices sequence length is longer than the specified maximum sequence length for this model (614 > 512). Running this sequence through the model will result in indexing errors HOT 1
- [Bug]: NotImplementedError HOT 1
- [Question]: Is It Possible to Share the Code how to Do the evaluation HOT 3
- [Question]: How to get `meetingbank_test_3qa_pairs_summary_formated.json`? HOT 2
- [Question]: Fail to reproduce llmlingua on meetingbank HOT 1
- [Question]: How to utilize compression to a finetuned LLM? HOT 1
- [Question]: cannot import name 'PromptCompressor' from partially initialized module 'llmlingua' HOT 1
- [Question]: LLMLingua-2 Sample-Wise Dynamic Compression Ratio HOT 2
- How can I speed up using llmlingua2 ? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llmlingua.