Comments (2)
deepcs233
commented on September 1, 2024
Hi!
Sorry for the late reply. I've been very busy lately.
It's an experimental feature, and you can simply replace the forward function and other related functions from LlamaAttention with those from LlamaFlashAttention2. I also update the code.
from lmdrive.
Luke20000429
commented on September 1, 2024
I've included that in my local repo, but not a bad thing for you to include in your public repo.
from lmdrive.
Related Issues (20)
- Training Issues HOT 1
- Cannot reproduce the reported performance HOT 1
- 坐标系定义 HOT 1
- Agent couldn't be set up HOT 1
- About how specifically LMDrive works HOT 1
- Bad evaluation performace on CARLA HOT 1
- Dockerize the whole repo ! HOT 1
- Segmentation fault when using server ubuntu, remote desktop HOT 1
- No such file or directory: 'sensor_pretrain.pth.tar.r50'
- Training time HOT 1
- The problem of model feature extraction from decoder HOT 3
- Carla get_trafficmanager stuck HOT 1
- What is the meaing of `measurements[frame_id]["x_command"]` and `measurements[frame_id]["y_command"]` HOT 2
- windows or ubuntu？
- Deploy locally HOT 1
- Disabling core dumps. HOT 1
- 如何测试自己采集的数据 HOT 2
- LLM权重放在哪里呢？ HOT 1
- 只运行evaluate.py是否可以直接测试一个仅包含四路相机+激光点云的真实数据
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lmdrive.