Comments (2)
哇,秒回,感谢
from chinese-clip.
您好,这个问题确实是比较突出的,也和多机节点之间的通信网络性能有很大关系。我们在训练时,多机之间是支持RDMA通信的,我们启用了RDMA,这对于保证all_gather的性能和训练速度非常重要。
from chinese-clip.
Related Issues (20)
- windows 单机单卡 脚本运行 HOT 4
- 请问有用immich相册的吗?这个模型怎么集成进immich?
- 相同文图get_similarity的结果每次都不一样? HOT 1
- onnx的下载地址
- 数据准备格式疑问
- 图像描述数据集图文特征提取finetune HOT 1
- Finetune模型时遇到的一些问题 HOT 2
- 知识蒸馏的一些疑问 HOT 2
- muge + finetune + distllation 运行失败, 寻求帮助 HOT 1
- convert rn50x16 HOT 1
- 如何将模型微调后应用于图像分类?
- 升级成deepspeed 多机器并行会比启动torch 并行方便很多
- Transform image to base64 string use PIL problem
- 您好,我想进行文搜图的任务。在notebook的演示流程中有需要8G显存的微调流程,但是我的笔记本只有6G,请问是否可以不进行微调,直接进行尝试? HOT 1
- 相同的文本词,使用encode_text产出的结果不一样 HOT 1
- 自建数据集微调的疑问 HOT 1
- 预训练模型授权洽詢
- hugging face demo访问出错了 HOT 1
- loss 为0 HOT 1
- 训练数据集图文多对多的情况,直接采样分类交叉熵是不是有问题?训练集应该怎么处理?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chinese-clip.