fistyee / mixpro Goto Github PK
View Code? Open in Web Editor NEW🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]
License: MIT License
🔥MixPro: Data Augmentation with MaskMix and Progressive Attention Labeling for Vision Transformer [Official, ICLR 2023]
License: MIT License
Dear @fistyee
When are you planning to release code?
Dear @fistyee
I have followed your installation instruction and after completing one epoch it gives an error.
Code
loss 6.5611 (6.7661) grad_norm 2.8034 (nan) mem 12138MB
[2023-06-08 11:25:02 deit_small_patch14_mask56_224_alpha1](main.py 488): INFO Train: [0/300][4970/5004] eta 0:00:37 lr 0.000051 time 1.0590 (1.1059)loss 6.6133 (6.7656) grad_norm 2.9514 (nan) mem 12138MB
[2023-06-08 11:25:13 deit_small_patch14_mask56_224_alpha1](main.py 488): INFO Train: [0/300][4980/5004] eta 0:00:26 lr 0.000051 time 1.1264 (1.1059)loss 6.3637 (6.7652) grad_norm 3.3315 (nan) mem 12138MB
[2023-06-08 11:25:24 deit_small_patch14_mask56_224_alpha1](main.py 488): INFO Train: [0/300][4990/5004] eta 0:00:15 lr 0.000051 time 1.0718 (1.1058)loss 6.5798 (6.7649) grad_norm 2.6179 (nan) mem 12138MB
[2023-06-08 11:25:35 deit_small_patch14_mask56_224_alpha1](main.py 488): INFO Train: [0/300][5000/5004] eta 0:00:04 lr 0.000051 time 1.0397 (1.1058)loss 6.7300 (6.7645) grad_norm 3.6217 (nan) mem 12138MB
[2023-06-08 11:25:38 deit_small_patch14_mask56_224_alpha1](main.py 497): INFO EPOCH 0 training takes 1:32:13
Traceback (most recent call last):
File "main.py", line 645, in <module>
main(config)
File "main.py", line 237, in main
logger,
File "/home2/coremax/Documents/MixPro/utils.py", line 193, in save_checkpoint
save_state['amp'] = amp.state_dict()
AttributeError: 'NoneType' object has no attribute 'state_dict'
Hello,would you have a plan to update the Github?
Dear author,
How can i use MixPro to training a model based on Swin-Transformer?
作者,您好,想请问一下,您提出的这个数据增强的方法,是否可以用到其他数据集上,
比如我想用到我的 人脸表情识别数据集上,对不平衡类别的数据集做数据增强是可以的吗,将 将MixPro 数据增强方法应用到我的模型,具体要注意哪些吗
感谢您的回答
I am trying to run this code using CIFAR-10, how should I operate it
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.