Comments (3)
@cendelian SE and CBAM can be directly replaced with Triplet. CBAM, SE and Triplet are dimension preserving modules and thus don't affect the number of channels of the input tensor. SE and CBAM requires the channel parameter because it has a MLP structure which is not present in Triplet Attention. Hopefully this clarifies.
from triplet-attention.
@cendelian SE and CBAM can be directly replaced with Triplet. CBAM, SE and Triplet are dimension preserving modules and thus don't affect the number of channels of the input tensor. SE and CBAM requires the channel parameter because it has a MLP structure which is not present in Triplet Attention. Hopefully this clarifies.
thanks for you reply.
and if I use Triplet to replace SE or CBAM.
Does the pretrain can use?
for example. I use resnet with SE attention, but when I replace SE with triplet, the resnet pretrain can use?
maybe i need train resnet with triplet from scrach?
from triplet-attention.
@cendelian No you can't use a SE or CBAM pretrained network and replace them with Triplet. You need to retrain the network with Triple Attention from scratch. But we have provided the weights for pretrained networks which you can use.
from triplet-attention.
Related Issues (20)
- wandb error HOT 4
- No multiprocessing option HOT 5
- Pre-training weights loading HOT 5
- seems like the params are not used in `TripletAttention`'s definition? HOT 1
- The weights in google drive is demage!!! HOT 2
- The code for HeatMap visualization HOT 1
- load error HOT 3
- Improvement of Triple Attention HOT 3
- torch.cat( (torch.max(x, 1)[0].unsqueeze(1), torch.mean(x, 1).unsqueeze(1)), dim=1 ) HOT 1
- Hi,I wanna ask that how to calculate the AP value of. HOT 1
- error HOT 3
- Triplet Attention can be applied to EfficientNet in place SE? HOT 3
- How did you initialize TA weights? HOT 1
- A little question about adding attention to the network HOT 1
- I Have a question HOT 6
- mmdetection——fasterrcnn
- mmdetection_fasterrcnn HOT 3
- data loader issue in the training stage HOT 7
- 预训练模型加载 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from triplet-attention.