怎么修改能一键替换SE 和CBAM about triplet-attention HOT 3 CLOSED

@cendelian SE and CBAM can be directly replaced with Triplet. CBAM, SE and Triplet are dimension preserving modules and thus don't affect the number of channels of the input tensor. SE and CBAM requires the channel parameter because it has a MLP structure which is not present in Triplet Attention. Hopefully this clarifies.

from triplet-attention.

@cendelian SE and CBAM can be directly replaced with Triplet. CBAM, SE and Triplet are dimension preserving modules and thus don't affect the number of channels of the input tensor. SE and CBAM requires the channel parameter because it has a MLP structure which is not present in Triplet Attention. Hopefully this clarifies.

thanks for you reply.
and if I use Triplet to replace SE or CBAM.
Does the pretrain can use?
for example. I use resnet with SE attention, but when I replace SE with triplet, the resnet pretrain can use?
maybe i need train resnet with triplet from scrach?

from triplet-attention.

@cendelian No you can't use a SE or CBAM pretrained network and replace them with Triplet. You need to retrain the network with Triple Attention from scratch. But we have provided the weights for pretrained networks which you can use.

from triplet-attention.