About SA_Layer

[Hzj199]

When the convolution weight of q and k are initialized equal,
self.q_conv.conv.weight = self.k_conv.conv.weight
will it cause q and k to be always the same when updated?

[MenghaoGuo]

It only works when it is initialized, and does not affect the update.

[aniqueakhtar]

It only works when it is initialized, and does not affect the update.

But what is the purpose of this? Why are they initialized to the same weight?