Key Mismatch for Swin

[YuchuanTian]

When I am loading Swin checkpoint mask_rcnn_swin_small_patch4_window7.pth, I encountered a key mismatch:

load checkpoint from local path: checkpoints/mask_rcnn_swin_small_patch4_window7.pth
The model and loaded state dict do not match exactly

unexpected key in source state_dict: neck.fpn_convs.0.conv.weight, neck.fpn_convs.0.conv.bias, neck.fpn_convs.1.conv.weight, neck.fpn_convs.1.conv.bias, neck.fpn_convs.2.conv.weight, neck.fpn_convs.2.conv.bias, neck.fpn_convs.3.conv.weight, neck.fpn_convs.3.conv.bias

missing keys in source state_dict: backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.decoder.bias

Is this mismatch expected? Thanks!

[Mr-Bigworth]

这个实际上并不影响，因为这些缺少的权重就是作者添加的模块。

[Mr-Bigworth]

但是想请教一下，bert你们是怎么准备的哇，bert-base-uncased我应该怎样下载然后放到哪个目录呢

[zzoneee]

但是想请教一下，bert你们是怎么准备的哇，bert-base-uncased我应该怎样下载然后放到哪个目录呢

在这里下载：https://huggingface.co/bert-base-uncased
放到checkpoints目录下

[Mr-Bigworth]

但是想请教一下，bert你们是怎么准备的哇，bert-base-uncased我应该怎样下载然后放到哪个目录呢

在这里下载：https://huggingface.co/bert-base-uncased 放到checkpoints目录下

谢谢！！

[0713qq]

When I am loading Swin checkpoint mask_rcnn_swin_small_patch4_window7.pth, I encountered a key mismatch:

load checkpoint from local path: checkpoints/mask_rcnn_swin_small_patch4_window7.pth The model and loaded state dict do not match exactly

unexpected key in source state_dict: neck.fpn_convs.0.conv.weight, neck.fpn_convs.0.conv.bias, neck.fpn_convs.1.conv.weight, neck.fpn_convs.1.conv.bias, neck.fpn_convs.2.conv.weight, neck.fpn_convs.2.conv.bias, neck.fpn_convs.3.conv.weight, neck.fpn_convs.3.conv.bias

missing keys in source state_dict: backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.decoder.bias

Is this mismatch expected? Thanks!

请问这个问题你解决了吗，我也遇到了相同的问题

[YuchuanTian]

If i haven‘t made it wrong (since it is two years ago) disregarding these warning is fine.On Aug 8, 2024, at 13:00, 0713qq ***@***.***> wrote: When I am loading Swin checkpoint mask_rcnn_swin_small_patch4_window7.pth, I encountered a key mismatch: load checkpoint from local path: checkpoints/mask_rcnn_swin_small_patch4_window7.pth The model and loaded state dict do not match exactly unexpected key in source state_dict: neck.fpn_convs.0.conv.weight, neck.fpn_convs.0.conv.bias, neck.fpn_convs.1.conv.weight, neck.fpn_convs.1.conv.bias, neck.fpn_convs.2.conv.weight, neck.fpn_convs.2.conv.bias, neck.fpn_convs.3.conv.weight, neck.fpn_convs.3.conv.bias missing keys in source state_dict: backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.0.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.0.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.0.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.1.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.1.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.1.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.2.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.2.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.2.qdatt.SpatialGate.spatial.decoder.decoder.bias, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.V, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, backbone.layers.3.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.V, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, backbone.layers.3.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.V, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.decoder.weight, backbone.layers.3.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.0.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.0.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.0.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.1.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.1.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.1.qdatt.SpatialGate.spatial.decoder.decoder.bias, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.V, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.decoder.weight, neck.fpn_down.2.qdatt.ChannelGate.mlp.0.decoder.decoder.bias, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.V, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.decoder.weight, neck.fpn_down.2.qdatt.ChannelGate.mlp.2.decoder.decoder.bias, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.V, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.decoder.weight, neck.fpn_down.2.qdatt.SpatialGate.spatial.decoder.decoder.bias Is this mismatch expected? Thanks! 请问这个问题你解决了吗，我也遇到了相同的问题 —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***>