In the code class WeightedPermuteMLP, after h = h.permute(0, 3, 2, 1, 4), h becomes (B, segment_dim, W, H, S); after w = w.permute(0, 1, 3, 2, 4), w becomes (B, H, segment_dim, W, S). My question is why can't w also be turned into (B, segment_dim, H, W, S) #6

lxy51 · 2024-09-25T07:17:27Z

In the code class WeightedPermuteMLP, after h = h.permute(0, 3, 2, 1, 4), h becomes (B, segment_dim, W, H, S); after w = w.permute(0, 1, 3, 2, 4), w becomes (B, H, segment_dim, W, S). My question is why can't w also be turned into (B, segment_dim, H, W, S)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

In the code class WeightedPermuteMLP, after h = h.permute(0, 3, 2, 1, 4), h becomes (B, segment_dim, W, H, S); after w = w.permute(0, 1, 3, 2, 4), w becomes (B, H, segment_dim, W, S). My question is why can't w also be turned into (B, segment_dim, H, W, S) #6

In the code class WeightedPermuteMLP, after h = h.permute(0, 3, 2, 1, 4), h becomes (B, segment_dim, W, H, S); after w = w.permute(0, 1, 3, 2, 4), w becomes (B, H, segment_dim, W, S). My question is why can't w also be turned into (B, segment_dim, H, W, S) #6

lxy51 commented Sep 25, 2024

In the code class WeightedPermuteMLP, after h = h.permute(0, 3, 2, 1, 4), h becomes (B, segment_dim, W, H, S); after w = w.permute(0, 1, 3, 2, 4), w becomes (B, H, segment_dim, W, S). My question is why can't w also be turned into (B, segment_dim, H, W, S) #6

In the code class WeightedPermuteMLP, after h = h.permute(0, 3, 2, 1, 4), h becomes (B, segment_dim, W, H, S); after w = w.permute(0, 1, 3, 2, 4), w becomes (B, H, segment_dim, W, S). My question is why can't w also be turned into (B, segment_dim, H, W, S) #6

Comments

lxy51 commented Sep 25, 2024