only use 1d rope?

[junwuzhang19]

Hi, thanks for your great work!

I read the code and found emu3 only use 1d rope for both visual and language content. I wonder if 1d rope will bring some problems to image and video generation results.

Thanks!

[Wolfwjs]

Hi, thanks for your interest!

We chose to use 1d rope for simplicity, and it works well. However, exploring higher-dimensional RoPEs (like 2d or 3d) is definitely worth trying.