Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do you only apply transpose MAMBA under channel independent settings? #10

Open
liuquangao opened this issue Aug 17, 2024 · 1 comment
Open

Comments

@liuquangao
Copy link

Thank you for your outstanding work! I was wondering if the transpose mamba is only applied with variable independent settings. If so, what are your considerations for designing it this way? It seems to me that the mamba transpose is modeling relationships between variables. Looking forward to your answers, thanks again!

@Atik-Ahamed
Copy link
Owner

Sorry for the delayed response. For channel independence, it meant to capture details in both ways. However, for channel mixing, our experimental results did not provide as much improvement, if considered in transposed way. However, thanks for your interest. We believe that this has more scope to explore further.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants