You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@LysandreJik, it says flash attention. So I thought it was a different thing 😅. You can close this if you consider them the same issue. I will try to work on some models in my free time.
Feature request
many of the newer models have an sdpa implementation. It could be good that some of the older models get up to speed.
Motivation
this could be good to unify the API more.
and improve training\inference speed for some of the older models like OPT.
Your contribution
Might be able to help with a few. this one seems bigger than the other feature request i opened, so will probably need more help
The text was updated successfully, but these errors were encountered: