Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add adapters to Vision Transformer #363

Merged
merged 11 commits into from
Jun 29, 2022
Merged

Add adapters to Vision Transformer #363

merged 11 commits into from
Jun 29, 2022

Conversation

calpt
Copy link
Member

@calpt calpt commented Jun 7, 2022 •
edited
Loading

This PR:

  • adds adapter implementation to the VisionTransformer model
  • introduces a new image classification flex head
  • Moves embedding training into a separate EmbeddingAdaptersMixin mixin
  • modifies adapter tests to support vision models via VisionAdapterTestBase

@calpt calpt changed the title Dev/vit Add adapters to Vision Transformer Jun 8, 2022
@calpt calpt force-pushed the dev/vit branch 2 times, most recently from f007bd2 to 94bec82 Compare June 21, 2022 07:15
@calpt calpt marked this pull request as ready for review June 29, 2022 12:09
@calpt calpt merged commit ebbddb8 into adapter-hub:master Jun 29, 2022
@calpt calpt deleted the dev/vit branch June 29, 2022 12:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@calpt