Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Attention XML to nn.networks (Working in Progress) #321

Closed
wants to merge 4 commits into from

Conversation

donglihe-hub
Copy link
Contributor

@donglihe-hub donglihe-hub commented Jul 10, 2023

What does this PR do?

UPDATED on 4 Aug

  1. Add AttentionXML and FastAttentionXML (Embedding NOT implemented).
  2. Update PyTorch dependency to 2.0.0.
  3. Experimenting TorchMetric 1.0.
  4. Experimenting the default logger in Lightning.

Will Update API after we discuss the PR.

Test CLI & API (bash tests/autotest.sh)

Test APIs used by main.py.

  • Test Pass
    • (Copy and paste the last outputted line here.)
  • Not Applicable (i.e., the PR does not include API changes.)

Check API Document

If any new APIs are added, please check if the description of the APIs is added to API document.

  • API document is updated (linear, nn)
  • Not Applicable (i.e., the PR does not include API changes.)

Test quickstart & API (bash tests/docs/test_changed_document.sh)

If any APIs in quickstarts or tutorials are modified, please run this test to check if the current examples can run correctly after the modified APIs are released.

@donglihe-hub donglihe-hub force-pushed the attxml branch 2 times, most recently from 9f81b2b to 32c5d6f Compare July 10, 2023 14:46
@donglihe-hub donglihe-hub force-pushed the attxml branch 26 times, most recently from 07fbe8c to e45e9c5 Compare August 2, 2023 12:10
@donglihe-hub
Copy link
Contributor Author

obsolete

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants