Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MODEL] Add DeepSeek-V2 support #51

Merged
merged 9 commits into from
Jun 26, 2024
Merged

[MODEL] Add DeepSeek-V2 support #51

merged 9 commits into from
Jun 26, 2024

Conversation

LRL-ModelCloud
Copy link
Contributor

@LRL-ModelCloud LRL-ModelCloud commented Jun 24, 2024

Resolves #48

@Qubitium Qubitium marked this pull request as ready for review June 24, 2024 15:21
@Qubitium Qubitium merged commit 0c78a06 into main Jun 26, 2024
2 of 3 checks passed
@Qubitium Qubitium deleted the add-deepseek-v2-support branch June 26, 2024 10:41
DeJoker pushed a commit to DeJoker/GPTQModel that referenced this pull request Jul 19, 2024
DeJoker pushed a commit to DeJoker/GPTQModel that referenced this pull request Jul 19, 2024
* add deepseel_v2 support

* need require_trust_remote_code = True

* fix typo, need "shared_experts", not "shared_expert"

* cleanup code

* clear up layer_modules

---------

Co-authored-by: LRL-ModelCloud <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEATURE] DeepSeek V2 Chat Support
2 participants