Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempted fix for main example getting stuck when -n -2 and --interactive #2767

Merged
merged 2 commits into from
Aug 24, 2023

Conversation

KerfuffleV2
Copy link
Collaborator

@KerfuffleV2 KerfuffleV2 commented Aug 24, 2023

I'm not sure this is the correct fix (seems fairly likely though since setting n_remain to -2 looks pretty weird).

Closes #2754

@KerfuffleV2 KerfuffleV2 added the bug Something isn't working label Aug 24, 2023
@ghost ghost mentioned this pull request Aug 24, 2023
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent! 🤣

@KerfuffleV2 KerfuffleV2 merged commit 7694add into ggerganov:master Aug 24, 2023
25 checks passed
@KerfuffleV2 KerfuffleV2 deleted the fix-main-stuck-interacting branch August 27, 2023 07:17
akawrykow pushed a commit to akawrykow/llama.cpp that referenced this pull request Aug 29, 2023
…ganov#2767)

* Fix for main example getting stuck when -n -2 and --interactive

* Add a comment so future generations may suffer less.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[User] -n -2 generates nothing
2 participants