Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

idea: Expose DRY and XTC parameters in frontend #3950

Open
p-e-w opened this issue Nov 5, 2024 · 1 comment
Open

idea: Expose DRY and XTC parameters in frontend #3950

p-e-w opened this issue Nov 5, 2024 · 1 comment
Labels
category: model settings Inference params, presets, templates type: feature request A new feature

Comments

@p-e-w
Copy link

p-e-w commented Nov 5, 2024

Problem Statement

Llama.cpp has recently added support for the DRY and XTC sampling algorithms (ggerganov/llama.cpp#9702 and ggerganov/llama.cpp#9742, respectively).

DRY and XTC are widely used for creative tasks, and are recommended in the model cards of many popular finetunes.

Feature Idea

It would be nice to be able to set DRY and XTC parameters from the Jan frontend. SillyTavern already has a frontend for those samplers, which could be used as a reference.
@p-e-w p-e-w added the type: feature request A new feature label Nov 5, 2024
@imtuyethan imtuyethan added the category: model settings Inference params, presets, templates label Nov 5, 2024
@louis-jan
Copy link
Contributor

That's a great find. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
category: model settings Inference params, presets, templates type: feature request A new feature
Projects
Jan & Cortex
Status: Investigating
Milestone
No milestone
Development

No branches or pull requests
3 participants
@p-e-w @imtuyethan @louis-jan