Skip to content

Commit

Permalink
fix(settings): set default tokenizer to avoid running make setup fail (
Browse files Browse the repository at this point in the history
  • Loading branch information
imartinez committed Mar 13, 2024
1 parent 84ad16a commit d17c34e
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions settings.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ llm:
# Should be matching the selected model
max_new_tokens: 512
context_window: 3900
tokenizer: mistralai/Mistral-7B-Instruct-v0.2
temperature: 0.1 # The temperature of the model. Increasing the temperature will make the model answer more creatively. A value of 0.1 would be more factual. (Default: 0.1)

llamacpp:
Expand Down

0 comments on commit d17c34e

Please sign in to comment.