Skip to content

Commit

Permalink
server : update readme [no ci]
Browse files Browse the repository at this point in the history
  • Loading branch information
ggerganov committed Oct 13, 2024
1 parent 5a699f1 commit bf28ea5
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions examples/server/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -524,6 +524,12 @@ Takes a prefix and a suffix and returns the predicted completion as stream.

- `input_prefix`: Set the prefix of the code to infill.
- `input_suffix`: Set the suffix of the code to infill.
- `prompt`: Added after the `FIM_MID` token
- `extra_context`: Additional context inserted before the FIM prefix. See https://github.com/ggerganov/llama.cpp/pull/9874

```txt
[extra context]<FIM_PRE>[input_prefix]<FIM_SUF>[input_suffix]<FIM_MID>[prompt]
```

It also accepts all the options of `/completion`.

Expand Down

0 comments on commit bf28ea5

Please sign in to comment.