-
-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow modificatons of completionParams via sendMessage #434
Allow modificatons of completionParams via sendMessage #434
Comments
Makes sense and happy to accept a PR for this.
Thanks! |
How would you like the interface to look ? Would we add a public function for updating the params or add options to sendmessage ? |
Just adding it as an additional option to const completionParams = { ...this._completionParams, ...opts.completionParams } |
@markNZed this is now supported in https://github.com/transitive-bullshit/chatgpt-api/releases/tag/v5.1.1 🔥 |
I finally got to testing this and ran into problems. Do we need to be able to dynamically set: maxResponseTokens and maxModelTokens. Is it possible to do this with the OpenAI API ? A minor issues was a change in the artialResponse.delta starting with special characters that no longer went through JSON.stringify(partialResponse.delta) but that is not a big deal. |
Describe the feature
For options like temperature it seems OpenAPI supports changing this per chatCompletion message. For example, on a server we might have one API instance the is sending messages for different clients with different temperature ?
The text was updated successfully, but these errors were encountered: