Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Add response_format to OpenAI based LLMs #955

Draft
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

martin-purplefish
Copy link
Contributor

@martin-purplefish martin-purplefish commented Oct 18, 2024

Fixes #689

  • Support tool calls

Copy link

changeset-bot bot commented Oct 18, 2024

🦋 Changeset detected

Latest commit: 15feab7

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
livekit-plugins-openai Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@jayeshp19
Copy link
Collaborator

@martin-purplefish Streaming will not be supported if we provide response formant

@martin-purplefish martin-purplefish changed the title Add response_format to OpenAI based LLMs WIP Add response_format to OpenAI based LLMs Oct 18, 2024
@martin-purplefish
Copy link
Contributor Author

@jayeshp19 nice call - updated. This works now, but it's quite slow (a few seconds for the response)

@martin-purplefish martin-purplefish changed the title WIP Add response_format to OpenAI based LLMs Add response_format to OpenAI based LLMs Oct 18, 2024
@martin-purplefish martin-purplefish changed the title Add response_format to OpenAI based LLMs [WIP] Add response_format to OpenAI based LLMs Oct 18, 2024
@martin-purplefish martin-purplefish marked this pull request as draft October 18, 2024 17:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Adding Support for Structured Outputs for Openai models!
2 participants