Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OpenAI compatible API #145

Closed
tgaddair opened this issue Dec 21, 2023 · 1 comment · Fixed by #171
Closed

OpenAI compatible API #145

tgaddair opened this issue Dec 21, 2023 · 1 comment · Fixed by #171
Labels
enhancement New feature or request

Comments

@tgaddair
Copy link
Contributor

We should support a version of the REST API that mirrors the OpenAI completion API, similar to vLLM:

https://docs.vllm.ai/en/latest/getting_started/quickstart.html#openai-compatible-server
@tgaddair tgaddair added the enhancement New feature or request label Dec 21, 2023
This was referenced Jan 8, 2024
Open
Merged
Merged
@tgaddair
Copy link
Contributor Author

This has landed, let me know how it goes!

@tgaddair tgaddair mentioned this issue Jan 10, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

OpenAI v1 Chat Completions API predibase/lorax
1 participant
@tgaddair