-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upgrade outlines to 0.1.1 #2658
Conversation
@Narsil any thoughts on this? We're using TGI with guidance in production and encountering parsing errors. Upgrading Outlines should fix some of those errors. If it makes the process easier I can open an issue as well. |
Thanks for this PR. Everything looks good, we upgraded other packets as well so the poetry.lock seems outdated now, could you rebase ? I can take care of it if you want, I'll open a PR for the CI to run, and we'll see if this breaks anything. |
CI running here : ( I manually rebased) #2690 |
And
|
|
5cfd934
to
79690a0
Compare
Closed in favor of : #2694 |
What does this PR do?
Upgrades Outlines package in the server to 0.1.1.
Outlines has released a number of fixes and improvements since the current version (0.0.34). Some highlights:
Compatibility with VLLMs
Support min/max number of digits for numbers in JSON Schema
Exclude escape character in JSON string fields (prevents invalid JSON generations)
Allow json ints to be negative
And more. This change should help everyone counting on reliable structured outputs.
Fixes # (issue)
Brings new improvements to regex parsing from Outlines
Before submitting
Pull Request section?
to it if that's the case. (Was not discussed)
documentation guidelines, and
here are tips on formatting docstrings. (No changes necessary)
Who can review?
@Narsil I noticed you reviewed the last Outlines version bump, so tagging you for review.