Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Docs] Add a few missing TRT-LLM options #2330

Merged
merged 1 commit into from
Aug 21, 2024
Merged

[Docs] Add a few missing TRT-LLM options #2330

merged 1 commit into from
Aug 21, 2024

Conversation

ethnzhng
Copy link
Contributor

@ethnzhng ethnzhng commented Aug 21, 2024 •
edited
Loading

  • Add a few undocumented TRT-LLM options to docs
  • Mention FP8 as a quantization option in docs

@ethnzhng ethnzhng marked this pull request as ready for review August 21, 2024 21:09
@ethnzhng ethnzhng requested review from zachgk, frankfliu and a team as code owners August 21, 2024 21:09
@ethnzhng ethnzhng merged commit a7a989a into deepjavalibrary:master Aug 21, 2024
3 checks passed
@ethnzhng ethnzhng deleted the docs-trtllm branch August 21, 2024 21:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nikhil-sk nikhil-sk nikhil-sk approved these changes

@sindhuvahinis sindhuvahinis sindhuvahinis approved these changes

@zachgk zachgk Awaiting requested review from zachgk zachgk is a code owner

@frankfliu frankfliu Awaiting requested review from frankfliu

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@ethnzhng @nikhil-sk @sindhuvahinis