Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge 0223 #8

Merged
merged 246 commits into from
Feb 24, 2024
Merged

Merge 0223 #8

merged 246 commits into from
Feb 24, 2024

Conversation

renning22
Copy link

Why are these changes needed?

Related issue number (if applicable)

Checks

  • I've run format.sh to lint the changes in this PR.
  • I've included any doc changes needed.
  • I've made sure the relevant tests are passing (if applicable).

Trangle and others added 30 commits August 31, 2023 18:34
@Trangle
Remove hardcode flash-attn disable setting (lm-sys#2342)
2264580
@nathanstitt
Document turning off proxy_buffering when api is streaming (lm-sys#2337)
24a8755
@merrymercy
Simplify huggingface api example (lm-sys#2355)
b039a66
@merrymercy
Update sponsor logos (lm-sys#2367)
ea045e6
@leiwen83 @wenlei03
if LOGDIR is empty, then don't try output log to local file (lm-sys#2357
85bec47 
)

Signed-off-by: Lei Wen <[email protected]>
Co-authored-by: Lei Wen <[email protected]>
@leiwen83 @wenlei03
add best_of and use_beam_search for completions interface (lm-sys#2348)
f99663c 
Signed-off-by: Lei Wen <[email protected]>
Co-authored-by: Lei Wen <[email protected]>
@merrymercy
Extract upvote/downvote from log files (lm-sys#2369)
3cf04c2
@merrymercy
Revert "add best_of and use_beam_search for completions interface" (l…
94f4dd6 
…m-sys#2370)
@merrymercy
Improve doc (lm-sys#2371)
dc3dd12
@leiwen83 @wenlei03
add best_of and use_beam_search for completions interface (lm-sys#2372)
a5e6abf 
Signed-off-by: Lei Wen <[email protected]>
Co-authored-by: Lei Wen <[email protected]>
@merrymercy
update monkey patch for llama2 (lm-sys#2379)
1d703b2
@merrymercy
Make E5 adapter more restrict to reduce mismatch (lm-sys#2381)
56744d1
@merrymercy
Update UI and sponsers (lm-sys#2387)
6af0a7c
@merrymercy
Use fsdp api for save save (lm-sys#2390)
9b3147e
@merrymercy
Release v0.2.27
a6167db
@jondurbin @j-durbin
Spicyboros + airoboros 2.2 template update. (lm-sys#2392)
7dcdafe 
Co-authored-by: Jon Durbin <[email protected]>
@Rayrtfr
bugfix of openai_api_server for fastchat.serve.vllm_worker (lm-sys#2398)
b921f16 
Co-authored-by: wuyongyu <[email protected]>
@merrymercy
Revert "bugfix of openai_api_server for fastchat.serve.vllm_worker" (l…
13f40b3 
…m-sys#2400)
@merrymercy
Revert "add best_of and use_beam_search for completions interface" (l…
77aa4df 
…m-sys#2401)
@merrymercy
Release a v0.2.28 with bug fixes and more test cases
11b05bb
@wangxiyuan
Fix model_worker error (lm-sys#2404)
a8088ba
@wangzhen263
Added google/flan models and fixed AutoModelForSeq2SeqLM when loading…
b49d789 
… T5 compression model (lm-sys#2402)
@karshPrime
Rename twitter to X (lm-sys#2406)
7dfcf1a
@merrymercy
Update huggingface_api.py (lm-sys#2409)
aa153d5
@obitoquilt
Add support for baichuan2 models (lm-sys#2408)
3149253
@Somezak1
Fixed character overlap issue when api streaming output (lm-sys#2431)
2e0e60b
@hi-jin
Support custom conversation template in multi_model_worker (lm-sys#2434)
c7e3e67
@zhangsibo1129
Add Ascend NPU support (lm-sys#2422)
c685951
@tobiabir
Add raw conversation template (lm-sys#2417) (lm-sys#2418)
54a8353
@merrymercy
Improve docs & UI (lm-sys#2436)
1119c51
dheeraj-326 and others added 27 commits January 28, 2024 22:05
@dheeraj-326
Adding download folder information in README (lm-sys#2972)
dc26514
@bjwswang
use cl100k_base as the default tiktoken encoding (lm-sys#2974)
a3aa5cd 
Signed-off-by: bjwswang <[email protected]>
@merrymercy
Update README.md (lm-sys#2975)
81b80fd
@Michaelvll
Fix tokenizer for vllm worker (lm-sys#2984)
29c2bd3
@wangpengfei1013
update yuan2.0 generation (lm-sys#2989)
707d9ba
@congchan
fix: tokenization mismatch when training with different templates (lm…
9924687 
…-sys#2996)
@congchan
fix: inconsistent tokenization by llama tokenizer (lm-sys#3006)
3bef934
@MonkeyLeeT
Fix type hint for play_a_match_single (lm-sys#3008)
81785d7
@infwinston
code update (lm-sys#2997)
2264204
@infwinston
Update model_support.md (lm-sys#3016)
6a530e1
@eltociear
Update lightllm_integration.md (lm-sys#3014)
1db84d0
@infwinston
Upgrade gradio to 4.17 (lm-sys#3027)
3f61c6e
@aliasaria
Update MLX integration to use new generate_step function signature (l…
ddb2cc9 
…m-sys#3021)
@merrymercy
Update readme (lm-sys#3028)
8c6443e
@merrymercy
Update gradio version in pyproject.toml and fix a bug (lm-sys#3029)
7c12409
@merrymercy
Update gradio demo and API model providers (lm-sys#3030)
b9d4d15
@BabyChouSr @merrymercy
Gradio Web Server for Multimodal Models (lm-sys#2960)
98b8f64 
Co-authored-by: Lianmin Zheng <[email protected]>
@merrymercy
Migrate the gradio server to openai v1 (lm-sys#3032)
e087d6e
@merrymercy @infwinston
Update version to 0.2.36 (lm-sys#3033)
b21d0f7 
Co-authored-by: Wei-Lin Chiang <[email protected]>
@merrymercy
Add llava 34b template (lm-sys#3034)
ac2a899
@merrymercy
Update model support (lm-sys#3040)
26505e2
@ShukantPal
Add psutil to pyproject.toml dependencies (lm-sys#3039)
324bcc6
@merrymercy
Fix SGLang worker (lm-sys#3045)
81225fc
@lisadunlap
Random VQA Sample button for VLM direct chat (lm-sys#3041)
4e734fe
@logankilpatrick
Update arena.md to fix link (lm-sys#3051)
ed6735d
@renning22
Merge commit 'ed6735d' into merge_0223
68c542c
@renning22
multi inference
ec856f3
renning22
renning22 commented Feb 24, 2024
View reviewed changes
Copy link
Author

@renning22 renning22 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@renning22 renning22 merged commit dac3317 into main Feb 24, 2024
0 of 2 checks passed
@renning22 renning22 deleted the merge_0223 branch February 24, 2024 07:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.