Skip to content

Pull requests: sgl-project/sglang

New pull request New
16 Open 1,258 Closed
16 Open 1,258 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: update pyzmq version
#1983 opened Nov 10, 2024 by zhyncs Loading…
3 tasks
[Performance, Triton] Optimize over mask compute to tl.load in fused_moe_kernel
#1980 opened Nov 10, 2024 by HaiShaw Loading…
3
[WIP] Support DP MLA
#1970 opened Nov 9, 2024 by ispobock Loading…
@merrymercy
Offline LLM Engine Benchmark Throughput await-response
#1968 opened Nov 9, 2024 by zolinthecow Loading…
3 tasks done
@merrymercy @ByronHsu
3
Add model support for Phi 3.5 MoE await-response
#1948 opened Nov 7, 2024 by svaruag • Draft
3 tasks
@merrymercy
3
[rust] cache-aware DP - approx tree high priority
#1934 opened Nov 6, 2024 by ByronHsu Loading…
3 tasks done
@Ying1123
6
Scheduler methods high priority
#1913 opened Nov 4, 2024 by josephydu Loading…
@ByronHsu
22
[Draft] Add Tensor Parallel to torch_native_llama await-response
#1876 opened Nov 2, 2024 by kwen2501 Loading…
3 tasks
@merrymercy
26
chore: update torch v2.5.1
#1849 opened Oct 31, 2024 by zhyncs • Draft
3 tasks
@zhyncs
3
Debug studio await-response
#1831 opened Oct 29, 2024 by zolinthecow Loading…
3 tasks done
@ByronHsu
7
Granite and GraniteMoE models. await-response
#1818 opened Oct 27, 2024 by janimo • Draft
@merrymercy
2
[LoRA, Performance] Add gemm expand triton kernel for multi-LoRA
#1728 opened Oct 20, 2024 by Ying1123 • Draft
4 of 15 tasks
@Ying1123
Surpport kv cache int8/int4 for triton backend high priority
#1644 opened Oct 12, 2024 by yuguo-Jack Loading…
@merrymercy
17
[WIP] Spec infer with EAGLE2 high priority
#1498 opened Sep 24, 2024 by yukavio Loading…
3 tasks
@merrymercy
41
[Feature] Add initial support for sequence parallelism
#1436 opened Sep 16, 2024 by Ying1123 • Draft
@Ying1123
Function calling for OpenAI backend
#573 opened Jun 29, 2024 by Yiyun-Liang Loading…
@Ying1123
19
ProTip! Mix and match filters to narrow down what you’re looking for.