Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update to upstream #4

Merged
merged 242 commits into from
Jan 19, 2025
Merged

Update to upstream #4

merged 242 commits into from
Jan 19, 2025

Conversation

gmlwns2000
Copy link
Owner

No description provided.

jerryzh168 and others added 30 commits December 21, 2024 00:25
@jerryzh168
Add integration with gemlite weight only quant (sgl-project#2528)
feb2b76
@zhyncs
chore: bump v0.4.0.post2 (sgl-project#2525)
8f4d04e
@zhyncs
fix sgl-project#2528 (sgl-project#2541)
4e1e3cf
@ccchow
Add lora_paths to v1_chat_generate_request (sgl-project#2529)
19ba2b0
@zhyncs
docs: update sponsorship (DataCrunch) (sgl-project#2523)
d4b1748
@BBuf
[kernel optimize] benchmark write_req_to_token_pool_triton and optimi…
7d672d2 
…ze kernel (sgl-project#2509)
@merrymercy
[Misc] Fix metrics, weight update lock, request logging (sgl-project#…
8496701 
…2543)
@merrymercy
A better aio rwlock that guarantees the order (sgl-project#2547)
41b1db6
@shuaills @zhaochenyang20
Doc: Update Grammar Backend (sgl-project#2545)
25e5d58 
Co-authored-by: Chayenne <[email protected]>
@merrymercy
Fix gemlite import (sgl-project#2553)
23e5e50
@ispobock
Reorg moe code (sgl-project#2563)
e835a50
@Ying1123
[Bench] Flush cache before benchmarking (sgl-project#2566)
8a56b43
@HandH1998 @zhyncs
Refactor MoE (sgl-project#2575)
53aed98 
Co-authored-by: zhyncs <[email protected]>
@zhyncs @ispobock
fix moe_align_block_size_kernel for shared memory issue (sgl-project#…
3154811 
…2579)

Co-authored-by: ispobock <[email protected]>
@zhyncs
chore: bump 0.0.2.post8 for sgl-kernel (sgl-project#2580)
d7c0e87
@zhyncs @ispobock @HandH1998
use sgl-kernel moe_align_block_size (sgl-project#2581)
60e2fdc 
Co-authored-by: ispobock <[email protected]>
Co-authored-by: HandH1998 <[email protected]>
@zhyncs
chore: bump v0.4.1 (sgl-project#2582)
efc52f8
@zhyncs
docs: add deepseek v3 launch instructions (sgl-project#2589)
75ad0a1
@zhyncs
fix: only enable moe_align_block_size for now (sgl-project#2590)
2dccecf
@zhyncs
docs: update deepseek v3 example (sgl-project#2592)
635a042
@BBuf
h100 tuning fused_moe_triton for qwen2 moe (sgl-project#2560)
9a23c48
@hnyls2002
Fix cache hit rate when chunked prefill (sgl-project#2555)
e7ebecf
@merrymercy
Update README.md (sgl-project#2594)
60bd327
@upskyy
Error occurs when loading the gemma model in bitsandbytes format. (sg…
08effbf 
…l-project#2557)
@adarshxs
[Feature] Support new parameter - EBNF in xgrammar (sgl-project#2526)
acb3407
@fsygd
update readme of DeepSeek V3 (sgl-project#2596)
637de9e
@merrymercy @libratiger
@fzyzcjy @HaoyuWang4188
Fix logprob_start_len for multi modal models (sgl-project#2597)
7739515 
Co-authored-by: libra <[email protected]>
Co-authored-by: fzyzcjy <[email protected]>
Co-authored-by: Wang, Haoyu <[email protected]>
@fzyzcjy
Fix duplicated handling of GetWeightsByNameReqInput (sgl-project#2565)
3169e66
@JamesSand
[unittest] add unit test to test quant args of srt engine (sgl-projec…
a74d194 
…t#2574)
@merrymercy
Fix test and benchmark scripts (sgl-project#2598)
dc3bee4
zhaochenyang20 and others added 29 commits January 16, 2025 13:04
@zhaochenyang20
Docs: Update pull_request_template.md (sgl-project#2928)
bf3edc2
@merrymercy @chunyuan-w
Fix zmq binding (sgl-project#2930)
0427416 
Co-authored-by: Chunyuan WU <[email protected]>
@CatherineSue
[Frontend] Fix request length check and add option to disallow auto t…
a8ccacc 
…runcation in scheduler (sgl-project#2876)
@chunyuan-w
Enable CPU device on SGLang (sgl-project#2806)
6305173
@merrymercy
Update release-docs.yml (sgl-project#2937)
6a7973a
@ispobock
Fix sgl-kernel ci (sgl-project#2938)
f3e9b48
@zhyncs @yizhang2077
feat: remove vllm distributed (sgl-project#2907)
5dc54f1 
Co-authored-by: Zhangyi <[email protected]>
@ispobock
Fix qwen accuracy issue (sgl-project#2945)
53e6552
@zhyncs
docs: add Cursor for adoption and sponsorship (sgl-project#2950)
c5644ca
@zhyncs
update ci install dependency (sgl-project#2949)
d06c1ab
@zhyncs
cleanup models dependencies 1/n (sgl-project#2948)
033c715
@ispobock
Add ut for qwen model (sgl-project#2947)
d47c510
@ispobock
Update pr template (sgl-project#2951)
dc2ac0c
@zhyncs
cleanup models unused import 2/n (sgl-project#2952)
7a15e9a
@zhyncs
feat: use get_rope for gemma2 (sgl-project#2954)
78e5b22
@HermitSun
Fix Llama-3.1-405B References Docs (sgl-project#2944)
120c363
@xiezhq-hermann
Multi-turn benchmark for hierarchical caching (sgl-project#2942)
13387e6
@bjmsong @mdattack
support e4m3 kvcache in qwen2 & add kv scaling facotr json (sgl-proje…
d3024f4 
…ct#2894)

Co-authored-by: bjmsong <[email protected]>
@xiezhq-hermann
Query remaining memory dynamically for PrefillAdder (sgl-project#2941)
8af7048
@ispobock
Remove fp8 monkey patch (sgl-project#2960)
656dcc1
@sleepcoo
fix sgl-kernel setup.py (sgl-project#2963)
6f98c58
@zhyncs
feat: remove vllm get_rope (sgl-project#2964)
2add697
@zhyncs
upgrade cutlass v3.7.0 (sgl-project#2967)
e2cdc8a
@BBuf
optimize MiniMax-Text-01 lightning_attn_decode triton (sgl-project#2966)
c2f212d
@mickqian @zhaochenyang20 @yizhang2077
[Feature] Support minicpmv v2.6 (sgl-project#2785)
3d93f84 
Co-authored-by: Chayenne <[email protected]>
Co-authored-by: yizhang2077 <[email protected]>
@BBuf
fix file name spelling mistake and useless variable in minmax-text-01…
83452db 
…-lightning_attention (sgl-project#2971)
@zhengy001
Memory pool: Minor optimize to avoid to (sgl-project#2901)
2bd18e2
@CatherineSue
Frontend: better error message handling for FINISH_ABORT in scheduler…
4d4cdb3 
….py (sgl-project#2956)
@gmlwns2000
Merge branch 'hip12-offload-add-offload-cache' into main-merge-patch-…
501686a 
…offload
@gmlwns2000 gmlwns2000 merged commit 4339831 into hip12-offload-add-offload-cache Jan 19, 2025
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.