Code

Move FP8 to sglang#2366

Code

Closed

HaiShaw wants to merge 8 commits intosgl-project:mainsgl-project/sglang:mainfrom HaiShaw:moe_fp8HaiShaw/sglang:moe_fp8Copy head branch name to clipboard

+1,733-10

Commits

Commits on Dec 5, 2024

• MoE Expert Parallel Impl (sgl-project#2203)

  Show description for f9b7c64
  

  xiaobochen123

  and

  HaiShaw

  authored
  f9b7c64

  Copy full SHA for f9b7c64

• Move FP8 to sglang

  HaiShaw

  committed
  c229398

  Copy full SHA for c229398

• Fix the cuda graph capture range for small #max-running-requests (sgl-project#2359)

  merrymercy

  authored
  337fe53

  Copy full SHA for 337fe53

Commits on Dec 6, 2024

• remove unneccessarty vllm dependencies

  HaiShaw

  committed
  47b1e33

  Copy full SHA for 47b1e33

• Merge branch 'main' into moe_fp8

  HaiShaw

  authored
  1049088

  Copy full SHA for 1049088

• [router] use 2-gpu-runner (sgl-project#2368)

  ByronHsu

  authored
  fc6387e

  Copy full SHA for fc6387e

• Merge branch 'main' into moe_fp8

  HaiShaw

  authored
  9677f61

  Copy full SHA for 9677f61

• Merge branch 'main' into moe_fp8

  HaiShaw

  authored
  1a98996

  Copy full SHA for 1a98996