Code

MoE Expert Parallel Impl#2203

Code

Merged

HaiShaw merged 12 commits intosgl-project:mainsgl-project/sglang:mainfrom xiaobochen123:dev/moe_epxiaobochen123/sglang:dev/moe_epCopy head branch name to clipboardDec 5, 2024

+1,172-8

Commits

Commits on Dec 4, 2024

• first add ep moe impl

  xiaobochen123

  committed
  c17df30

  Copy full SHA for c17df30

• fix bug

  xiaobochen123

  committed
  81ad025

  Copy full SHA for 81ad025

• fix some problem

  xiaobochen123

  committed
  6935c96

  Copy full SHA for 6935c96

• BLOCK_SIZE as args

  xiaobochen123

  committed
  7d4c447

  Copy full SHA for 7d4c447

• clean code

  xiaobochen123

  committed
  4b75a51

  Copy full SHA for 4b75a51

• use use_fp8_w8a8

  xiaobochen123

  committed
  05490b4

  Copy full SHA for 05490b4

• add ep-size args

  xiaobochen123

  committed
  d633761

  Copy full SHA for d633761

• update

  xiaobochen123

  committed
  be071f3

  Copy full SHA for be071f3

Commits on Dec 5, 2024

• mixtral support moe-ep

  xiaobochen123

  committed
  d624adf

  Copy full SHA for d624adf

• Merge branch 'main' into dev/moe_ep

  HaiShaw

  authored
  aa0cb1b

  Copy full SHA for aa0cb1b

• fix bug

  xiaobochen123

  committed
  4876dbc

  Copy full SHA for 4876dbc

• Merge branch 'main' into dev/moe_ep

  HaiShaw

  authored
  a2ef180

  Copy full SHA for a2ef180