Code

MoE Expert Parallel#2371

Code

Merged

zhyncs merged 10 commits intosgl-project:mainsgl-project/sglang:mainfrom xiaobochen123:dev/moe_ep_newxiaobochen123/sglang:dev/moe_ep_newCopy head branch name to clipboardDec 6, 2024

+1,172-8

Commits

Commits on Dec 6, 2024

• first add ep moe impl

  xiaobochen123

  committed
  1ba776f

  Copy full SHA for 1ba776f

• fix bug

  xiaobochen123

  committed
  d02b725

  Copy full SHA for d02b725

• fix some problem

  xiaobochen123

  committed
  23716e8

  Copy full SHA for 23716e8

• BLOCK_SIZE as args

  xiaobochen123

  committed
  c508ccb

  Copy full SHA for c508ccb

• clean code

  xiaobochen123

  committed
  5ac3399

  Copy full SHA for 5ac3399

• use use_fp8_w8a8

  xiaobochen123

  committed
  41eafe5

  Copy full SHA for 41eafe5

• add ep-size args

  xiaobochen123

  committed
  6db8cf6

  Copy full SHA for 6db8cf6

• update

  xiaobochen123

  committed
  f1ccb91

  Copy full SHA for f1ccb91

• mixtral support moe-ep

  xiaobochen123

  committed
  71bda0d

  Copy full SHA for 71bda0d

• fix bug

  xiaobochen123

  committed
  420939b

  Copy full SHA for 420939b