Code

Support DP MLA#1970

Code

Merged

merrymercy merged 16 commits intosgl-project:mainsgl-project/sglang:mainfrom ispobock:dp-mlaispobock/sglang:dp-mlaCopy head branch name to clipboardNov 16, 2024

+395-63

Commits

Commits on Nov 9, 2024

• add args and share worker

  ispobock

  committed
  d6d5ed4

  Copy full SHA for d6d5ed4

• update head num

  ispobock

  committed
  9962b66

  Copy full SHA for 9962b66

• add idle batch

  ispobock

  committed
  ee70ff3

  Copy full SHA for ee70ff3

• update model

  ispobock

  committed
  d1cdd90

  Copy full SHA for d1cdd90

• fix dist

  ispobock

  committed
  63525b2

  Copy full SHA for 63525b2

• fix lint

  ispobock

  committed
  cb23a72

  Copy full SHA for cb23a72

• fix group

  ispobock

  committed
  d7e79da

  Copy full SHA for d7e79da

• fix logits

  ispobock

  committed
  94091e8

  Copy full SHA for 94091e8

Commits on Nov 12, 2024

• Merge branch 'main' into dp-mla

  ispobock

  authored
  6c05bf3

  Copy full SHA for 6c05bf3

• set chunked prefill size

  ispobock

  committed
  48086c7

  Copy full SHA for 48086c7

• Merge branch 'main' into dp-mla

  ispobock

  authored
  d04b89f

  Copy full SHA for d04b89f

Commits on Nov 15, 2024

• update dp

  ispobock

  committed
  68150db

  Copy full SHA for 68150db

• add default settings

  ispobock

  committed
  83f85a4

  Copy full SHA for 83f85a4

• add test

  ispobock

  committed
  a79dd89

  Copy full SHA for a79dd89

• Merge branch 'main' into dp-mla

  ispobock

  authored
  3c0f1cd

  Copy full SHA for 3c0f1cd

Commits on Nov 16, 2024

• Merge branch 'main' into dp-mla

  merrymercy

  authored
  064eb79

  Copy full SHA for 064eb79