Code

Deepseek v3#11502

Code

Merged

simon-mo merged 14 commits intovllm-project:mainvllm-project/vllm:mainfrom simon-mo:deepseek-v3simon-mo/vllm:deepseek-v3Copy head branch name to clipboardDec 27, 2024

+887-61

Commits

Commits on Dec 26, 2024

• Initial V3 file and sigmoid change

  simon-mo

  committed
  f01c04a

  Copy full SHA for f01c04a

• BF16 + TP1 working

  simon-mo

  committed
  1afe830

  Copy full SHA for 1afe830

• Support deepseek_v3 w8a8 fp8 block-wise quantization

  Show description for eea0049
  mgoin

  committed
  eea0049

  Copy full SHA for eea0049

• Format

  Show description for 083d904
  mgoin

  committed
  083d904

  Copy full SHA for 083d904

• Format

  Show description for e71e6aa
  mgoin

  committed
  e71e6aa

  Copy full SHA for e71e6aa

• Fix yapf

  Show description for 0807252
  mgoin

  committed
  0807252

  Copy full SHA for 0807252

• Merge branch 'deepseek_v3-fp8-support' of github.com:vllm-project/vllm into deepseek-v3

  simon-mo

  committed
  addc2ed

  Copy full SHA for addc2ed

• fp8 plumbing

  simon-mo

  committed
  3c96d48

  Copy full SHA for 3c96d48

• e2e working for base model

  simon-mo

  committed
  2f53441

  Copy full SHA for 2f53441

• Merge branch 'main' of github.com:vllm-project/vllm into deepseek-v3

  simon-mo

  committed
  2b57c55

  Copy full SHA for 2b57c55

• format

  simon-mo

  committed
  a035d02

  Copy full SHA for a035d02

• restore some small diff

  simon-mo

  committed
  bcd044f

  Copy full SHA for bcd044f

• nit for TPU

  simon-mo

  committed
  71e6b03

  Copy full SHA for 71e6b03

Commits on Dec 27, 2024

• nits

  simon-mo

  committed
  a8c7457

  Copy full SHA for a8c7457