Code

Simplify stream_output#2398

Code

Merged

merrymercy merged 19 commits intomainsgl-project/sglang:mainfrom pr-fix-streamingsgl-project/sglang:pr-fix-streamingCopy head branch name to clipboardDec 8, 2024

+425-289

Commits

Commits on Dec 8, 2024

• Fix stream

  merrymercy

  committed
  643746a

  Copy full SHA for 643746a

• remove metainfo

  merrymercy

  committed
  f6cb65a

  Copy full SHA for f6cb65a

• flatten logprobs

  merrymercy

  committed
  905cb34

  Copy full SHA for 905cb34

• handle top logprob

  merrymercy

  committed
  b705166

  Copy full SHA for b705166

• Fix tokenizer_manager

  merrymercy

  committed
  b9e875b

  Copy full SHA for b9e875b

• Fix metainfo

  merrymercy

  committed
  13f1ad8

  Copy full SHA for 13f1ad8

• Fix fill_ids[0]

  merrymercy

  committed
  c354f2d

  Copy full SHA for c354f2d

• fix

  merrymercy

  committed
  175963b

  Copy full SHA for 175963b

• Fix

  merrymercy

  committed
  a271d60

  Copy full SHA for a271d60

• remove completion_tokens_wo_jump_forward

  merrymercy

  committed
  889cee3

  Copy full SHA for 889cee3

• Fix finish_reason

  merrymercy

  committed
  88aa67c

  Copy full SHA for 88aa67c

• Finish reason

  merrymercy

  committed
  e5c6708

  Copy full SHA for e5c6708

• Fix

  merrymercy

  committed
  3a2a8aa

  Copy full SHA for 3a2a8aa

• Fix normalized_prompt_logprob

  merrymercy

  committed
  edee23b

  Copy full SHA for edee23b

• Fix for embedding models

  merrymercy

  committed
  e0694d3

  Copy full SHA for e0694d3

• fix metrics for embeddings

  merrymercy

  committed
  7c7033c

  Copy full SHA for 7c7033c

• incremental decoding

  merrymercy

  committed
  3df32bd

  Copy full SHA for 3df32bd

• fix abort

  merrymercy

  committed
  4f782b3

  Copy full SHA for 4f782b3

• Fix has_new_server

  merrymercy

  committed
  faaaa33

  Copy full SHA for faaaa33