Code

[Serve] multiple submodels serve#298

Code

Open

cyber-pioneer wants to merge 86 commits intoFlagOpen:mainFlagOpen/FlagScale:mainfrom cyber-pioneer:final_servecyber-pioneer/FlagScale:final_serveCopy head branch name to clipboard

+967-22

Commits

Commits on Jan 22, 2025

• add manual emu infer serve

  cyber-pioneer

  committed
  6e727c5

  Copy full SHA for 6e727c5

• add case to build dag

  cyber-pioneer

  committed
  f16fa78

  Copy full SHA for f16fa78

• fix code

  cyber-pioneer

  committed
  616c0cd

  Copy full SHA for 616c0cd

• add serve dag

  cyber-pioneer

  committed
  f018be0

  Copy full SHA for f018be0

• better design and demo

  cyber-pioneer

  committed
  97ca7ad

  Copy full SHA for 97ca7ad

• support launch task from upper api

  cyber-pioneer

  committed
  abac6d6

  Copy full SHA for abac6d6

• serve emu dev1

  cyber-pioneer

  committed
  ff6c82c

  Copy full SHA for ff6c82c

• polish check logic

  cyber-pioneer

  committed
  b92bd37

  Copy full SHA for b92bd37

• serve add router

  cyber-pioneer

  committed
  2425590

  Copy full SHA for 2425590

• finish whole router process

  cyber-pioneer

  committed
  2437951

  Copy full SHA for 2437951

• polish code

  cyber-pioneer

  committed
  2865f0e

  Copy full SHA for 2865f0e

• polish code

  cyber-pioneer

  committed
  0a16a1b

  Copy full SHA for 0a16a1b

• polish code

  cyber-pioneer

  committed
  2cef2d1

  Copy full SHA for 2cef2d1

• fix progress

  cyber-pioneer

  committed
  d76eea5

  Copy full SHA for d76eea5

• debug1

  cyber-pioneer

  committed
  56d4b37

  Copy full SHA for 56d4b37

• use origin remote

  cyber-pioneer

  committed
  87d30f1

  Copy full SHA for 87d30f1

• support LLM instance in remote

  cyber-pioneer

  committed
  46688ff

  Copy full SHA for 46688ff

• polish code

  cyber-pioneer

  committed
  a56339f

  Copy full SHA for a56339f

• polish request keys

  cyber-pioneer

  committed
  6c510f5

  Copy full SHA for 6c510f5

• fix

  cyber-pioneer

  committed
  f7c3201

  Copy full SHA for f7c3201

• fix code

  cyber-pioneer

  committed
  61b34a5

  Copy full SHA for 61b34a5

• fix

  cyber-pioneer

  committed
  c39def0

  Copy full SHA for c39def0

• add save image

  cyber-pioneer

  committed
  0a79f4c

  Copy full SHA for 0a79f4c

• fix code

  cyber-pioneer

  committed
  18391cd

  Copy full SHA for 18391cd

• polish yaml

  cyber-pioneer

  committed
  c5ca817

  Copy full SHA for c5ca817

• fix yaml

  cyber-pioneer

  committed
  f56cc1f

  Copy full SHA for f56cc1f

• fix yaml

  cyber-pioneer

  committed
  0ca82b5

  Copy full SHA for 0ca82b5

• polish code

  cyber-pioneer

  committed
  f598d57

  Copy full SHA for f598d57

• polish yaml

  cyber-pioneer

  committed
  ecaf22b

  Copy full SHA for ecaf22b

• support multiple nodes task

  cyber-pioneer

  committed
  6fae390

  Copy full SHA for 6fae390

• polish yaml

  cyber-pioneer

  committed
  837610c

  Copy full SHA for 837610c

• polish code

  cyber-pioneer

  committed
  c7296b7

  Copy full SHA for c7296b7

• polish code

  cyber-pioneer

  committed
  dfa1a4f

  Copy full SHA for dfa1a4f

• fix case

  cyber-pioneer

  committed
  a793272

  Copy full SHA for a793272

• fix case

  cyber-pioneer

  committed
  09b56c2

  Copy full SHA for 09b56c2

• polish module path

  cyber-pioneer

  committed
  3b5e9f5

  Copy full SHA for 3b5e9f5

• add dag

  cyber-pioneer

  committed
  4c37189

  Copy full SHA for 4c37189

• fix code

  cyber-pioneer

  committed
  16366e5

  Copy full SHA for 16366e5

• fix code

  cyber-pioneer

  committed
  b4b042c

  Copy full SHA for b4b042c

• fix code

  cyber-pioneer

  committed
  eac06a0

  Copy full SHA for eac06a0

• fix code

  cyber-pioneer

  committed
  82f728d

  Copy full SHA for 82f728d

• add check dag and support ci

  cyber-pioneer

  committed
  1b3e696

  Copy full SHA for 1b3e696

• fit ci

  cyber-pioneer

  committed
  d528a7b

  Copy full SHA for d528a7b

• remove png

  cyber-pioneer

  committed
  103ba5a

  Copy full SHA for 103ba5a

• remove png

  cyber-pioneer

  committed
  af14b4e

  Copy full SHA for af14b4e

• remove code

  cyber-pioneer

  committed
  73b3461

  Copy full SHA for 73b3461

• remove code

  cyber-pioneer

  committed
  a83bdc8

  Copy full SHA for a83bdc8

• fix test case

  cyber-pioneer

  committed
  e5674e3

  Copy full SHA for e5674e3

• polish code

  cyber-pioneer

  committed
  765f0cb

  Copy full SHA for 765f0cb

• polish yaml

  cyber-pioneer

  committed
  1fcd328

  Copy full SHA for 1fcd328

• fix code

  cyber-pioneer

  committed
  630d5ef

  Copy full SHA for 630d5ef

• fix code

  cyber-pioneer

  committed
  5bbdc61

  Copy full SHA for 5bbdc61

• fix code

  cyber-pioneer

  committed
  b0eeab6

  Copy full SHA for b0eeab6

• fix code

  cyber-pioneer

  committed
  b4d6bed

  Copy full SHA for b4d6bed

• ci test case

  cyber-pioneer

  committed
  ebe759f

  Copy full SHA for ebe759f

• servve ci case

  cyber-pioneer

  committed
  0fbd03d

  Copy full SHA for 0fbd03d

• fix ci

  cyber-pioneer

  committed
  4799edf

  Copy full SHA for 4799edf

• fix test model

  cyber-pioneer

  committed
  b7edcab

  Copy full SHA for b7edcab

• add clear serve

  cyber-pioneer

  committed
  deaeaed

  Copy full SHA for deaeaed

• Merge remote-tracking branch 'gitee/final_serve' into final_serve

  cyber-pioneer

  committed
  ead9bd6

  Copy full SHA for ead9bd6

• fix stop serve

  cyber-pioneer

  committed
  fc065b0

  Copy full SHA for fc065b0

• fix test case

  cyber-pioneer

  committed
  f4c85c8

  Copy full SHA for f4c85c8

• fix code

  cyber-pioneer

  committed
  84b27c3

  Copy full SHA for 84b27c3

• fix code

  cyber-pioneer

  committed
  d892433

  Copy full SHA for d892433

• polish dag image path

  cyber-pioneer

  committed
  f9fe272

  Copy full SHA for f9fe272

• ci support

  cyber-pioneer

  committed
  05c51e0

  Copy full SHA for 05c51e0

• add ci case

  cyber-pioneer

  committed
  b77514b

  Copy full SHA for b77514b

• polish test case

  cyber-pioneer

  committed
  4af8522

  Copy full SHA for 4af8522

• debug ci

  cyber-pioneer

  committed
  32614dd

  Copy full SHA for 32614dd

• debug ci

  cyber-pioneer

  committed
  5cd26c1

  Copy full SHA for 5cd26c1

• debug ci

  cyber-pioneer

  committed
  55878b6

  Copy full SHA for 55878b6

• debug ci

  cyber-pioneer

  committed
  3f744b9

  Copy full SHA for 3f744b9

• debug ci

  cyber-pioneer

  committed
  3de67ea

  Copy full SHA for 3de67ea

• debug ci

  cyber-pioneer

  committed
  4547d24

  Copy full SHA for 4547d24

• debug ci

  cyber-pioneer

  committed
  ed5ce2c

  Copy full SHA for ed5ce2c

• debug ci

  cyber-pioneer

  committed
  65fe58d

  Copy full SHA for 65fe58d

• debug ci

  cyber-pioneer

  committed
  a58c8b8

  Copy full SHA for a58c8b8

• debug ci

  cyber-pioneer

  committed
  ee64a87

  Copy full SHA for ee64a87

• debug ci

  cyber-pioneer

  committed
  e2eef6a

  Copy full SHA for e2eef6a

• debug ci

  cyber-pioneer

  committed
  a188707

  Copy full SHA for a188707

Commits on Jan 23, 2025

• fix ci case

  cyber-pioneer

  committed
  3648863

  Copy full SHA for 3648863

• fix code

  cyber-pioneer

  committed
  e73ae9a

  Copy full SHA for e73ae9a

• add model

  cyber-pioneer

  committed
  779ec05

  Copy full SHA for 779ec05

• polish ci

  cyber-pioneer

  committed
  0482b0b

  Copy full SHA for 0482b0b

• polish code

  cyber-pioneer

  committed
  9ab5b39

  Copy full SHA for 9ab5b39

• polish code

  cyber-pioneer

  committed
  19044f5

  Copy full SHA for 19044f5