Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upstream merge 24 11 11 #272

Merged
merged 129 commits into from
Nov 12, 2024
Merged

Upstream merge 24 11 11 #272

merged 129 commits into from
Nov 12, 2024

Conversation

gshtras
Copy link
Collaborator

@gshtras gshtras commented Nov 11, 2024

No description provided.

youkaichao and others added 30 commits November 4, 2024 08:51
@youkaichao
[4/N] make quant config first-class citizen (vllm-project#9978)
8d72bb2 
Signed-off-by: youkaichao <[email protected]>
@jeejeelee
[Misc]Reduce BNB static variable (vllm-project#9987)
fb2716d 
Signed-off-by: Jee Jee Li <[email protected]>
@mzusman
[Model] factoring out MambaMixer out of Jamba (vllm-project#8993)
603a661 
Signed-off-by: mzusman <[email protected]>
@robertgshaw2-redhat
[CI] Basic Integration Test For TPU (vllm-project#9968)
1c45f4c 
Signed-off-by: Robert Shaw <[email protected]>
@hissu-hyvarinen
[Bugfix][CI/Build][Hardware][AMD] Shard ID parameters in AMD tests ru…
5208dc7 
…nning parallel jobs (vllm-project#9279)

Signed-off-by: Hissu Hyvarinen <[email protected]>
@ywang96
[Doc] Update VLM doc about loading from local files (vllm-project#9999)
6e056bc 
Signed-off-by: Roger Wang <[email protected]>
@robertgshaw2-redhat
[Bugfix] Fix MQLLMEngine hanging (vllm-project#9973)
04cef2c 
Signed-off-by: [email protected] <[email protected]>
@lk-chen
[Misc] Refactor benchmark_throughput.py (vllm-project#9779)
9a5664d 
Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
@tomeras91
[Frontend] Add max_tokens prometheus metric (vllm-project#9881)
ac04a97 
Signed-off-by: Tomer Asida <[email protected]>
@bnellnm
[Bugfix] Upgrade to pytorch 2.5.1 (vllm-project#10001)
d93478b 
Signed-off-by: Bill Nell <[email protected]>
@youkaichao
[4.5/N] bugfix for quant config in speculative decode (vllm-project#1…
2094062 
…0007)

Signed-off-by: youkaichao <[email protected]>
@mgoin
[Bugfix] Respect modules_to_not_convert within awq_marlin (vllm-proje…
8f0a9ca 
…ct#9895)

Signed-off-by: mgoin <[email protected]>
@tlrmchlsmth
[Core] Use os.sched_yield in ShmRingBuffer instead of time.sleep (vll…
04bbf38 
…m-project#9994)

Signed-off-by: Tyler Michael Smith <[email protected]>
@DarkLight1337
[Core] Make encoder-decoder inputs a nested structure to be more comp…
bbc3619 
…osable (vllm-project#9604)

Signed-off-by: DarkLight1337 <[email protected]>
@tlrmchlsmth
[Bugfix] Fixup Mamba (vllm-project#10004)
ad23318 
Signed-off-by: Tyler Michael Smith <[email protected]>
@GeneDer
[BugFix] Lazy import ray (vllm-project#10021)
7a83b1a
@chaunceyjiang
[Misc] vllm CLI flags should be ordered for better user readability (v…
93dee88 
…llm-project#10017)

Signed-off-by: chaunceyjiang <[email protected]>
@russellb
[Frontend] Fix tcp port reservation for api server (vllm-project#10012)
5952d81 
Signed-off-by: Russell Bryant <[email protected]>
@richardsliu
Refactor TPU requirements file and pin build dependencies (vllm-proje…
cd34029 
…ct#10010)

Signed-off-by: Richard Liu <[email protected]>
@yangalan123 @youkaichao
[Misc] Add logging for CUDA memory (vllm-project#10027)
09d3550 
Signed-off-by: Chenghao Yang <[email protected]>
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: Chenghao Yang <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@russellb
[CI/Build] Limit github CI jobs based on files changed (vllm-project#…
731aec5 
…9928)

Signed-off-by: Russell Bryant <[email protected]>
@mgoin
[Model] Support quantization of PixtralHFTransformer for PixtralHF (v…
a53046b 
…llm-project#9921)

Signed-off-by: mgoin <[email protected]>
@lk-chen
[Feature] Update benchmark_throughput.py to support image input (vllm…
d2e8033 
…-project#9851)

Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
@jeejeelee
[Misc] Modify BNB parameter name (vllm-project#9997)
b9c64c0 
Signed-off-by: Jee Jee Li <[email protected]>
@mgoin
[CI] Prune tests/models/decoder_only/language/* tests (vllm-project#9940
0246246 
)

Signed-off-by: mgoin <[email protected]>
@mgoin
[CI] Prune back the number of tests in tests/kernels/* (vllm-project#…
235366f 
…9932)

Signed-off-by: mgoin <[email protected]>
@youkaichao
[bugfix] fix weak ref in piecewise cudagraph and tractable test (vllm…
ca9844b 
…-project#10048)

Signed-off-by: youkaichao <[email protected]>
@zifeitong
[Bugfix] Properly propagate trust_remote_code settings (vllm-project#…
43300bd 
…10047)

Signed-off-by: Zifei Tong <[email protected]>
@wallashss
[Bugfix] Fix pickle of input when async output processing is on (vllm…
966e316 
…-project#9931)

Signed-off-by: Wallas Santos <[email protected]>
@llsj14 @LiuXiaoxuanPKU
[Bugfix][SpecDecode] kv corruption with bonus tokens in spec decode (v…
0c63c34 
…llm-project#9730)

Co-authored-by: LiuXiaoxuanPKU <[email protected]>
xuechendi and others added 24 commits November 9, 2024 06:26
@xuechendi
[CI/Build] Add run-hpu-test.sh script (vllm-project#10167)
8e1529d 
Signed-off-by: Chendi.Xue <[email protected]>
@bnellnm
[Bugfix] Enable some fp8 and quantized fullgraph tests (vllm-project#…
f192aeb 
…10171)

Signed-off-by: Bill Nell <[email protected]>
@youkaichao
[bugfix] fix broken tests of mlp speculator (vllm-project#10177)
bd46357 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[doc] explaining the integration with huggingface (vllm-project#10173)
8a4358e 
Signed-off-by: youkaichao <[email protected]>
@caijizhuo
bugfix: fix the bug that stream generate not work (vllm-project#2756)
9e37266
@cjackal
[Frontend] add add_request_id middleware (vllm-project#9594)
d88bff1 
Signed-off-by: cjackal <[email protected]>
@KrishnaM251 @DarkLight1337
[Frontend][Core] Override HF config.json via CLI (vllm-project#5836)
b09895a 
Signed-off-by: DarkLight1337 <[email protected]>
Co-authored-by: DarkLight1337 <[email protected]>
@DarkLight1337
[CI/Build] Split up models tests (vllm-project#10069)
51c2e1f 
Signed-off-by: DarkLight1337 <[email protected]>
@youkaichao
[ci][build] limit cmake version (vllm-project#10188)
9fa4bdd 
Signed-off-by: youkaichao <[email protected]>
@FuryMartin
[Doc] Fix typo error in CONTRIBUTING.md (vllm-project#10190)
1968202 
Signed-off-by: FuryMartin <[email protected]>
@CRZbulabula @youkaichao
[doc] Polish the integration with huggingface doc (vllm-project#10195)
bfb7d61 
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@ShawnD200 @youkaichao
[Misc] small fixes to function tracing file path (vllm-project#9543)
20cf2f5 
Signed-off-by: Shawn Du <[email protected]>
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@youkaichao
[misc] improve cloudpickle registration and tests (vllm-project#10202)
73b9083 
Signed-off-by: youkaichao <[email protected]>
@yansh97
[Doc] Fix typo error in vllm/entrypoints/openai/cli_args.py (vllm-pro…
ad9a78b 
…ject#10196)
@youkaichao
[doc] improve debugging code (vllm-project#10206)
f0f2e56 
Signed-off-by: youkaichao <[email protected]>
@youkaichao
[6/N] pass whole config to inner model (vllm-project#10205)
f89d18f 
Signed-off-by: youkaichao <[email protected]>
@dependabot
Bump the patch-update group with 5 updates (vllm-project#10210)
9804ac7 
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@Isotr0py
[Hardware][CPU] Add embedding models support for CPU backend (vllm-pr…
58170d6 
…oject#10193)

Signed-off-by: Isotr0py <[email protected]>
@jeejeelee
[LoRA][Kernel] Remove the unused libentry module (vllm-project#10214)
36e4acd 
Signed-off-by: Jee Jee Li <[email protected]>
@ywang96
[V1] Allow tokenizer_mode and trust_remote_code for Detokenizer (v…
5fb1f93 
…llm-project#10211)

Signed-off-by: Roger Wang <[email protected]>
@Isotr0py
[Bugfix][Hardware][CPU] Fix broken encoder-decoder CPU runner (vllm-p…
2cebda4 
…roject#10218)

Signed-off-by: Isotr0py <[email protected]>
@gshtras
Merge remote-tracking branch 'upstream/main'
c8c6c7e
@gshtras
Merge remote-tracking branch 'origin/main' into upstream_merge_24_11_11
409a439
@gshtras
Formatting
c0f2e87
@gshtras gshtras force-pushed the upstream_merge_24_11_11 branch from 3700cc9 to c0f2e87 Compare November 11, 2024 22:51
@gshtras gshtras changed the base branch from main to develop November 12, 2024 16:02
@gshtras gshtras requested a review from shajrawi November 12, 2024 16:02
@gshtras gshtras merged commit 8de3a62 into develop Nov 12, 2024
9 of 11 checks passed
@gshtras gshtras deleted the upstream_merge_24_11_11 branch November 12, 2024 16:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@shajrawi shajrawi shajrawi approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.