[Speculative Decoding] Medusa Implementation with Top-1 proposer#4978

Merged

LiuXiaoxuanPKU merged 18 commits intovllm-project:mainfrom flipkart-incubator:medusa

Jul 10, 2024

+587-4

Commits on Jun 21, 2024

Commits on Jun 25, 2024

Merge branch 'vllm-project:main' into medusa
abhigoyal1997
authored

Commits on Jun 26, 2024

Commits on Jun 27, 2024

Merge branch 'main' into medusa
abhigoyal1997
authored

Commits on Jul 3, 2024

Commits on Jul 9, 2024

Adding E2E tests for Medusa
abhigoyal1997
committed
Changing base model to a smaller model in test_medusa_correctness to prevent OOM in CI
abhigoyal1997
committed
Replacing Medusa models in test with smaller ones to prevent OOM
abhigoyal1997
committed