Skip to content

Commit

Permalink
revert
Browse files Browse the repository at this point in the history
Signed-off-by: Cody Yu <[email protected]>
  • Loading branch information
comaniac authored and sakunkun committed Dec 31, 2024
1 parent f570cd3 commit 44e63ea
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions vllm/v1/core/scheduler.py
Original file line number Diff line number Diff line change
Expand Up @@ -208,6 +208,7 @@ def schedule(self) -> "SchedulerOutput":
num_new_tokens = self.block_size
computed_blocks.pop()
num_new_tokens = min(num_new_tokens, token_budget)
assert num_new_tokens > 0

# Schedule encoder inputs.
(encoder_inputs_to_schedule, num_new_tokens,
Expand Down

0 comments on commit 44e63ea

Please sign in to comment.