Skip to content

Commit

Permalink
Doc fix in benchmark_long_document_qa_throughput.py (vllm-project#1…
Browse files Browse the repository at this point in the history
…1933)

Signed-off-by: Kuntai Du <[email protected]>
Signed-off-by: Fred Reiss <[email protected]>
  • Loading branch information
KuntaiDu authored and frreiss committed Jan 10, 2025
1 parent b7ff369 commit 3d889f7
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions benchmarks/benchmark_long_document_qa_throughput.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,7 @@
Offline benchmark to test the long document QA throughput.
Example usage:
# This command run the vllm with 50GB CPU memory for offloading
# The workload samples 8 different prompts with a default input
# This workload samples 8 different prompts with a default input
# length of 20000 tokens, then replicates each prompt 2 times
# in random order.
python benchmark_long_document_qa_throughput.py \
Expand Down

0 comments on commit 3d889f7

Please sign in to comment.