Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Misc]: some minor issues in disaggregation test and benchmark tools #11455

Closed
1 task done
Jeffwan opened this issue Dec 24, 2024 · 1 comment · Fixed by #11456
Closed
1 task done

[Misc]: some minor issues in disaggregation test and benchmark tools #11455

Jeffwan opened this issue Dec 24, 2024 · 1 comment · Fixed by #11456
Labels
misc

Comments

@Jeffwan
Copy link
Contributor

Jeffwan commented Dec 24, 2024

Anything you want to discuss about vllm.

  1. disaggregation benchmark replies on benchmark_serving.py which has the datasets dependency.
    image

  2. lsof command is not found
    image

  3. program exit immediately without waiting for two process. when I first run it, I though there's an issue.
    image

  4. logs need more polishment in kv_transfer tests. I can not easily check the run status.

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@Jeffwan Jeffwan added the misc label Dec 24, 2024
@Jeffwan Jeffwan mentioned this issue Dec 24, 2024
Merged
@Jeffwan
Copy link
Contributor Author

Jeffwan commented Dec 24, 2024

/cc @KuntaiDu I cut a minor PR to address above issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
misc
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Misc] Update disaggregation benchmark scripts and test logs Jeffwan/vllm
1 participant
@Jeffwan