Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CB] Fixes for perf stat #1538

Merged
merged 1 commit into from
Jan 14, 2025

Conversation

ilya-lavrenov
Copy link
Contributor

@ilya-lavrenov ilya-lavrenov commented Jan 14, 2025

Extracted fixes for perf metrics from #1455

Fixed issues introduced in #1524

@ilya-lavrenov ilya-lavrenov added this to the 2025.0 milestone Jan 14, 2025
@github-actions github-actions bot added category: visual language Visual language pipeline category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: samples GenAI samples category: GenAI C++ API Changes in GenAI C++ public headers no-match-files category: prompt lookup labels Jan 14, 2025
@github-actions github-actions bot added the category: Python API Python API for GenAI label Jan 14, 2025
@ilya-lavrenov ilya-lavrenov merged commit f578a9b into openvinotoolkit:master Jan 14, 2025
57 of 58 checks passed
@ilya-lavrenov ilya-lavrenov deleted the cb-perf-metrics branch January 14, 2025 12:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: prompt lookup category: Python API Python API for GenAI category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: visual language Visual language pipeline no-match-files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants