Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PT2.6][Client GPU Windows] Reach comparable hugging face benchmark pass rate with PVC on LNL Windows #998

Open
riverliuintel opened this issue Oct 22, 2024 · 0 comments
Assignees
Labels
os: Windows Windows Platform

Comments

@riverliuintel
Copy link
Contributor

riverliuintel commented Oct 22, 2024

🚀 The feature, motivation and pitch

Huggingface accuracy have reached reasonable pass rate on PVC Linux on both torch.complie and eager. For windows on Client GPU, it only can support eager accuracy.

It requests to test all three benchmarks eager mode and triage the failure reason to reach a reasonable pass rate. Take LNL as an reference platform.

Some checkpoints:

  1. Fully run huggingface benchmark e2e test result on eager.
  2. Set up CI test task (Weekly can be workaround before CI machine ready)
  3. Give the investigate report and fix plan within two weeks.
  4. Fix bugs, give the fix reason and upstream the code.

Alternatives

No response

Additional context

No response

@riverliuintel riverliuintel added the os: Windows Windows Platform label Oct 22, 2024
@riverliuintel riverliuintel changed the title [PyTorch2.6][Client GPU Windows] Reach comparable three benchmarks pass rate with PVC on LNL Windows [PT2.6][Client GPU Windows] Reach comparable three benchmarks pass rate with PVC on LNL Windows Oct 22, 2024
@Stonepia Stonepia self-assigned this Nov 19, 2024
@riverliuintel riverliuintel changed the title [PT2.6][Client GPU Windows] Reach comparable three benchmarks pass rate with PVC on LNL Windows [PT2.6][Client GPU Windows] Reach comparable hugging face benchmark pass rate with PVC on LNL Windows Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
os: Windows Windows Platform
Projects
None yet
Development

No branches or pull requests

2 participants