We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When following the Phi-3 Tutorial using DirectML the phi3-qa.py script causes a segmentation fault after entering the input.
This issue occurs a laptop with a 13th Gen Intel(R) Core(TM) i7-1360P and a laptop with an AMD Ryzen™ AI 9 HX 370.
huggingface-cli download microsoft/Phi-3-mini-4k-instruct-onnx --include directml/* --local-dir .
pip install numpy
pip install --pre onnxruntime-genai-directml
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
python phi3-qa.py -m directml\directml-int4-awq-block-128
Tell me a joke about GPUs
No response
Windows
Windows 11 Home 22631.4460
Released Package
1.20.0
Python
X64
DirectML
0.5.1
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the issue
When following the Phi-3 Tutorial using DirectML the phi3-qa.py script causes a segmentation fault after entering the input.
This issue occurs a laptop with a 13th Gen Intel(R) Core(TM) i7-1360P and a laptop with an AMD Ryzen™ AI 9 HX 370.
To reproduce
huggingface-cli download microsoft/Phi-3-mini-4k-instruct-onnx --include directml/* --local-dir .
pip install numpy
pip install --pre onnxruntime-genai-directml
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
python phi3-qa.py -m directml\directml-int4-awq-block-128
Tell me a joke about GPUs
Urgency
No response
Platform
Windows
OS Version
Windows 11 Home 22631.4460
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.20.0
ONNX Runtime API
Python
Architecture
X64
Execution Provider
DirectML
Execution Provider Library Version
0.5.1
The text was updated successfully, but these errors were encountered: