From 2e27ecec72e2aea745a693d541bc415474d49ae2 Mon Sep 17 00:00:00 2001 From: wenhuach21 Date: Mon, 21 Oct 2024 16:33:37 +0800 Subject: [PATCH] for cpu inference, the current version will have issue due to zp+-1, must need version>0.3.1 --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index b4fab6d0..fbf5108f 100644 --- a/README.md +++ b/README.md @@ -205,7 +205,7 @@ Please run the quantization code first ### AutoRound format -**CPU**: pip install intel-extension-for-transformers +**CPU**: pip install intel-extension-for-transformers, auto_round version >0.3.1 **HPU**: docker image with Gaudi Software Stack is recommended. More details can be found in [Gaudi Guide](https://docs.habana.ai/en/latest/).