Monkey Patch step missing and not documented #3642
hypersniper05
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I finally got it to work, the readme really really sucks a$$. What it doesn't tell you is that you need to install the monkey patch separately. Here are the steps:
First, follow this guide to install GPTQ-for-LLaMa:
Link
dont forget the --monkey-patch flag.
Next install from Monkeypatch from source:
Monkeypatch github
cd text-generation-webui\repositories
git clone https://github.com/iki/monkeypatch
pip install .
if you get this error:
except ImportError, e: ^^^^^^^^^^^^^^
open the setup.py from the monkeypatch folder, on line 99 change to this
except ImportError :
and try to install the command again.I am running it on Windows 11, currently training Vicuna 1.5 13B GPTQ on 3080ti. Hope this helps someone or someone can update the link for monkey patch install above.
Beta Was this translation helpful? Give feedback.
All reactions