New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can I run this on my 6GB VRAM RTHX 3060 laptop gpu? #7

Open

shashankyld opened this issue Sep 17, 2024 · 0 comments

shashankyld commented Sep 17, 2024

I get an error after pulling and loading the model (llama 8B). It says ready but then given a prompt it fails immediately.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment