New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Quantized Model Usage? #15

Open

GalenMarek14 opened this issue Apr 15, 2024 · 1 comment

GalenMarek14 commented Apr 15, 2024

Is there a way to use quantized models? The current version is really out of reach for most people with consumer-grade GPUs.

Also, will you train / release models for SD1.5 and SDXL?

Thanks!

Collaborator

thss15fyt commented Apr 16, 2024

Thanks for your interest.

Currently we do not have plan to develop quantized model of Ranni. But for the LLM part, it might be easy to incorporate quantization tools from community for the LLama2 model used here.
For 1.5/SDXL, refer to Will there be 1.5 and XL versions? #4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment