Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unquantized model files aren't cleaned up after conversion #10

Closed
alexrozanski opened this issue Apr 14, 2023 · 1 comment
Closed

Unquantized model files aren't cleaned up after conversion #10

alexrozanski opened this issue Apr 14, 2023 · 1 comment
Assignees
Labels
bug Something isn't working
Milestone

Comments

@alexrozanski
Copy link
Owner

When importing .pth models we convert them to .ggml files first then quantize them; however, these un-quantized models aren't cleaned up so sit in the internal models directory, even though they are not needed.

@alexrozanski alexrozanski added the bug Something isn't working label Apr 14, 2023
@alexrozanski
Copy link
Owner Author

This should be an easy fix:

  • Ensure they're cleaned up
  • Run a function on app launch to clean up any unquantized models in the internal models directory, to mitigate this issue for existing users

@alexrozanski alexrozanski self-assigned this Apr 21, 2023
@alexrozanski alexrozanski added this to the v1.2 milestone Apr 21, 2023
@alexrozanski alexrozanski moved this to Done in LlamaChat Apr 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

No branches or pull requests

1 participant