You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently the Fastembed.... embedders are not utilizing the GPUs which makes it so that i.e. SPLADE takes a substantial amount of time for embeddings vs. its counterparts.
Describe the solution you'd like QDrant supports GPUs with another library, see here. Utilizing that library would allow us to leverage our GPUs. GPU-mode could be enabled with a flag or another method.
Describe alternatives you've considered
Besides the Fastembed.. embedders, there are no out-of-the-box, nor integration, alternatives for sparse embeddings, meaning the only alternative would be to not use GPUs.
Additional context
For now, none.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Currently the Fastembed.... embedders are not utilizing the GPUs which makes it so that i.e. SPLADE takes a substantial amount of time for embeddings vs. its counterparts.
Describe the solution you'd like
QDrant supports GPUs with another library, see here. Utilizing that library would allow us to leverage our GPUs. GPU-mode could be enabled with a flag or another method.
Describe alternatives you've considered
Besides the Fastembed.. embedders, there are no out-of-the-box, nor integration, alternatives for sparse embeddings, meaning the only alternative would be to not use GPUs.
Additional context
For now, none.
The text was updated successfully, but these errors were encountered: