Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot use parler-tts models #3941

Open
rn3-sfos opened this issue Oct 23, 2024 · 2 comments · Fixed by #3954
Open

Cannot use parler-tts models #3941

rn3-sfos opened this issue Oct 23, 2024 · 2 comments · Fixed by #3954
Assignees
Labels
bug Something isn't working

Comments

@rn3-sfos
Copy link

LocalAI version:
localai/localai:latest-gpu-nvidia-cuda-12 (sha256:ff0b3e63d517631b1660fb3f7dbf6cfbbe8f0df730573c6f9b7b6effa964af05)

Environment, CPU architecture, OS, and Version:
Linux 82a266e95db7 6.11.5-arch1-1 #1 SMP PREEMPT_DYNAMIC Tue, 22 Oct 2024 18:31:38 +0000 x86_64 x86_64 x86_64 GNU/Linux

Describe the bug
Parler-tts backend imports runtime_version from protobuf and fails.

To Reproduce

  1. Install parler-tts model from gallery
  2. Try to invoke the model
  3. curl -L http://localhost:8080/tts \ -H "Content-Type: application/json" \ -d '{ "model": "parler-tts", "input": "Hi there!" }' | aplay

Expected behavior
Model loads and generates audio for the text

Logs
7:11AM DBG Wait for the service to start up 7:11AM DBG GRPC(-127.0.0.1:34227): stdout Initializing libbackend for parler-tts 7:11AM DBG GRPC(-127.0.0.1:34227): stdout virtualenv activated 7:11AM DBG GRPC(-127.0.0.1:34227): stdout activated virtualenv has been ensured 7:11AM DBG GRPC(-127.0.0.1:34227): stderr Traceback (most recent call last): 7:11AM DBG GRPC(-127.0.0.1:34227): stderr File "/build/backend/python/parler-tts/backend.py", line 13, in <module> 7:11AM DBG GRPC(-127.0.0.1:34227): stderr import backend_pb2 7:11AM DBG GRPC(-127.0.0.1:34227): stderr File "/build/backend/python/parler-tts/backend_pb2.py", line 9, in <module> 7:11AM DBG GRPC(-127.0.0.1:34227): stderr from google.protobuf import runtime_version as _runtime_version 7:11AM DBG GRPC(-127.0.0.1:34227): stderr ImportError: cannot import name 'runtime_version' from 'google.protobuf' (/build/backend/python/parler-tts/venv/lib/python3.10/site-packages/google/protobuf/__init__.py)

@rn3-sfos rn3-sfos added bug Something isn't working unconfirmed labels Oct 23, 2024
@mudler
Copy link
Owner

mudler commented Oct 24, 2024

Should be covered by #3954 - we had a hacky workaround in place for workarounding descriptinc/audiotools#111

@mudler
Copy link
Owner

mudler commented Nov 7, 2024

Still present on master images. Needs deeper investigation

@mudler mudler reopened this Nov 7, 2024
@mudler mudler removed the unconfirmed label Nov 7, 2024
@mudler mudler self-assigned this Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants