Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add sentencepiece as a soft dependency #9065

Merged
merged 4 commits into from
Aug 5, 2024
Merged

add sentencepiece as a soft dependency #9065

merged 4 commits into from
Aug 5, 2024

Conversation

yiyixuxu
Copy link
Collaborator

@yiyixuxu yiyixuxu commented Aug 3, 2024

fix #9034

@yiyixuxu yiyixuxu requested review from asomoza, DN6 and sayakpaul August 3, 2024 02:41
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Member

@sayakpaul sayakpaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. Just a single comment.

@@ -12,6 +12,7 @@
is_note_seq_available,
is_onnx_available,
is_scipy_available,
is_sentencepiece_available,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually sentencepiece is needed by all the pipelines that need T5. Should we add them here as well?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

technically, they can use these pipelines without t5, no? i.e. use pre-computed text embeddings

EulerDiscreteScheduler,
KolorsPipeline,
UNet2DConditionModel,
)
from diffusers.pipelines.kolors import ChatGLMModel, ChatGLMTokenizer
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we already install sentencepiece for tests. So should be good:

"sentencepiece>=0.1.91,!=0.1.92",

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah, that was the main reason I didn't catch this

Copy link
Member

@asomoza asomoza left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

really nice! thanks.

@yiyixuxu yiyixuxu merged commit bc3c73a into main Aug 5, 2024
18 checks passed
@yiyixuxu yiyixuxu deleted the fix_kolors_dep branch August 5, 2024 18:04
sayakpaul added a commit that referenced this pull request Dec 23, 2024
* add sentencepiece as  soft dependency for kolors

* up

---------

Co-authored-by: Sayak Paul <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

AutoPipelineForText2Image requiring sentencepiece, which isn't a diffusers requirement
4 participants