Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SD3 Lora support #16212

Merged
merged 2 commits into from
Jul 20, 2024
Merged

SD3 Lora support #16212

merged 2 commits into from
Jul 20, 2024

Conversation

AUTOMATIC1111
Copy link
Owner

  • tested to work on all currently existing SD3 loras on civitai
  • should probably add more diffusers layer name mappings, but I'd rather do id when there's a lora for me to work with

@tritant
Copy link

tritant commented Jul 16, 2024

Lora working with sd3, but if you load a sdxl model lora does not work anymore.
You can find more lora here: https://www.shakker.ai/search?keyword=sd3

    return forward_call(*args, **kwargs)
  File "C:\sd.webui\webui\extensions-builtin\Lora\networks.py", line 639, in network_MultiheadAttention_forward
    network_apply_weights(self)
  File "C:\sd.webui\webui\extensions-builtin\Lora\networks.py", line 440, in network_apply_weights
    bias_backup = store_weights_backup(self.out_proj)
  File "C:\sd.webui\webui\extensions-builtin\Lora\networks.py", line 380, in store_weights_backup
    return weight.to(devices.cpu, copy=True)
  File "C:\sd.webui\webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1141, in to
    device, dtype, non_blocking, convert_to_format = torch._C._nn._parse_to(*args, **kwargs)
RuntimeError: .to() does not accept copy argument

@AUTOMATIC1111 AUTOMATIC1111 merged commit ea90381 into dev Jul 20, 2024
6 checks passed
@AUTOMATIC1111 AUTOMATIC1111 deleted the sd3_lora branch July 20, 2024 08:39
@viking1304 viking1304 mentioned this pull request Jul 21, 2024
6 tasks
@SunGreen777
Copy link

https://www.shakker.ai/search?keyword=sd3

Thanks for this resource. It’s unclear what’s happening on CivitAi

@lawchingman lawchingman mentioned this pull request Oct 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants