Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[training] CogVideoX Lora #9302

Merged
merged 68 commits into from
Sep 19, 2024
Merged

[training] CogVideoX Lora #9302

Show file tree
Hide file tree
Changes from 61 commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
dc08234
cogvideox lora training draft
a-r-r-o-w Aug 28, 2024
f12e669
update
a-r-r-o-w Aug 28, 2024
24c362c
update
a-r-r-o-w Aug 29, 2024
588c6ee
update
a-r-r-o-w Aug 31, 2024
74e6f90
update
a-r-r-o-w Sep 1, 2024
63e80b7
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 3, 2024
9a95d8d
update
a-r-r-o-w Sep 3, 2024
efa9b0a
make fix-copies
a-r-r-o-w Sep 3, 2024
4c56287
update
a-r-r-o-w Sep 4, 2024
3afb2e2
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 6, 2024
038fec4
update
a-r-r-o-w Sep 7, 2024
a063503
apply suggestions from review
a-r-r-o-w Sep 7, 2024
4e81d5a
apply suggestions from reveiw
a-r-r-o-w Sep 7, 2024
ad2f35f
fix typo
a-r-r-o-w Sep 7, 2024
4159b3b
Update examples/cogvideo/train_cogvideox_lora.py
a-r-r-o-w Sep 7, 2024
b1ca3db
fix lora alpha
a-r-r-o-w Sep 7, 2024
f35c36c
use correct lora scaling for final test pipeline
a-r-r-o-w Sep 9, 2024
8f7ee5a
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 10, 2024
7e9e25c
Update examples/cogvideo/train_cogvideox_lora.py
a-r-r-o-w Sep 12, 2024
165d9b2
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 12, 2024
2e4a1bf
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 13, 2024
80c8771
apply suggestions from review; prodigy optimizer
a-r-r-o-w Sep 14, 2024
6a97b1b
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 14, 2024
f1f9e81
add tests
a-r-r-o-w Sep 14, 2024
200f63a
make style
a-r-r-o-w Sep 14, 2024
e5a44fd
add README
a-r-r-o-w Sep 14, 2024
5e5ee43
update
a-r-r-o-w Sep 14, 2024
f1740b0
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 14, 2024
8aa62dd
update
a-r-r-o-w Sep 14, 2024
0bd238a
make style
a-r-r-o-w Sep 14, 2024
96b2f17
fix
a-r-r-o-w Sep 15, 2024
e83200e
update
a-r-r-o-w Sep 15, 2024
e3c2677
add test skeleton
a-r-r-o-w Sep 15, 2024
e3a9fe7
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 15, 2024
19d12f5
revert lora utils changes
a-r-r-o-w Sep 15, 2024
ca9d9a1
add cleaner modifications to lora testing utils
a-r-r-o-w Sep 15, 2024
a3ca2a2
update lora tests
a-r-r-o-w Sep 16, 2024
4679088
deepspeed stuff
a-r-r-o-w Sep 16, 2024
b07ac74
add requirements.txt
a-r-r-o-w Sep 16, 2024
0d95b0c
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 16, 2024
ec8d483
deepspeed refactor
a-r-r-o-w Sep 16, 2024
969a960
add lora stuff to img2vid pipeline to fix tests
a-r-r-o-w Sep 16, 2024
0aa8f3a
fight tests
a-r-r-o-w Sep 17, 2024
1b0a6bd
add co-authors
a-r-r-o-w Sep 17, 2024
2ec6232
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 17, 2024
6d704ce
fight lora runner tests
a-r-r-o-w Sep 17, 2024
f07755f
import Dummy optim and scheduler only wheh required
a-r-r-o-w Sep 17, 2024
57d7ca6
update docs
a-r-r-o-w Sep 17, 2024
f8fd727
add coauthors
a-r-r-o-w Sep 17, 2024
0c8ec36
remove option to train text encoder
a-r-r-o-w Sep 17, 2024
0e1c569
update tests
a-r-r-o-w Sep 17, 2024
7c84394
fight more tests
a-r-r-o-w Sep 17, 2024
5893fdc
update
a-r-r-o-w Sep 17, 2024
60ea9ae
fix vid2vid
a-r-r-o-w Sep 17, 2024
14d2191
fix typo
a-r-r-o-w Sep 17, 2024
f9f47ea
remove lora tests; todo in follow-up PR
a-r-r-o-w Sep 17, 2024
6ab5047
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 17, 2024
a3f3fa1
undo img2vid changes
a-r-r-o-w Sep 18, 2024
f8a8444
remove text encoder related changes in lora loader mixin
a-r-r-o-w Sep 18, 2024
4c92f62
Revert "remove text encoder related changes in lora loader mixin"
a-r-r-o-w Sep 18, 2024
f138eab
update
a-r-r-o-w Sep 18, 2024
2e57269
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 18, 2024
47937cd
round 1 of fighting tests
a-r-r-o-w Sep 18, 2024
528bd73
round 2 of fighting tests
a-r-r-o-w Sep 18, 2024
fda6604
fix copied from comment
a-r-r-o-w Sep 18, 2024
6b586ea
fix typo in lora test
a-r-r-o-w Sep 18, 2024
ac68ee2
update styling
a-r-r-o-w Sep 19, 2024
a2e850b
Merge branch 'main' into cogvideox-lora-and-training
a-r-r-o-w Sep 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
228 changes: 228 additions & 0 deletions examples/cogvideo/README.md
View file
Open in desktop

Large diffs are not rendered by default.

10 changes: 10 additions & 0 deletions examples/cogvideo/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
accelerate>=0.31.0
torchvision
transformers>=4.41.2
ftfy
tensorboard
Jinja2
peft>=0.11.1
sentencepiece
decord>=0.6.0
imageio-ffmpeg
Loading
Loading