Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

freeze类型如何指定lm_head可训练？ #3694

Closed
CanvaChen opened this issue May 11, 2024 · 2 comments
Closed

freeze类型如何指定lm_head可训练？ #3694

CanvaChen opened this issue May 11, 2024 · 2 comments
Labels
solved This problem has been already solved

Comments

@CanvaChen
Copy link

如题
@hiyouga hiyouga added enhancement New feature or request pending This problem is yet to be addressed labels May 11, 2024
@CanvaChen
Copy link
Author

embed_tokens 能一起支持吗？

@hiyouga hiyouga added in-progress The related features are in the progress solved This problem has been already solved and removed enhancement New feature or request pending This problem is yet to be addressed in-progress The related features are in the progress labels May 15, 2024
@hiyouga
Copy link
Owner

hiyouga commented May 15, 2024 •
edited
Loading

freeze_extra_modules: embed_tokens,lm_head

@upskyy upskyy mentioned this issue Jul 31, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
solved This problem has been already solved
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Support for training lm_head in freeze finetuning_type upskyy/LLaMA-Factory
2 participants
@hiyouga @CanvaChen