New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

會增加SimPO算法嗎? #3900

Closed

win10ogod opened this issue May 26, 2024 · 2 comments

Labels

solved

win10ogod commented May 26, 2024

https://github.com/princeton-nlp/SimPO
如標題所述全面超越DPO：陈丹琦团队提出简单偏好优化SimPO，还炼出最强8B开源模型

hiyouga added a commit that referenced this issue


          support SimPO #3900

cb63b32

Owner

hiyouga commented May 26, 2024

supported

hiyouga added the solved label

hiyouga closed this as completed

lcyuanjiang commented Jun 17, 2024

GLM4 9B 一直显存溢出
A800*2
batch_size 1
bf16_pure
zero3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment