Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AttributeError: 'SimPOConfig' object has no attribute 'ref_model_init_kwargs'. Did you mean 'model_init_kwargs'? #34

Open
Saumajit opened this issue Jul 4, 2024 · 2 comments

Comments

@Saumajit
Copy link

Saumajit commented Jul 4, 2024

I am following the run_simpo.py and running it in my system on a custom dataset (prepared in a similar format). I am getting the above mentioned error. I also tried to initialize ref_model_init_kwargs = model_init_kwargs and pass on to the trainer. However the error still persists. Please let me know what can be the possible fix to this solution?

@yumeng5
Copy link
Collaborator

yumeng5 commented Jul 9, 2024

Hi,

I'm not sure what caused the error you encountered as we haven't run into similar issues. We just updated the trainer scripts, and hopefully, the issues caused by using different package versions can be eliminated. Could you try again with the latest codebase?

Best,
Yu

@Saumajit
Copy link
Author

Hi,
I was using phi3/phi2 with data prepared accordingly. I got this error and thus I couldn't proceed. Any idea if that error is due to choosing the aforesaid model or for something else?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants