Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Repair the issue where quantization failed after merging the adapter. #4950

Merged
merged 1 commit into from
Jul 26, 2024

Conversation

liuwwang
Copy link
Contributor

@liuwwang liuwwang commented Jul 24, 2024

fix #4728 : Repair the issue where quantization failed after merging the adapter.

@hiyouga
Copy link
Owner

hiyouga commented Jul 24, 2024

Please provide details about this issue

@liuwwang
Copy link
Contributor Author

Please provide details about this issue

修复 #4728 中提到的问题

问题导致原因:

未选择检查点时,检查点路径传入空list,导致逻辑错误,任务无法继续

问题代码如下:

Snipaste_2024-07-25_09-37-46

复现步骤:

1.页面设定合并导出的模型路径
2.检查点路径不要选择
3.设定量化等级并点击导出操作。
4.页面提示: 量化模型前请先合并适配器

@hiyouga hiyouga merged commit 9839c6d into hiyouga:main Jul 26, 2024
1 check passed
@xiaorui3
Copy link

我刚刚做模型量化导出还在想找个问题,结果一找就找到了,这个是很有帮助的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

如何将合并后的模型,导出为int4?
3 participants