Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

12月12日更新后，Qwen-14B模型加载时间异常缓慢 #1819

Closed
1 task done
frozenarctic opened this issue Dec 13, 2023 · 2 comments
Closed
1 task done

12月12日更新后，Qwen-14B模型加载时间异常缓慢 #1819

frozenarctic opened this issue Dec 13, 2023 · 2 comments
Labels
solved This problem has been already solved

Comments

@frozenarctic
Copy link

Reminder

  • I have read the README and searched the existing issues.

Reproduction

加载Qwen-14B和checkpoint进行chat，以下画面停留了几分钟：
image

过了好久才加载完毕，比之前的版本花费的时间多了几倍，加载完成后能正常chat。
image

不知道是不是模型加载机制调整了。

Expected behavior

No response

System Info

No response

Others

No response
@hiyouga hiyouga added the pending This problem is yet to be addressed label Dec 13, 2023
@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels Dec 13, 2023
@hiyouga
Copy link
Owner

hiyouga commented Dec 13, 2023

修复了

@orbit-clown
Copy link

orbit-clown commented Jun 11, 2024 •
edited
Loading

我现在用Qwen1.5-14B出现了类似的情况，加载权重非常慢，而且会卡在99%很久。。。用的NPU
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
solved This problem has been already solved
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@hiyouga @orbit-clown @frozenarctic