Replies: 1 comment
-
以量化模型为例:如果你不在意速度,那就主要看你的内存能不能装下量化的模型,7B需要5G+,13B需要9G+可用内存。 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
最低可用的性能要求是多少?
Beta Was this translation helpful? Give feedback.
All reactions