Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

您好，如何在日志增加输出Tokens/gpu/s和TFLOPS #3646

Closed
Liuweixiong0118 opened this issue May 9, 2024 · 6 comments · Fixed by #4066
Closed

您好，如何在日志增加输出Tokens/gpu/s和TFLOPS #3646

Liuweixiong0118 opened this issue May 9, 2024 · 6 comments · Fixed by #4066
Labels
solved This problem has been already solved

Comments

@Liuweixiong0118
Copy link

您好，如何在日志增加输出Tokens/gpu/s和TFLOPS
@rangehow
Copy link

rangehow commented May 9, 2024

+1，希望可以在日志里加上衡量吞吐性能的指标

@hiyouga hiyouga added the pending This problem is yet to be addressed label May 11, 2024
@1737686924
Copy link

+1,希望有训练和推理的Tokens/s/p

@hiyouga hiyouga mentioned this issue Jun 5, 2024
Merged
1 task
@hiyouga
Copy link
Owner

hiyouga commented Jun 5, 2024 •
edited
Loading

fixed in #4066

@hiyouga hiyouga added solved This problem has been already solved and removed pending This problem is yet to be addressed labels Jun 5, 2024
@hiyouga hiyouga closed this as completed Jun 5, 2024
@a383615194
Copy link

a383615194 commented Jun 7, 2024 •
edited
Loading

@hiyouga hi，麻烦问下这个方法支持全量SFT计算吞吐吗？我测试sft的时候throughput输出的一直为0
目前我看代码好像只是dpo中支持了这个功能对吗？

WeChat2fe2e311ad7a7f0af5fd35c15254403b

@hiyouga
Copy link
Owner

hiyouga commented Jun 7, 2024

@a383615194 我这边测试 sft 是可以的

@Jeffrey-JDong
Copy link

@a383615194 我也遇到这个问题，sft时throughput一直为0，请问解决了吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
solved This problem has been already solved
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

add throughput entry to training log injet-zhou/LLaMA-Factory
6 participants
@hiyouga @Jeffrey-JDong @a383615194 @rangehow @Liuweixiong0118 @1737686924