Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mindspore 是否支持Elastic Training #316

Open
Ind1x1 opened this issue Nov 13, 2024 · 1 comment
Open

Mindspore 是否支持Elastic Training #316

Ind1x1 opened this issue Nov 13, 2024 · 1 comment

Comments

@Ind1x1
Copy link

Ind1x1 commented Nov 13, 2024 •
edited
Loading

Mindspore 是否支持Elastic Training？是否有在这方面过计划？
@zhouyifeng888
Copy link

你指的是动态调整一些训练超参数吗？动态的调整学习率、优化器超参等，据我了解是支持的，但动态图和静态图的情况有差别，动态图下支持的情况比较好，但如果静态图的话，有些支持效果不好，比如batchsize要是改变了，就会出现计算图重新编译的情况，会消耗很多时间；但动态图的性能会比静态图差一些；
如果说的是大规模集群并行训练中的计算资源随时动态分配调整的话，目前还没看到官方消息说支持这个特性

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zhouyifeng888 @Ind1x1