Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Dy2Stat]Add NoNeedBufferVarsInferer to reduce memory usage #34177

Merged
merged 2 commits into from
Jul 16, 2021

Conversation

Aurelius84
Copy link
Contributor

@Aurelius84 Aurelius84 commented Jul 15, 2021

PR types

Others

PR changes

Others

Describe

Add NoNeedBufferVarsInferer to reduce memory usage

显存占用(M) 静态图 动态图 to_static(优化前) 优化后 减少比例
ResNet50_bs32 5115 4608 5626 4770 -15.2%
ResNet50_bs128 15087 13329 15157 14050 -7.3%
MobileNetV1_bs128 - 7481 8025 7063 -11.9%
MobileNetV2_bs128 - 9345 10419 9287 -10.8%
Bert Base 8531 7085 7523 7167 -4.7%

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@Aurelius84 Aurelius84 requested review from zhhsplendid and zhiqiu July 15, 2021 09:20
Copy link
Member

@zhhsplendid zhhsplendid left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Aurelius84 Aurelius84 merged commit 7049af5 into PaddlePaddle:develop Jul 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants