Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

batchnorm issues #358

Closed
liupengkd opened this issue Apr 19, 2018 · 5 comments
Closed

batchnorm issues #358

liupengkd opened this issue Apr 19, 2018 · 5 comments

Comments

@liupengkd
Copy link

在batchnorm里的参数mean_data和var_data为什么不是根据输入数据算出来的而是模型读取的，对数据的高斯化不应该是要数据本来的均值和方差吗？
@harhar539
Copy link
Contributor

The runtime statistics are used in the training phase, while the accumulated values saved are used in the testing phase.

@liupengkd
Copy link
Author

@harhar539 这样和测试时使用测试数据自身的均值和方差会不会对结果产生大的影响

@nihui
Copy link
Member

nihui commented Apr 19, 2018

do you mean instancenorm ...

@liupengkd
Copy link
Author

@nihui yes

@nihui
Copy link
Member

nihui commented Apr 27, 2018

batchnorm inference 时候就是这样做的
https://arxiv.org/abs/1502.03167

@nihui nihui closed this as completed Apr 27, 2018
@zhu-zhaofei zhu-zhaofei mentioned this issue Dec 19, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@nihui @liupengkd @harhar539