Virtual batch Normalization

[sahiliitm]

If I understand the code correctly, it uses virtual batch normalization only for the inputs and not for the intermediate layers.

Was this done in the Atari context for getting the results stated in the paper?

Also, what was the network architecture used for the Atari domain?

[joyousrabbit]

@sahiliitm Hello, in the paper, it is stated " We used the same preprocessing and feedforward CNN architecture used by (Mnih et al., 2016)". So it should be the traditional two layers FF.

[PatrykChrabaszcz]

Hi @sahiliitm

Could you point me to the code where you see virtual batch normalisation implementation?
I thought it is:

@property
def needs_ref_batch(self):
     return False

Which is currently not implemented

[louiskirsch]

In the code here we have just z-normalization for the inputs, no virtual batch norm.
Also no hyperparameters for Atari. OpenAI, please be more reproducible! :-)