Replies: 1 comment
-
I don't think that we actually need this feature :-) |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
The idea is to make the differences between random values less different :-)
In the GUI it has to be a check box to enable normalization and an input box to set the normalization factor (it can be 2 by default)
The math:
After all elements are randomized, SM calculates https://en.wikipedia.org/wiki/Truncated_mean (dropping one min and one max values would be enough as for me) per block separately. Then each elements recalculates:
if randomized_weight >Truncated_mean then new_weight=Truncated_mean+(randomized_weight-Truncated_mean)/normalization_factor
if randomized_weight <Truncated_mean then new_weight=Truncated_mean-(Truncated_mean-randomized_weight)/normalization_factor
As the result we'll get a new distribution like this(for BASE):
Beta Was this translation helpful? Give feedback.
All reactions