Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible bug #3

Open
trangham283 opened this issue Nov 2, 2018 · 3 comments
Open

Possible bug #3

trangham283 opened this issue Nov 2, 2018 · 3 comments

Comments

@trangham283
Copy link

trangham283 commented Nov 2, 2018

In lines 78 and 100, shouldn't the sign be flipped? i.e. increment r if delta > 2*orig_delta.
That's according to the Berg-Kirkpatrick et al. (2012) paper, unless I'm misunderstanding something.
Thanks!

@allanj
Copy link

allanj commented Aug 28, 2019

BTW, I also found that Berg-Kirkpatrick et al. (2012) mentioned in the footnote,
we can also use

delta (x_i) < 0

besides

delta > 2*orig_delta

@texttheater
Copy link

So... this was fixed for Bootstrap, but not for Permutation?

@texttheater
Copy link

texttheater commented Sep 12, 2022

Someone correct me please, but I think the original version is correct assuming that data_A is the output of the baseline and data_B is the output of the algorithm to be tested. If you swap the two, the sign of the deltas is going to be flipped, so you have to flip the comparator.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants