add an initial feature for rerunning failing tests

[richarda]

I'm taking a crack at implementing #882 with the outline/example from Maven reruns

I thought that one particular example would be that you could get a pass out of this, but you should still see the error information.

I like the idea as a way to help get through a tough spot, but living with flaky tests should hurt a little bit 😄

I would love to get to adding some code if this is close to what people were looking for out of this enhancement.

What do you think @mattwynne ?

[richarda]

maybe a @flaky tag here?

[mattwynne]

Suggest we call it retry rather than rerun since rerun already has a meaning in our domain (the rerun formatter)

[mattwynne]

If we're going to reproduce the Maven behaviour (which is what I suggest we start with) then we should just have a global option.

[mattwynne]

One concern I have for you with this is that there may be some yak-shaving to do in order to meddle around with how the summary results like (1 passed, 1 flake) are printed. Currently that code is pretty ugly and old, and has almost reached the top of my refactoring list. It might be sensible to do that first on master. But you could get on with figuring out how to do the retries, in any case.

[richarda]

Thanks @mattwynne I'll take a look. I won't spend much time on the output here, but the global option to run with retries for any failures makes sense.

[mattwynne]

Superseded by #920

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.