Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Should we standardize the output of our benchmarks? #346

Open
Oppen opened this issue Jan 18, 2022 · 1 comment
Open

Should we standardize the output of our benchmarks? #346

Oppen opened this issue Jan 18, 2022 · 1 comment

Comments

@Oppen
Copy link
Collaborator

Oppen commented Jan 18, 2022

I've been toying with the idea of making CRoaring benchmarks print their results in a format compatible with the benchstat tool we use in the Go world for comparing different runs. I think it would help us make more informed decisions when optimizing.

Related to this, after we tackle #284 we should be able to use an allocator that keeps track of how many allocations we make and how much memory we use for a given operation, which could further aid comparison.

@lemire
Copy link
Member

lemire commented Jan 18, 2022

Good idea.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants