-
Notifications
You must be signed in to change notification settings - Fork 269
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
More reasonable and accurate benchmarks #460
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
9 tasks
Glad to see we have more accurate benchmark. I will use it. |
@huihan365 We are often bound by array containers. Use Now that we have the foundation for AVX-512, we should be able to really optimize it well. |
Got it, i will work on it when i finish my work on-hand. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Currently, the CRoaring project does not have, by itself, sensible microbenchmarks. This PR will fix that.
(The 'benchmarks' directory is filled with ad hoc benchmarks that may have their uses.)
Running microbenchmarks
We have microbenchmarks constructed with the Google Benchmarks.
Under Linux or macOS, you may run them as follows:
By default, the benchmark tools picks one data set (e.g.,
CRoaring/benchmarks/realdata/census1881
).We have several data sets and you may pick others:
You may disable some functionality for the purpose of benchmarking. For example, you could
benchmark the code without AVX-512 even if both your processor and compiler supports it: