Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

redb slow down when bump to v0.20.0 compare with v0.17.0 #2183

Closed
BillZong opened this issue Jun 15, 2023 · 1 comment
Closed

redb slow down when bump to v0.20.0 compare with v0.17.0 #2183

BillZong opened this issue Jun 15, 2023 · 1 comment
Assignees

Comments

@BillZong
Copy link

BillZong commented Jun 15, 2023

@casey @raphjaph
Hi, casey, raph.

I've tried redb version v0.17.0 about 2 weeks ago.
The configs are default, we only modified the commit step from 5000 blocks to 5000 cache_values or 10 blocks.
The time consuming when indexing main net is OK in AWS node.
While bumping redb version to v0.20.0 or v0.22.0, the time consuming increases significantly.

cberner/redb#603
I've tried what cberner descibed: "make a BTreeMap for faster insertion before commit".
Tried with 8GB cache, sorted commit, and don't find too much improvement IMO.

Here are some flame graphs I've taken. Hope it will help.
I didn't benchmark v0.17.0 yet, due to not compatible db file version and lots of tests failed when downgrade database version.
But I'll keep an eye on it, and update this issue once it get done.

  • v0.20.0
    flamegraph-v0 20 0

  • v0.22.0
    flamegraph-v0 22 0

  • v0.22.0-sorted-commit
    flamegraph-v0 22 0-sorted-commit

@veryordinally
Copy link
Collaborator

We merged redb 1.0.2 - indexing performance comparable to 0.13.0 with sufficient cache.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants