You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've tried redb version v0.17.0 about 2 weeks ago.
The configs are default, we only modified the commit step from 5000 blocks to 5000 cache_values or 10 blocks.
The time consuming when indexing main net is OK in AWS node.
While bumping redb version to v0.20.0 or v0.22.0, the time consuming increases significantly.
cberner/redb#603
I've tried what cberner descibed: "make a BTreeMap for faster insertion before commit".
Tried with 8GB cache, sorted commit, and don't find too much improvement IMO.
Here are some flame graphs I've taken. Hope it will help.
I didn't benchmark v0.17.0 yet, due to not compatible db file version and lots of tests failed when downgrade database version.
But I'll keep an eye on it, and update this issue once it get done.
v0.20.0
v0.22.0
v0.22.0-sorted-commit
The text was updated successfully, but these errors were encountered:
@casey @raphjaph
Hi, casey, raph.
I've tried redb version v0.17.0 about 2 weeks ago.
The configs are default, we only modified the commit step from 5000 blocks to 5000 cache_values or 10 blocks.
The time consuming when indexing main net is OK in AWS node.
While bumping redb version to v0.20.0 or v0.22.0, the time consuming increases significantly.
cberner/redb#603
I've tried what cberner descibed: "make a BTreeMap for faster insertion before commit".
Tried with 8GB cache, sorted commit, and don't find too much improvement IMO.
Here are some flame graphs I've taken. Hope it will help.
I didn't benchmark v0.17.0 yet, due to not compatible db file version and lots of tests failed when downgrade database version.
But I'll keep an eye on it, and update this issue once it get done.
v0.20.0
![flamegraph-v0 20 0](https://private-user-images.githubusercontent.com/4676655/246131707-0036a349-0c81-4ed4-8fac-a6b6346e914c.svg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk1MjgyNDcsIm5iZiI6MTczOTUyNzk0NywicGF0aCI6Ii80Njc2NjU1LzI0NjEzMTcwNy0wMDM2YTM0OS0wYzgxLTRlZDQtOGZhYy1hNmI2MzQ2ZTkxNGMuc3ZnP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTRUMTAxMjI3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NzE2MzViZDVjMjg3YzA0NThkOWJmMzQ0ZjkyY2I4YzU5NDUwOGUxMTlhZWRiNWQzNmQzM2Y5NDhjMzBkZjE3MiZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.KyyB91OTO9iwU9MCOI6R-a1JBO7p2qLUm951QYeRDo0)
v0.22.0
![flamegraph-v0 22 0](https://private-user-images.githubusercontent.com/4676655/246131724-5cb6ddaf-28c5-4f01-a914-05ebd92aa1a9.svg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk1MjgyNDcsIm5iZiI6MTczOTUyNzk0NywicGF0aCI6Ii80Njc2NjU1LzI0NjEzMTcyNC01Y2I2ZGRhZi0yOGM1LTRmMDEtYTkxNC0wNWViZDkyYWExYTkuc3ZnP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTRUMTAxMjI3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NDgxYTlhMDA5MDA1ZDU0MWVhMDM4YzE5MzhkZWRjNGNmNDhiYTc5MmY3N2Q3M2Q1MGRhYjE4OGUyY2UyYWFmOCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.XJ8qpt6NBLct0gDNPrwMRMQ1cRZns4kPG0zCv-rXwrg)
v0.22.0-sorted-commit
![flamegraph-v0 22 0-sorted-commit](https://private-user-images.githubusercontent.com/4676655/246131722-ab0d2913-ba21-488f-8882-89efcb0a4247.svg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk1MjgyNDcsIm5iZiI6MTczOTUyNzk0NywicGF0aCI6Ii80Njc2NjU1LzI0NjEzMTcyMi1hYjBkMjkxMy1iYTIxLTQ4OGYtODg4Mi04OWVmY2IwYTQyNDcuc3ZnP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MDIxNCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTAyMTRUMTAxMjI3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NjljNTRlN2IxNmY3NzE5ZDA4MjkzMmFmNzgxYmQyMDUzZTgzM2MzOThhNjVlMDQ1YTIwYjY4MzEzMzBkN2EyOSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.GXAGUQ7Mj3Ctwi4ch2mCRuAxMCHZiyPAz8GuER3fm0o)
The text was updated successfully, but these errors were encountered: