Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add parallel LMDB database implementation #177

Merged
merged 28 commits into from
Mar 13, 2022
Merged

Add parallel LMDB database implementation #177

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
faf0e72
Refactor database into separate module
casey Mar 3, 2022
59dab56
Move into redb_database module
casey Mar 3, 2022
a28264c
Remove unused cfg
casey Mar 3, 2022
23a81df
Add empty lmdb database
casey Mar 3, 2022
6d7d60a
Placate clippy
casey Mar 3, 2022
891021f
Begin work on lmdb database implementation
terror Mar 3, 2022
be53603
Start transaction after creating databases
casey Mar 6, 2022
f62eba7
Fix empty_index test
casey Mar 6, 2022
8a557de
Add index.lmdb to .gitignore
casey Mar 6, 2022
ea738a5
Use lmdb-zero, list tests pass
terror Mar 6, 2022
ff80bfd
Add run and remove dbg
casey Mar 6, 2022
924873d
Add ctrl-c handler
casey Mar 7, 2022
4a61189
Print stats
casey Mar 7, 2022
d2b3c19
Do the thing
casey Mar 12, 2022
394fc64
Use both databases on CI
casey Mar 12, 2022
e475839
Fix bugs
casey Mar 12, 2022
9d05327
Initialize database tables on open
casey Mar 12, 2022
a259b65
Test that old transactions are pruned
casey Mar 12, 2022
90599dc
Remove old satpoints
casey Mar 12, 2022
1705ee8
Implement remove satpoint for redb
casey Mar 12, 2022
f449a9c
Fix test
casey Mar 13, 2022
ef2b04d
Placate clippy
casey Mar 13, 2022
09cc61f
Fix CI fmt
casey Mar 13, 2022
81f6848
Sort deps
casey Mar 13, 2022
879329d
Remove flamegraph
casey Mar 13, 2022
11f825b
Remove clean recipe
casey Mar 13, 2022
bd4fdea
Remove unnecessary static
casey Mar 13, 2022
33add35
Fmt
casey Mar 13, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 8 additions & 3 deletions .github/workflows/ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,13 +44,18 @@ jobs:
cargo update --locked --package ord

- name: Test
run: cargo test --all
run: |
cargo test --all
cargo test --all --features redb

- name: Clippy
run: cargo clippy --all --all-targets
run: |
cargo clippy --all --all-targets
cargo clippy --all --all-targets --features redb

- name: Format
run: cargo fmt --all -- --check
run: |
cargo fmt --all -- --check

- name: Check for Forbidden Words
if: ${{ matrix.os == 'ubuntu-latest' }}
Expand Down
3 changes: 2 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
.idea/
/.idea/
/index.lmdb
/index.redb
/target
113 changes: 107 additions & 6 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 5 additions & 1 deletion Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,9 @@ autotests = false
[dependencies]
bitcoin = "0.27.1"
bitcoincore-rpc = "0.14.0"
chrono = "0.4.19"
clap = { version = "3.1.0", features = ["derive"] }
ctrlc = "3.2.1"
derive_more = "0.99.17"
dirs = "4.0.0"
env_logger = "0.9.0"
Expand All @@ -18,7 +20,9 @@ integer-cbrt = "0.1.2"
integer-sqrt = "0.1.5"
jsonrpc = "0.12.1"
log = "0.4.14"
redb = "0.0.5"
ord-lmdb-zero = "0.4.5"
rayon = "1.5.1"
redb = { version = "0.0.5", optional = true }

[dev-dependencies]
criterion = "0.3.5"
Expand Down
Loading