feat(storage): init compaction group

[zwang28]

What's changed and what's your intention?

This PR initializes compaction group. To be compatible with current code, we temporarily create one default compaction group and use the existent tiered compaction picker for it. All files are added to the default compaction group, so the whole write path remains the same.

Changes

• Send compaction request to compaction scheduler when HummockManager::commit_epoch, instead of previous periodic compaction trigger. The compaction frequency are expected to be very different from before.
• Define dedicated error types for hummock meta module, to distinguish retryable errors from unretryable ones.
• Move some code from hummock_manager.rs to versioning.rs and compaction.rs, to reduce hummock_manager.rs size.

TODO

• Compaction task may be stuck if meta fails at https://github.com/singularity-data/risingwave/blob/0699492be69646bed553b25a76f6ceb5c4474b0d/src/meta/src/hummock/compaction_scheduler.rs#L150
  • either cancel all pending compaction tasks on failover
  • or a compaction task should be marked as sent/unsent, and cancel all unsent ones on failover
• Add the real default compaction group which is responsible for dispatching KVs to their targeted compaction group.
• After multiple level enabled, also send compaction request to compaction scheduler when HummockManager::report_compact_task.

Checklist

• I have written necessary docs and comments
• I have added necessary unit tests and integration tests

Refer to a related PR or issue link (optional)

[github-actions]

license-eye has totally checked 771 files.

Valid	Invalid	Ignored	Fixed
768	1	2	0

Click to see the invalid file list

• src/meta/src/hummock/manager/mod.rs

[codecov]

Codecov Report

Merging #2248 (0699492) into main (65a1958) will decrease coverage by 0.06%.
The diff coverage is 61.69%.

@@            Coverage Diff             @@
##             main    #2248      +/-   ##
==========================================
- Coverage   71.24%   71.18%   -0.07%     
==========================================
  Files         655      660       +5     
  Lines       83523    83865     +342     
==========================================
+ Hits        59507    59696     +189     
- Misses      24016    24169     +153     

Flag	Coverage Δ
rust	71.18% <61.69%> (-0.07%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...ummock/compaction_group/group_compaction_picker.rs	0.00% <0.00%> (ø)
src/meta/src/hummock/compaction_scheduler.rs	0.00% <0.00%> (ø)
src/meta/src/hummock/compactor_manager.rs	98.21% <ø> (ø)
src/meta/src/hummock/mod.rs	22.44% <0.00%> (+1.08%)	⬆️
src/meta/src/hummock/utils.rs	0.00% <0.00%> (ø)
src/meta/src/rpc/service/hummock_service.rs	0.00% <0.00%> (ø)
src/meta/src/storage/meta_store.rs	25.00% <0.00%> (-37.50%)	⬇️
src/meta/src/hummock/error.rs	13.79% <13.79%> (ø)
src/meta/src/hummock/compaction_group/mod.rs	60.41% <61.70%> (+60.41%)	⬆️
src/meta/src/hummock/mock_hummock_meta_client.rs	51.06% <63.15%> (+1.69%)	⬆️
... and 23 more

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

[zwang28]

Will split to smaller PRs after #2242