feat(meta): introduce consistent hash logic

[xx01cyx]

What's changed and what's your intention?

PLEASE DO NOT LEAVE THIS EMPTY !!!

Please explain IN DETAIL what the changes are in this PR and why they are needed:

• Summarize your change (mandatory)

  • Introduce consistent hash logic (altering mapping when a node enters or leaves the cluster)
  • Introduce ParallelUnit for each ComputeNode

• How does this PR work? Need a brief introduction for the changed logic (optional)

• Describe clearly one logical change and avoid lazy messages (optional)

• Describe any limitations of the current code (optional)

Checklist

• I have written necessary docs and comments
• I have added necessary unit tests and integration tests

Refer to a related PR or issue link (optional)

#381

[fuyufjh]

Good job!

[fuyufjh]

I think it's okay to recalculate the load everytime on add/delete node instead of maintaining such a map, which may simplify the implementation.

[codecov]

Codecov Report

Merging #626 (49a3df9) into main (c49c9aa) will increase coverage by 0.07%.
The diff coverage is 85.61%.

@@             Coverage Diff              @@
##               main     #626      +/-   ##
============================================
+ Coverage     71.35%   71.43%   +0.07%     
  Complexity     2699     2699              
============================================
  Files           891      893       +2     
  Lines         50657    50935     +278     
  Branches       1723     1723              
============================================
+ Hits          36146    36384     +238     
- Misses        13699    13739      +40     
  Partials        812      812              

Flag	Coverage Δ
java	60.06% <ø> (ø)
rust	76.34% <85.61%> (+0.07%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
rust/meta/src/model/mod.rs	76.31% <ø> (ø)
rust/meta/src/cluster/mod.rs	59.43% <50.00%> (-2.77%)	⬇️
rust/meta/src/model/hash_mapping.rs	88.00% <88.00%> (ø)
rust/meta/src/manager/hash_dispatch.rs	89.09% <89.09%> (ø)
rust/frontend/src/scheduler/plan_fragmenter.rs	98.56% <100.00%> (+0.03%)	⬆️
rust/meta/src/manager/id.rs	91.37% <100.00%> (+0.15%)	⬆️
rust/meta/src/model/cluster.rs	83.33% <100.00%> (+3.33%)	⬆️
rust/meta/src/hummock/compaction.rs	67.32% <0.00%> (-0.66%)	⬇️
rust/frontend/src/planner/mod.rs	100.00% <0.00%> (ø)
rust/frontend/src/planner/select.rs	66.66% <0.00%> (ø)
... and 34 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c49c9aa...49a3df9. Read the comment docs.

[fuyufjh]

Generally LGTM.

[fuyufjh]

Please feel free to click the "Ready for review" button to make it able to merge