Skip to content

Commit

Permalink
markdownlint
Browse files Browse the repository at this point in the history
  • Loading branch information
jojochuang committed Dec 14, 2024
1 parent 2a41af0 commit 271d48b
Show file tree
Hide file tree
Showing 2 changed files with 12 additions and 12 deletions.
13 changes: 6 additions & 7 deletions docs/03-core-concepts/02-replication/01-storage-containers.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,17 +23,16 @@ Containers are big binary units (5Gb by default) which can contain multiple bloc
![Containers](Containers.png)

Blocks are local information and not managed by SCM. Therefore even if billions of small files are created in the system (which means billions of blocks are created), only of the status of the containers will be reported by the Datanodes and containers will be replicated.

When Ozone Manager requests a new Block allocation from the SCM, SCM will identify the suitable container and generate a block id which contains `ContainerId` + `LocalId`. Client will connect to the Datanode which stores the Container, and datanode can manage the separated block based on the `LocalId`.
When Ozone Manager requests a new Block allocation from the SCM, SCM will identify the suitable container and generate a block id which contains `ContainerId` + `LocalId`. Client will connect to the Datanode which stores the Container, and Datanode can manage the separated block based on the `LocalId`.

## Open vs. Closed containers

When a container is created it starts in an OPEN state. When it's full (~5GB data is written), container will be closed and becomes a CLOSED container.

The fundamental differences between OPEN and CLOSED containers:

OPEN | CLOSED
-----------------------------------|-----------------------------------------
mutable | immutable
replicated with RAFT (Ratis) | Replicated with async container copy
Raft leader is used to READ / WRITE | All the nodes can be used to READ
| OPEN | CLOSED |
|-----------------------------------|-----------------------------------------|
| mutable | immutable |
| replicated with RAFT (Ratis) | Replicated with async container copy |
| Raft leader is used to READ / WRITE | All the nodes can be used to READ |
11 changes: 6 additions & 5 deletions package.json
Original file line number Diff line number Diff line change
Expand Up @@ -16,22 +16,23 @@
},
"dependencies": {
"@docusaurus/core": "3.3.2",
"@docusaurus/preset-classic": "3.3.2",
"@docusaurus/plugin-pwa": "3.3.2",
"@docusaurus/preset-classic": "3.3.2",
"@mdx-js/react": "^3.0.0",
"ajv": "^8.12.0",
"clsx": "^2.1.0",
"prism-react-renderer": "^2.3.1",
"react": "^18.2.0",
"react-dom": "^18.2.0",
"ajv": "^8.12.0"
"react-dom": "^18.2.0"
},
"devDependencies": {
"@docusaurus/module-type-aliases": "3.3.2",
"cspell": "^8.2.1",
"@cspell/dict-docker": "^1.1.7",
"@cspell/dict-java": "^5.0.6",
"@cspell/dict-markdown": "^2.0.1",
"@cspell/dict-shell": "^1.0.6",
"@docusaurus/module-type-aliases": "3.3.2",
"cspell": "^8.2.1",
"markdownlint": "^0.37.0",
"markdownlint-cli": "^0.39.0"
},
"browserslist": {
Expand Down

0 comments on commit 271d48b

Please sign in to comment.