Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDDS-11477. [doc] Add configuration description for datanode docs #7223

Merged
merged 6 commits into from
Sep 23, 2024
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions hadoop-hdds/docs/content/concept/Datanodes.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,3 +76,15 @@ blocks that get reported. That is a 40x reduction in the block reports.
This extra indirection helps tremendously with scaling Ozone. SCM has far
less block data to process and the namespace service (Ozone Manager) as a
different service are critical to scaling Ozone.


## Notable configurations

key | default | <div style="width: 300px;">description</div>
----|---------|------------
dfs.container.ratis.datanode.storage.dir | none | This directory is used for storing Ratis metadata like logs.
ozone.scm.datanode.id.dir | none | The path that datanodes will use to store the datanode ID.
hdds.datanode.dir | none | Determines where on the local filesystem HDDS data will be stored.
whbing marked this conversation as resolved.
Show resolved Hide resolved
hdds.datanode.dir.du.reserved | none | Reserved space in bytes per volume. Always leave this much space free for non dfs use.
ozone.metadata.dirs | none | Directory to store persisted data (RocksDB).
ozone.recon.address | 0.0.0.0:9891 | RPC address of the Recon. Use <host:port> to connect Recon.
13 changes: 13 additions & 0 deletions hadoop-hdds/docs/content/concept/Datanodes.zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,3 +49,16 @@ Ozone 的存储容器是一个自包含的超级块,容器中包含一系列
SCM 如何获得容器的位置?这一点和现有的 HDFS 十分相似。数据节点会定期发送类似于块报告的容器报告,容器报告比块报告的内容简洁的多,比如,对于一个存储容量为 196 TB 的集群,Ozone 大概会拥有四万个容器,相比于 HDFS 的一百五十万个块,块报告数量缩减为四十分之一。

这种间接管理的方式大大地提高了 Ozone 的扩展性,因为 SCM 需要处理的块数据大大减少,且命名服务(OM)作为一个独特的服务主体对于扩展 Ozone 具有重要意义。



whbing marked this conversation as resolved.
Show resolved Hide resolved
## 需要关注的配置项

配置项 |默认值 | <div style="width:300px;">描述</div>
----|---------|------------
dfs.container.ratis.datanode.storage.dir | none | 该目录用于存储 Ratis 元数据,如日志。
ozone.scm.datanode.id.dir | none | 数据节点上用于存储数据节点 ID 的路径。
hdds.datanode.dir | none | 此配置决定数据节点上的数据将存储在本地文件系统的哪个位置。
hdds.datanode.dir.du.reserved | none | 每个卷保留的存储空间(以字节为单位)。始终为非DFS用途保留这么多空闲空间。
ozone.metadata.dirs | none | 用于存储持久化数据(RocksDB)的目录。
ozone.recon.address | 0.0.0.0:9891 | Recon的RPC地址. 使用 <host:port> 连接到Recon.
whbing marked this conversation as resolved.
Show resolved Hide resolved