Hadoop 如何单独更改配置单元的HDFS复制因子

Hadoop 如何单独更改配置单元的HDFS复制因子,hadoop,hive,hadoop2,Hadoop,Hive,Hadoop2,我们当前的HDFS群集的复制系数为1。但为了提高性能和可靠性(节点故障),我们希望仅将配置单元中间文件(Hive.exec.scratchdir)复制系数增加到5。有可能实现这一点吗 问候,, Selva查看-setrep是否对您有帮助 setrep 用法: hadoop fs -setrep [-R] [-w] <numReplicas> <path> 示例: The -w flag requests that the command wait for the rep

我们当前的HDFS群集的复制系数为1。但为了提高性能和可靠性(节点故障),我们希望仅将配置单元中间文件(Hive.exec.scratchdir)复制系数增加到5。有可能实现这一点吗

问候,,
Selva

查看
-setrep
是否对您有帮助

setrep

用法:

hadoop fs -setrep [-R] [-w] <numReplicas> <path>
示例:

The -w flag requests that the command wait for the replication to complete. This can potentially take a very long time.

The -R flag is accepted for backwards compatibility. It has no effect.
hadoop fs -setrep -w 3 /user/hadoop/dir1

hadoop fs -setrep -R -w 100 /path/to/hive/warehouse
参考: