Warning: file_get_contents(/data/phpspider/zhask/data//catemap/1/visual-studio-2012/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Hadoop 流中的最后一个txid无效_Hadoop_High Availability - Fatal编程技术网

Hadoop 流中的最后一个txid无效

Hadoop 流中的最后一个txid无效,hadoop,high-availability,Hadoop,High Availability,我正在尝试配置hadoop namenode HA和resourcemanager HA。但是,当我以待机状态启动namenode时,我得到了IllegalArgumentException,如下所示: ===================================================== About to bootstrap Standby ID nn2 from: Nameservice ID: mycluster Other

我正在尝试配置hadoop namenode HA和resourcemanager HA。但是,当我以待机状态启动namenode时,我得到了IllegalArgumentException,如下所示:

=====================================================
 About to bootstrap Standby ID nn2 from:
            Nameservice ID: mycluster
         Other Namenode ID: nn1
   Other NN's HTTP address: http://my1.namenode.com:50070
   Other NN's IPC  address: my1.namenode.com/xxx.xxx.xxx.xxx:8020
              Namespace ID: 1915209867
             Block pool ID: BP-740716617-xxx.xxx.xxx.xxx-1409206617148
                Cluster ID: CID-51cea219-ffe7-4a52-8a6c-fb83d501ccaa
            Layout version: -56
 =====================================================
 Data exists in Storage Directory /hadoop1/hadoop/hdfs/nn. Formatting anyway.
 14/11/05 16:41:20 INFO common.Storage: Storage directory /hadoop1/hadoop/hdfs/nn has been successfully formatted.
 14/11/05 16:41:20 WARN common.Util: Path /hadoop1/hadoop/hdfs/nn should be specified as a URI in configuration files. Please update hdfs configuration.
 14/11/05 16:41:20 WARN common.Util: Path /hadoop1/hadoop/hdfs/nn should be specified as a URI in configuration files. Please update hdfs configuration.
 14/11/05 16:41:21 FATAL namenode.NameNode: Exception in namenode join
 java.io.IOException: java.lang.IllegalArgumentException: invalid last txid in stream: http://my3.namenode.com:8480/getJournal?jid=mycluster&segmentTxId=74823&storageInfo=-56%3A1915209867%3A0%3ACID-51cea219-ffe7-4a52-8a6c-fb83d501ccaa
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:317)
         at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1306)
         at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1395)
 Caused by: java.lang.IllegalArgumentException: invalid last txid in stream: http://my3.namenode.com:8480/getJournal?jid=mycluster&segmentTxId=74823&storageInfo=-56%3A1915209867%3A0%3ACID-51cea219-ffe7-4a52-8a6c-fb83d501ccaa
         at com.google.common.base.Preconditions.checkArgument(Preconditions.java:115)
         at org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream.<init>(RedundantEditLogInputStream.java:101)
         at org.apache.hadoop.hdfs.server.namenode.JournalSet.chainAndMakeRedundantStreams(JournalSet.java:300)
         at org.apache.hadoop.hdfs.qjournal.client.QuorumJournalManager.selectInputStreams(QuorumJournalManager.java:494)
         at org.apache.hadoop.hdfs.server.namenode.JournalSet.selectInputStreams(JournalSet.java:260)
         at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1399)
         at org.apache.hadoop.hdfs.server.namenode.FSEditLog.selectInputStreams(FSEditLog.java:1418)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.checkLogsAvailableForRead(BootstrapStandby.java:236)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.doRun(BootstrapStandby.java:203)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.access$000(BootstrapStandby.java:69)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby$1.run(BootstrapStandby.java:106)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby$1.run(BootstrapStandby.java:102)
         at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:102)
         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
         at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:312)
         ... 2 more
 14/11/05 16:41:21 INFO util.ExitUtil: Exiting with status 1
 14/11/05 16:41:21 INFO namenode.NameNode: SHUTDOWN_MSG:
 /************************************************************
 SHUTDOWN_MSG: Shutting down NameNode at 
 ************************************************************/
所有其他的都工作正常,我已经检查了hdfs-site.xml配置以查找问题,但是我找不到任何东西

请帮帮我

谢谢

重新启动:

./sbin/hadoop-daemon.sh start journalnode

您是否尝试过先格式化Namenode,然后配置Namenode HA?是的,我们尝试过…:-当我们访问特定数据时,问题就出现了。