Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/hadoop/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
未能在project hadoop project dist上执行目标org.apache.maven.plugins:maven antrun plugin:1.6:run(pre-dist):_Hadoop_Rhadoop - Fatal编程技术网

未能在project hadoop project dist上执行目标org.apache.maven.plugins:maven antrun plugin:1.6:run(pre-dist):

未能在project hadoop project dist上执行目标org.apache.maven.plugins:maven antrun plugin:1.6:run(pre-dist):,hadoop,rhadoop,Hadoop,Rhadoop,我需要帮助,因为在过去的2-3天里我一直在努力解决这个问题 我正在Windows-7 64位机器上安装Hadoop。这是为了尝试R与Hadoop的集成 我按照URL中给出的Hadoop安装说明进行操作- 环境变量如下所示 JAVE_HOME:C:\Program Files\Java\jdk1.6.0_45 M2\u HOME:C:\Hadoop\apache-maven-3.1.1 路径:C:\cygwin64\bin;C:\Hadoop\apache-maven-3.1.1\bin;C:\H

我需要帮助,因为在过去的2-3天里我一直在努力解决这个问题

我正在Windows-7 64位机器上安装Hadoop。这是为了尝试R与Hadoop的集成

我按照URL中给出的Hadoop安装说明进行操作-

环境变量如下所示 JAVE_HOME:C:\Program Files\Java\jdk1.6.0_45 M2\u HOME:C:\Hadoop\apache-maven-3.1.1 路径:C:\cygwin64\bin;C:\Hadoop\apache-maven-3.1.1\bin;C:\Hadoop\protoc-2.5.0-win32


mvn包-Pdist,本机win-DSKIPTEST-Dtar

我从Windows SDK 7.1命令提示符运行了上面的命令,并在下面得到错误。。。非常感谢您的早期帮助

****************************************************************************************

    [INFO] ------------------------------------------------------------------------
    [INFO] Reactor Summary:
    [INFO]
    [INFO] Apache Hadoop Main ................................ SUCCESS [8.893s] 
    [INFO] Apache Hadoop Project POM ......................... SUCCESS [4.782s] 
    [INFO] Apache Hadoop Annotations ......................... SUCCESS [9.500s]
    [INFO] Apache Hadoop Assemblies .......................... SUCCESS [2.145s]
    [INFO] Apache Hadoop Project Dist POM .................... FAILURE [4.141s]
    [INFO] Apache Hadoop Maven Plugins ....................... SKIPPED
    [INFO] Apache Hadoop Auth ................................ SKIPPED
    [INFO] Apache Hadoop Auth Examples ....................... SKIPPED
    [INFO] Apache Hadoop Common .............................. SKIPPED
    [INFO] Apache Hadoop NFS ................................. SKIPPED
    [INFO] Apache Hadoop Common Project ...................... SKIPPED
    [INFO] Apache Hadoop HDFS ................................ SKIPPED
    [INFO] Apache Hadoop HttpFS .............................. SKIPPED
    [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
    [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
    [INFO] Apache Hadoop HDFS Project ........................ SKIPPED
    [INFO] hadoop-yarn ....................................... SKIPPED
    [INFO] hadoop-yarn-api ................................... SKIPPED
    [INFO] hadoop-yarn-common ................................ SKIPPED
    [INFO] hadoop-yarn-server ................................ SKIPPED
    [INFO] hadoop-yarn-server-common ......................... SKIPPED
    [INFO] hadoop-yarn-server-nodemanager .................... SKIPPED
    [INFO] hadoop-yarn-server-web-proxy ...................... SKIPPED
    [INFO] hadoop-yarn-server-resourcemanager ................ SKIPPED
    [INFO] hadoop-yarn-server-tests .......................... SKIPPED
    [INFO] hadoop-yarn-client ................................ SKIPPED
    [INFO] hadoop-yarn-applications .......................... SKIPPED
    [INFO] hadoop-yarn-applications-distributedshell ......... SKIPPED
    [INFO] hadoop-mapreduce-client ........................... SKIPPED
    [INFO] hadoop-mapreduce-client-core ...................... SKIPPED
    [INFO] hadoop-yarn-applications-unmanaged-am-launcher .... SKIPPED
    [INFO] hadoop-yarn-site .................................. SKIPPED
    [INFO] hadoop-yarn-project ............................... SKIPPED
    [INFO] hadoop-mapreduce-client-common .................... SKIPPED
    [INFO] hadoop-mapreduce-client-shuffle ................... SKIPPED
    [INFO] hadoop-mapreduce-client-app ....................... SKIPPED
    [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED
    [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED
    [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED
    [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED
    [INFO] hadoop-mapreduce .................................. SKIPPED
    [INFO] Apache Hadoop MapReduce Streaming ................. SKIPPED
    [INFO] Apache Hadoop Distributed Copy .................... SKIPPED
    [INFO] Apache Hadoop Archives ............................ SKIPPED
    [INFO] Apache Hadoop Rumen ............................... SKIPPED
    [INFO] Apache Hadoop Gridmix ............................. SKIPPED
    [INFO] Apache Hadoop Data Join ........................... SKIPPED
    [INFO] Apache Hadoop Extras .............................. SKIPPED
    [INFO] Apache Hadoop Pipes ............................... SKIPPED
    [INFO] Apache Hadoop Tools Dist .......................... SKIPPED
    [INFO] Apache Hadoop Tools ............................... SKIPPED
    [INFO] Apache Hadoop Distribution ........................ SKIPPED
    [INFO] Apache Hadoop Client .............................. SKIPPED
    [INFO] Apache Hadoop Mini-Cluster ........................ SKIPPED
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 32.981s
    [INFO] Finished at: Thu Feb 13 14:06:51 IST 2014
    [INFO] Final Memory: 32M/190M
    [INFO] ------------------------------------------------------------------------

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (pre-dist) on project hadoop-project-dist: An Ant BuildException has occured : exec returned: 2 -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (pre-dist) on project hadoop-project-dist: An Ant BuildException has occured: exec returned: 2

        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
        at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317)
        at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152)
        at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555)
        at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
        at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
        at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
        at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: An Ant BuildException
 has occured: exec returned: 2
        at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:283)
        at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
        ... 19 more
Caused by: C:\Hadoop\hdfs\hadoop-project-dist\target\antrun\build-main.xml:31: exec returned: 2
        at org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:650)
        at org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:676)
        at org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:502)
        at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:390)
        at org.apache.tools.ant.Target.performTasks(Target.java:411)
        at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
        at org.apache.tools.ant.Project.executeTarget(Project.java:1366)
        at org.apache.maven.plugin.antrun.AntRunMojo.execute(AntRunMojo.java:270)
        ... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command

[ERROR]   mvn <goals> -rf :hadoop-project-dist
提前谢谢
Gopal

mvn package-Pdist,native win-DskipTests-Dtar根据此命令,您正在尝试编译和打包native librariesnative win关键字,要执行此操作,中给出的任何包都是不够的

要解决此问题,您有两种选择:

1不需要本机库,hadoop将使用内置java类而不是本机库。使用以下命令:mvn package-Pdist-DskipTests-Dtar代替您的命令

2如果您想使用本机库,请遵循。这里给出了构建本机库所需的所有包和其他重要信息

我的建议是使用第一个选项,因为我在某个地方读到,在windows上构建本机库有很多问题,在windows上不是首选

阅读Hadoop src文件夹中的Building.txt,它可能会帮助您使用各种打包命令


以上可能是您的问题的解决方案。请尝试使用mvn package-Pdist,native win-DskipTests-Dtar。根据此命令,您正在尝试编译和打包native librariesnative win关键字,并且执行此操作。中给出的任何包都是不够的

要解决此问题,您有两种选择:

1不需要本机库,hadoop将使用内置java类而不是本机库。使用以下命令:mvn package-Pdist-DskipTests-Dtar代替您的命令

2如果您想使用本机库,请遵循。这里给出了构建本机库所需的所有包和其他重要信息

我的建议是使用第一个选项,因为我在某个地方读到,在windows上构建本机库有很多问题,在windows上不是首选

阅读Hadoop src文件夹中的Building.txt,它可能会帮助您使用各种打包命令


以上可能是您问题的解决方案。试试看,您解决问题了吗?我在安装Hadoop时遇到了类似的问题。我发现构建源文件阶段的所有问题都与路径变量设置有关

一,。确保安装了JDK,而不仅仅是JRE可用

二,。如果您遵循此链接上的说明,则需要一个附加路径设置: 将.NET MsBuild.exe主目录添加到路径,它应该类似于此C:\Windows\Microsoft.NET\Framework64\v4.030319


三,。检查所有路径值是否已更正。在我的安装过程中,我遇到了一个与Cygwin路径相关的问题,Cygwin安装在名为cygwin64的文件夹中,但在开始时,我只是将Cygwin添加为路径值,这花了我一些时间来解决

你解决问题了吗?我在安装Hadoop时遇到了类似的问题。我发现构建源文件阶段的所有问题都与路径变量设置有关

一,。确保安装了JDK,而不仅仅是JRE可用

二,。如果您遵循此链接上的说明,则需要一个附加路径设置: 将.NET MsBuild.exe主目录添加到路径,它应该类似于此C:\Windows\Microsoft.NET\Framework64\v4.030319


三,。检查所有路径值是否已更正。在我的安装过程中,我遇到了一个与Cygwin路径相关的问题,Cygwin安装在名为cygwin64的文件夹中,但在开始时,我只是将Cygwin添加为路径值,这花了我一些时间来解决

我也犯了同样的错误。当我用-X运行mvn package-Pdist、native win-DskipTests-Dtar时,maven告诉我执行dist-copynativelibs.sh脚本有一些问题

问题是Windows命令提示符不能运行sh命令,只能运行bash命令。不知道为什么-Cygwin已正确安装并添加到路径。因此,我将pom文件D:\hdfs\hadoop project dist\pom.xml中的executable=sh更改为executable=bash:

<exec executable="bash" dir="${project.build.directory}" failonerror="true">
<arg line="./dist-copynativelibs.sh"/>
</exec>

构建成功了。

我也犯了同样的错误。当我用-X运行mvn package-Pdist、native win-DskipTests-Dtar时,maven告诉我执行dist-copynativelibs.sh脚本有一些问题

问题是Windows命令提示符不能运行sh命令,只能运行bash命令。不知道为什么-Cygwin已正确安装并添加到pat H因此,我将pom文件D:\hdfs\hadoop project dist\pom.xml中的executable=sh更改为executable=bash:

<exec executable="bash" dir="${project.build.directory}" failonerror="true">
<arg line="./dist-copynativelibs.sh"/>
</exec>

构建成功。

我使用以下命令,它成功了

mvn clean package -DskipTests -Dtar

我使用下面的命令,它成功了

mvn clean package -DskipTests -Dtar

谢谢Rushikesh。。。我遵循了你建议的第一个选项,但不幸的是,我得到了同样的问题我不确定…但我认为,有一个先决条件没有实现,因为你可能在你的存储库中看到了这个插件,但它仍然说它不存在。同样的案例发生在meSame上,我的案例中也出现了错误……但这是由于缺少protobuff造成的。我的机器上的protobuff位于C驱动器中。低于错误属性BUILD_DIR尚未设置属性snappy.lib尚未设置[exec]当前操作系统是Windows 7[exec]正在执行带参数[exec]的“sh”。/dist copynativelibs.sh'[exec]可执行文件和参数周围的字符[exec]不是命令的一部分。Execute:Java13CommandLauncher:使用参数执行'sh'。/dist copynativelibs.sh'这甚至在定义了BUILD_DIR和其他东西并可用之后。。。。。你能分享你得到的确切错误吗?抱歉,错误已解决。。我没有保留它的副本,但是snappy.lib、copynativelibs.sh所有这些都与本机库有关……或者从一开始就尝试所有程序。。。我遵循了你建议的第一个选项,但不幸的是,我得到了同样的问题我不确定…但我认为,有一个先决条件没有实现,因为你可能在你的存储库中看到了这个插件,但它仍然说它不存在。同样的案例发生在meSame上,我的案例中也出现了错误……但这是由于缺少protobuff造成的。我的机器上的protobuff位于C驱动器中。低于错误属性BUILD_DIR尚未设置属性snappy.lib尚未设置[exec]当前操作系统是Windows 7[exec]正在执行带参数[exec]的“sh”。/dist copynativelibs.sh'[exec]可执行文件和参数周围的字符[exec]不是命令的一部分。Execute:Java13CommandLauncher:使用参数执行'sh'。/dist copynativelibs.sh'这甚至在定义了BUILD_DIR和其他东西并可用之后。。。。。你能分享你得到的确切错误吗?抱歉,错误已解决。。我没有保存它的副本,但是snappy.lib、copynativelibs.sh所有这些都与本机库有关……或者从一开始就重试所有过程,这是因为您在执行生成时执行了yum install-y cmake,因为您忘记了在执行生成时执行了yum install-y cmake