Java 为什么我要使用Apache™；Hadoop®；拒绝连接

我正在创建第一个使用Hadoop HDFS的java应用程序。 我在笔记本电脑上使用eclipse访问远程HDFS群集

我想从一个简单的例子开始，列出特定HDFS文件夹中的所有文件

如何配置远程HDFS盒的主机名和端口名

Configuration conf = new Configuration();
conf.set("fs.default.name","hdfs://hostname:9000/“);
FileSystem fs = FileSystem.get(conf);

我被拒绝了

我做错了什么

更新0001

我尝试过执行这个java代码

    System.setProperty("HADOOP_USER_NAME", "xxxxx");

    Path p = new Path("hdfs://xx.xxx.xx.xxx:9000/xxxxx/xxxxx/xxxxx/XXXX/XX_XX_XXXXX/XX_XXXXXX.txt");
    FileSystem fs = FileSystem.get(new Configuration());
    System.out.println(p.getName() + " exists: " + fs.exists(p));

现在获取以下日志输出：-

 main DEBUG lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=, value=[Rate of successful kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)
 main DEBUG lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=, value=[Rate of failed kerberos logins and latency (milliseconds)], always=false, type=DEFAULT, sampleName=Ops)
 main DEBUG lib.MutableMetricsFactory - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(valueName=Time, about=, value=[GetGroups], always=false, type=DEFAULT, sampleName=Ops)
 main DEBUG impl.MetricsSystemImpl - UgiMetrics, User and group related metrics
 main DEBUG security.Groups -  Creating new Groups object
 main DEBUG util.NativeCodeLoader - Trying to load the custom-built native-hadoop library...
 main DEBUG util.NativeCodeLoader - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
 main WARN  util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
 main DEBUG util.PerformanceAdvisory - Falling back to shell based
 main DEBUG security.JniBasedUnixGroupsMappingWithFallback - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
 main ERROR util.Shell - Failed to locate the winutils binary in the hadoop binary path
 java.io.IOException: Could not locate executable C:\BigData\hadoop-2.6.0\bin\winutils.exe in the Hadoop binaries.

那么如何获取

winutils.exe

是我在windows7上从源代码构建hadoop的唯一选择吗

没有其他选项可以在hadoop上远程处理mapReduce作业吗

更新0002

目前我的hadoop maven版本失败如下：-

main:
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [  2.527 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [  1.997 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  6.583 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... FAILURE [  0.998 s]
[INFO] Apache Hadoop Maven Plugins ........................ SKIPPED
[INFO] Apache Hadoop MiniKDC .............................. SKIPPED
[INFO] Apache Hadoop Auth ................................. SKIPPED
[INFO] Apache Hadoop Auth Examples ........................ SKIPPED
[INFO] Apache Hadoop Common ............................... SKIPPED
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 16.083 s
[INFO] Finished at: 2015-02-03T15:34:57+00:00
[INFO] Final Memory: 41M/122M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:
run (pre-dist) on project hadoop-project-dist: An Ant BuildException has occured
: exec returned: -1073741515
[ERROR] around Ant part ...<exec dir="C:\hdc\hadoop-project-dist\target" executa
ble="sh" failonerror="true">... @ 41:84 in C:\hdc\hadoop-project-dist\target\ant
run\build-main.xml

main：
[信息]------------------------------------------------------------------------
[信息]反应堆概要：
[信息]
[信息]Apache Hadoop主服务器。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。成功[2.527秒]
[信息]Apache Hadoop项目POM。。。。。。。。。。。。。。。。。。。。。。。。。。成功[1.997秒]
[信息]Apache Hadoop注释。。。。。。。。。。。。。。。。。。。。。。。。。。成功[6.583秒]
[信息]Apache Hadoop程序集。。。。。。。。。。。。。。。。。。。。。。。。。。。成功[0.312秒]
[信息]Apache Hadoop项目区POM。。。。。。。。。。。。。。。。。。。。。故障[0.998秒]
[信息]Apache Hadoop Maven插件。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop MiniKDC。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop验证。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop身份验证示例。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop通用版。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop NFS。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop KMS。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop通用项目。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop HDFS。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop HttpFS。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop HDFS簿记员日志。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop HDFS-NFS。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop HDFS项目。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线api。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop普通纱线。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线服务器。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线服务器通用版。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线服务器节点管理器。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线服务器web代理。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线服务器应用程序历史服务。。。。。。。跳过
[信息]hadoop纱线服务器资源管理器。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线服务器测试。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线客户端。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线应用。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线应用程序分布式Shell。。。。。。。。。。跳过
[信息]hadoop纱线应用程序非托管am启动器。。。。。跳过
[信息]hadoop纱线网站。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线注册处。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop纱线项目。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端核心。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端通用。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端洗牌。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端应用程序。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端hs。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端作业客户端。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce客户端hs插件。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop MapReduce示例。。。。。。。。。。。。。。。。。。。跳过
[信息]hadoop mapreduce。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop MapReduce流媒体。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop分布式副本。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop归档文件。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop Rumen。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop Gridmix。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop数据连接。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop Ant任务。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop附加功能。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop管道。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop OpenStack支持。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop Amazon Web服务支持。。。。。。。。。。跳过
[信息]Apache Hadoop客户端。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop小型集群。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop调度程序负载模拟器。。。。。。。。。。。。。跳过
[信息]Apache Hadoop工具区。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop工具。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]Apache Hadoop发行版。。。。。。。。。。。。。。。。。。。。。。。。。跳过
[信息]------------------------------------------------------------------------
[信息]生成失败
[信息]------------------------------------------------------------------------
[信息]总时间：16.083秒
[信息]完成时间：2015-02-03T15:34:57+00:00
[信息]最终内存：41M/122M
[信息]------------------------------------------------------------------------
[错误]无法执行目标org.apache.maven.plugins:maven antrun plugin:1.7:
在project hadoop project dist上运行（预dist）：发生Ant BuildException
：exec返回：-1073741515
[错误]蚂蚁部分周围……@41:84在C:\hdc\hadoop project dist\target\ant中
运行\build-main.xml

我缺少“sh.exe”，因为我的cygwin安装缺少

cygiconv-2.dll

一个

$ telnet <hostname> <port>