Hive Cloudera ToolRunner
我正在使用色调访问配置单元服务。我使用Hive Cloudera ToolRunner,hive,cloudera,hue,toolrunner,Hive,Cloudera,Hue,Toolrunner,我正在使用色调访问配置单元服务。我使用 create table tablename(colname type,.....) row format delimited fields terminated by ','; 我上传了30万条记录的数据。但在执行以下查询时: select count(*) from tablename; 它正在创建MapReduce作业,此时我收到以下警告,如何解决此警告 警告:未执行Hadoop命令行选项解析。使生效 工具接口并使用ToolRunner执行应用
create table tablename(colname type,.....)
row format delimited fields terminated by ',';
我上传了30万条记录的数据。但在执行以下查询时:
select count(*) from tablename;
它正在创建MapReduce作业,此时我收到以下警告,如何解决此警告
警告:未执行Hadoop命令行选项解析。使生效
工具接口并使用ToolRunner执行应用程序,以
补救这一点
完整日志:
INFO : Number of reduce tasks determined at compile time: 1
INFO : In order to change the average load for a reducer (in bytes):
INFO : set hive.exec.reducers.bytes.per.reducer=<number>
INFO : In order to limit the maximum number of reducers:
INFO : set hive.exec.reducers.max=<number>
INFO : In order to set a constant number of reducers:
INFO : set mapreduce.job.reduces=<number>
WARN : Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
INFO : number of splits:1
INFO : Submitting tokens for job: job_1442315442114_0017
INFO : The url to track the job: http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO : Starting Job = job_1442315442114_0017, Tracking URL = http://dwiclmaster:8088/proxy/application_1442315442114_0017/
INFO : Kill Command = /opt/cloudera/parcels/CDH-5.4.4-1.cdh5.4.4.p0.4/lib/hadoop/bin/hadoop job -kill job_1442315442114_0017
INFO : Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
INFO : 2015-09-15 18:29:06,910 Stage-1 map = 0%, reduce = 0%
INFO : 2015-09-15 18:29:15,257 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 1.65 sec
INFO : 2015-09-15 18:29:21,513 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 3.19 sec
INFO : MapReduce Total cumulative CPU time: 3 seconds 190 msec
INFO : Ended Job = job_1442315442114_0017
这只是MapReduce发出的警告,因为Hive提交的作业没有实现该接口。这可以放心地忽略 更多关于