Hive 配置单元内部错误:java.lang.RuntimeException(java.net.UnknownHostException
我有下面的HiveRows。第一个工作并创建表。第二个在加载时失败Hive 配置单元内部错误:java.lang.RuntimeException(java.net.UnknownHostException,hive,Hive,我有下面的HiveRows。第一个工作并创建表。第二个在加载时失败 --HiveRow1 "create table hotel_price_data (hotel string, room string, bus_date string, price string) row format delimited fields terminated by '|' location '/tmp'" --HiveRow2 "LOAD DATA LOCAL INPATH 'C:/tmp/out.txt'
--HiveRow1
"create table hotel_price_data (hotel string, room string, bus_date string, price string)
row format delimited fields terminated by '|' location '/tmp'"
--HiveRow2
"LOAD DATA LOCAL INPATH 'C:/tmp/out.txt' OVERWRITE INTO TABLE hotel_price_data"
HiveRow1工作正常,可以看到在沙盒UI中创建的表
HiveRow2,加载部件目前是一个问题
##########错误
我不确定这在Windows上是如何工作的,但我认为您的文件路径
C:/tmp/out.txt
不正确
- 相对路径,例如:项目/数据1
- 绝对路径,例如:/user/hive/project/data1
- 带有方案和(可选)权限的完整URI,例如:hdfs://namenode:9000/user/hive/project/data1"
文件需要在HDFS存储中才能使用
LOAD DATA LOCAL INPATH
加载。我猜C:/tmp/out.txt
指的是本地存储中的文件,而不是HDFS中的文件。您可以使用HDFS-put
Hi Lukas:using Talend Studio for Big DATA,这样就可以从本地磁盘中拾取文件。从本地磁盘。我不熟悉Talend。是什么让你认为你可以从本地磁盘中选择文件?
13/07/24 19:45:55 INFO parse.ParseDriver: Parsing command: LOAD DATA LOCAL INPATH 'C:/tmp/out.txt' OVERWRITE INTO TABLE hotel_price_data
13/07/24 19:45:55 INFO parse.ParseDriver: Parse Completed
13/07/24 19:45:55 INFO hive.log: DDL: struct hotel_price_data { string hotel, string room, string bus_date, string price}
FAILED: Hive Internal Error: java.lang.RuntimeException(java.net.UnknownHostException: **unknown host: sandbox**)
java.lang.RuntimeException: java.net.UnknownHostException: unknown host: sandbox
at org.apache.hadoop.hive.ql.Context.getScratchDir(Context.java:170)
at org.apache.hadoop.hive.ql.Context.getExternalScratchDir(Context.java:222)
at org.apache.hadoop.hive.ql.Context.getExternalTmpFileURI(Context.java:315)
at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:225)
at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:431)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:336)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:909)
at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:191)
at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:187)
at org.apache.hadoop.hive.jdbc.HiveStatement.execute(HiveStatement.java:127)
at talenddemosjava.hive_connection_0_1.hive_connection.tHiveRow_4Process(hive_connection.java:1314)
at talenddemosjava.hive_connection_0_1.hive_connection.tHiveRow_1Process(hive_connection.java:1245)
at talenddemosjava.hive_connection_0_1.hive_connection.tHiveRow_2Process(hive_connection.java:1132)
at talenddemosjava.hive_connection_0_1.hive_connection.tFileInputDelimited_1Process(hive_connection.java:1019)
at talenddemosjava.hive_connection_0_1.hive_connection.tHiveConnection_1Process(hive_connection.java:461)
at talenddemosjava.hive_connection_0_1.hive_connection.runJobInTOS(hive_connection.java:1628)
at talenddemosjava.hive_connection_0_1.hive_connection.main(hive_connection.java:1494)
Caused by: java.net.UnknownHostException: **unknown host: sandbox**