Warning: file_get_contents(/data/phpspider/zhask/data//catemap/1/amazon-web-services/12.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Java Spark临时表未以直线显示_Java_Amazon Web Services_Jdbc_Apache Spark_Amazon Emr - Fatal编程技术网

Java Spark临时表未以直线显示

Java Spark临时表未以直线显示,java,amazon-web-services,jdbc,apache-spark,amazon-emr,Java,Amazon Web Services,Jdbc,Apache Spark,Amazon Emr,我在AWS EMR有一个spark cluster,并尝试使用thrift server启动以下代码: ... JavaSparkContext jsc = new JavaSparkContext(SparkContext.getOrCreate()); HiveContext hiveContext = new HiveContext(jsc); JavaRDD<Person> people = jsc.textFile("people.txt").map( new Func

我在AWS EMR有一个spark cluster,并尝试使用thrift server启动以下代码:

...
JavaSparkContext jsc = new JavaSparkContext(SparkContext.getOrCreate());
HiveContext hiveContext = new HiveContext(jsc);
JavaRDD<Person> people = jsc.textFile("people.txt").map(
  new Function<String, Person>() {
    public Person call(String line) throws Exception {
      ...
    }
});
DataFrame schemaPeople = hiveContext.createDataFrame(people, Person.class);
schemaPeople.registerTempTable("people_temp");
schemaPeople.saveAsTable("people");

HiveThriftServer2.startWithContext(hiveContext);
...

我希望看到一个临时表
people\u temp
。为什么
people\u temp
不存在?

在最新的Spark 1.6.*我发现需要显式地将配置标志设置为single session以使其与临时表一起工作:Spark.sql.hive.thriftServer.singleSession=true 请参阅迁移指南 希望这有帮助

+--------------+--------------+--+
|  tableName   | isTemporary  |
+--------------+--------------+--+
| people       | false        |
+--------------+--------------+--+