Warning: file_get_contents(/data/phpspider/zhask/data//catemap/6/apache/8.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/4/postgresql/10.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache 测试HiveServer2元存储是否正常工作_Apache_Postgresql_Hadoop_Hive_Apache Spark Sql - Fatal编程技术网

Apache 测试HiveServer2元存储是否正常工作

Apache 测试HiveServer2元存储是否正常工作,apache,postgresql,hadoop,hive,apache-spark-sql,Apache,Postgresql,Hadoop,Hive,Apache Spark Sql,我最近将集群的HiveServer升级为HiveServer2。我还设置了Hive元存储(在远程模式下),并从嵌入式模式(我们之前运行的模式)移开 我想测试东西是否正确配置,metatdata是否实际存储在远程metastore中。最简单的方法是什么?我可以检查他们的某些日志来验证这种行为吗 我担心没有正确配置,我仍然在本地模式下运行我的metastore,因为当我在托管metastore的机器上查询postgresql数据库时,metastore DB中没有行(尽管我已经通过beeline创建

我最近将集群的HiveServer升级为HiveServer2。我还设置了Hive元存储(在远程模式下),并从嵌入式模式(我们之前运行的模式)移开

我想测试东西是否正确配置,metatdata是否实际存储在远程metastore中。最简单的方法是什么?我可以检查他们的某些日志来验证这种行为吗

我担心没有正确配置,我仍然在本地模式下运行我的metastore,因为当我在托管metastore的机器上查询postgresql数据库时,metastore DB中没有行(尽管我已经通过beeline创建了测试表)

值得一提的是,它的最终目标是能够通过SparkSQL查询存储在HDFS中的数据。我是否需要HiveServer2来完成此任务?抱歉,我对这项技术还很陌生

这是我的hive-site.xml:

<configuration>
  <property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:postgresql://w7/metastore</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionDriverName</name>
    <value>org.postgresql.Driver</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionUserName</name>
    <value>hiveuser</value>
  </property>
  <property>
    <name>javax.jdo.option.ConnectionPassword</name>
    <value>password</value>
  </property>
  <property>
    <name>datanucleus.autoCreateSchema</name>
    <value>false</value>
  </property>
  <property>
    <name>hive.metastore.uris</name>
    <value>thrift://w7:9083</value>
    <description>IP address (or fully-qualified domain name) and port of the metastore host</description>
  </property>
  <property>
   <name>hive.metastore.schema.verification</name>
   <value>true</value>
  </property>
  <property>
    <name>hive.metastore.warehouse.dir</name>
    <value>/user/hive/warehouse</value>
  </property>
  <property>
    <name>hive.warehouse.subdir.inherit.perms</name>
    <value>true</value>
  </property>
  <property>
    <name>hive.zookeeper.quorum</name>
    <value>mn</value>
  </property>
  <property>
    <name>hive.zookeeper.client.port</name>
    <value>2181</value>
  </property>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>mn</value>
  </property>
  <property>
    <name>hbase.zookeeper.property.clientPort</name>
    <value>2181</value>
  </property>
  <property>
    <name>hive.zookeeper.namespace</name>
    <value>hive_zookeeper_namespace_hive</value>
  </property>
  <property>
    <name>hive.cluster.delegation.token.store.class</name>
    <value>org.apache.hadoop.hive.thrift.MemoryTokenStore</value>
  </property>
  <property>
    <name>hive.server2.enable.doAs</name>
    <value>true</value>
  </property>
  <property>
    <name>hive.server2.use.SSL</name>
    <value>false</value>
  </property>
  <property>
    <name>hive.support.concurrency</name>
    <description>Enable Hive's Table Lock Manager Service</description>
    <value>true</value>
  </property>
</configuration>

javax.jdo.option.ConnectionURL
jdbc:postgresql://w7/metastore
javax.jdo.option.ConnectionDriverName
org.postgresql.Driver
javax.jdo.option.ConnectionUserName
蜂巢用户
javax.jdo.option.ConnectionPassword
密码
datanucleus.autoCreateSchema
假的
hive.metastore.uris
thrift://w7:9083
metastore主机的IP地址(或完全限定的域名)和端口
hive.metastore.schema.verification
真的
hive.metastore.warehouse.dir
/用户/配置单元/仓库
hive.warehouse.subdir.inherit.perms
真的
蜂箱、动物园管理员、法定人数
锰
hive.zookeeper.client.port
2181
hbase.zookeeper.quorum
锰
hbase.zookeeper.property.clientPort
2181
hive.zookeeper.namespace
蜂巢\u动物园管理员\u命名空间\u蜂巢
hive.cluster.delegation.token.store.class
org.apache.hadoop.hive.thrift.MemoryTokenStore
hive.server2.enable.doAs
真的
hive.server2.use.SSL
假的
hive.support.concurrency
启用配置单元的表锁管理器服务
真的