配置单元jdbc连接内存不足错误
我只是想运行一个示例hivejdbc客户端程序,但它给了我一个内存不足错误配置单元jdbc连接内存不足错误,jdbc,database-connection,hive,out-of-memory,heap-memory,Jdbc,Database Connection,Hive,Out Of Memory,Heap Memory,我只是想运行一个示例hivejdbc客户端程序,但它给了我一个内存不足错误 import java.sql.SQLException; import java.sql.Connection; import java.sql.ResultSet; import java.sql.Statement; import java.sql.DriverManager; public class HiveJdbcClient { private static String driverName = "
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
public class HiveJdbcClient {
private static String driverName = "org.apache.hadoop.hive.jdbc.HiveDriver";
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
// "jdbc:hive://host:port/dbname"
System.out.println("going to get connection");
Connection con = DriverManager.getConnection("jdbc:hive://titan-edgenode.int.thomsonreuters.com:22/default", "", "");
System.out.println("got connection!");
Statement stmt = con.createStatement();
ResultSet res;
// show tables
String sql = "show tables";
System.out.println("Running: " + sql);
res = stmt.executeQuery(sql);
if (res.next()) {
System.out.println(res.getString(1));
}
}
}
这是我得到的输出
going to get connection
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:353)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:215)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
at org.apache.hadoop.hive.service.ThriftHive$Client.recv_execute(ThriftHive.java:116)
at org.apache.hadoop.hive.service.ThriftHive$Client.execute(ThriftHive.java:103)
at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:192)
at org.apache.hadoop.hive.jdbc.HiveStatement.execute(HiveStatement.java:132)
at org.apache.hadoop.hive.jdbc.HiveConnection.configureConnection(HiveConnection.java:133)
at org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:122)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:106)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at HiveJdbcClient.main(HiveJdbcClient.java:24)
将获得连接
线程“main”java.lang.OutOfMemoryError中出现异常:java堆空间
位于org.apache.thrift.protocol.TBinaryProtocol.readStringBody(TBinaryProtocol.java:353)
位于org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:215)
位于org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
位于org.apache.hadoop.hive.service.ThriftHive$Client.recv_execute(ThriftHive.java:116)
位于org.apache.hadoop.hive.service.ThriftHive$Client.execute(ThriftHive.java:103)
位于org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:192)
位于org.apache.hadoop.hive.jdbc.HiveStatement.execute(HiveStatement.java:132)
位于org.apache.hadoop.hive.jdbc.HiveConnection.configureConnection(HiveConnection.java:133)
位于org.apache.hadoop.hive.jdbc.HiveConnection。(HiveConnection.java:122)
位于org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:106)
位于java.sql.DriverManager.getConnection(未知源)
位于java.sql.DriverManager.getConnection(未知源)
位于HiveJdbcClient.main(HiveJdbcClient.java:24)
这个错误的有趣之处在于,在获得连接后,堆空间用完了。这是不寻常的,因为获取连接本身不需要太多空间,因为我没有执行查询或类似的操作
编辑
下面是来自另一个用户的该堆栈的另一个变体(更改最大堆大小并没有产生明显的差异):
java.lang.OutOfMemoryError:java堆空间
位于org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
位于org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288)
位于org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
位于org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:190)
位于org.apache.hive.jdbc.HiveConnection(HiveConnection.java:163)
位于org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
位于java.sql.DriverManager.getConnection(未知源)
位于java.sql.DriverManager.getConnection(未知源)
在[myapp]
您可以增加堆空间。使用命令行参数Xms-Xmx。如果这不能解决问题,那么驱动程序可能有问题。我可以通过移动到x64应用程序来克服这个错误。无论我如何配置java的最大堆大小,Win32似乎从来没有足够的内存
java.lang.OutOfMemoryError: Java heap space
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:190)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:163)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at [myapp]