Python 无法将数据帧写入配置单元表
我正在测试hive表和pandas之间的读写操作 我能够使用下面的代码成功地从hive读取熊猫数据帧Python 无法将数据帧写入配置单元表,python,pandas,hive,impala,pyhive,Python,Pandas,Hive,Impala,Pyhive,我正在测试hive表和pandas之间的读写操作 我能够使用下面的代码成功地从hive读取熊猫数据帧 from impala.dbapi import connect import pandas as pd conn = connect(host='myhostaddress',port=21050,kerberos_service_name='impala', auth_mechanism='GSSAPI',use_ssl=True,
from impala.dbapi import connect
import pandas as pd
conn = connect(host='myhostaddress',port=21050,kerberos_service_name='impala',
auth_mechanism='GSSAPI',use_ssl=True,
ca_cert='/opt/cloudera/...pem',
database='mydb'
)
cursor = conn.cursor()
df = pd.read_sql('select * from my_table',con=conn)
test_df = pd.DataFrame({'A':[1,2,3],'B':[4,5,6]})
test_df.to_sql('test_table',con=conn)
我能把表格从蜂巢读到熊猫
现在尝试使用下面的代码编写一个简单的pandas df到hive表
from impala.dbapi import connect
import pandas as pd
conn = connect(host='myhostaddress',port=21050,kerberos_service_name='impala',
auth_mechanism='GSSAPI',use_ssl=True,
ca_cert='/opt/cloudera/...pem',
database='mydb'
)
cursor = conn.cursor()
df = pd.read_sql('select * from my_table',con=conn)
test_df = pd.DataFrame({'A':[1,2,3],'B':[4,5,6]})
test_df.to_sql('test_table',con=conn)
但是,我有个错误
DatabaseErrorTraceback (most recent call last)
<ipython-input-24-967eed4bac18> in<module>()
----> 1 test_df.to_sql('test_table',con=conn)
....
....
DatabaseError: Execution failed on sql: SELECT name FROM sqlite_master WHERE type='table' AND name=?;
AnalysisException: Could not resolve table reference: 'sqlite_master'<br>
unable to rollback
DatabaseErrorTraceback(最近一次调用)
在()
---->1测试方向到sql(“测试表”,con=conn)
....
....
DatabaseError:在sql上执行失败:从sqlite_master中选择名称,其中type='table'和name=?;
AnalysisException:无法解析表引用:“sqlite\u master”
无法回滚
是否有此更新?是否有此更新?