Apache pig I';我正在尝试使用python调用一个pig脚本。但其返回退出状态为1
日志如下所示Apache pig I';我正在尝试使用python调用一个pig脚本。但其返回退出状态为1,apache-pig,Apache Pig,日志如下所示 #PIG script execution hadoop_channel_obj = hadoop_transport_obj.open_session() command = 'cd ' + pig_path LOG.do_log('INFO', 'command is ' + command) #hadoop_channel_obj.exec_command(command) command = '/usr/local/pig/bin/pig ' + 'DL_Base.pig'
#PIG script execution
hadoop_channel_obj = hadoop_transport_obj.open_session()
command = 'cd ' + pig_path
LOG.do_log('INFO', 'command is ' + command)
#hadoop_channel_obj.exec_command(command)
command = '/usr/local/pig/bin/pig ' + 'DL_Base.pig'
#sys.path.append('.')
#time.sleep(1)
LOG.do_log('DEBUG', 'Executing ' + pig_filename)
LOG.do_log('INFO', 'command is ' + command)
#hadoop_channel_obj = hadoop_transport_obj.open_session()
hadoop_channel_obj.exec_command(command)
exit_status = hadoop_channel_obj.recv_exit_status()
LOG.do_log('INFO', exit_status)
我正在尝试使用python调用一个“PIG”脚本。但是它返回的退出状态1我不确定这个错误是否与Python有关;我会查阿帕奇猪的日志当然。。我也尝试过同样的方法,但没有清管器日志…:(在调用pig之前,我还添加了一些命令来检查脚本是否正常工作……这很好,但调用pig导致了问题……我将删除python标记,因为问题似乎出在pig而不是python上。我尝试了很多方法,只有在python脚本调用pig时才会出现这个问题。我知道我在一个shell脚本中包含了我的pig命令,并在python中调用了shell脚本。我的shell脚本工作正常,但在python调用时,pig失败,退出状态为1。。。。。
2014-05-13 01:58:37,161 DEBUG : Archiving DL_DLY_PRE_CUST_MASTER_20140512.csv.gz
2014-05-13 01:58:38,008 INFO : command is cd /home/hadoop/scripts/Base
2014-05-13 01:58:38,008 DEBUG : Executing DL_Base.pig
2014-05-13 01:58:38,008 INFO : command is /usr/local/pig/bin/pig DL_Base.pig
2014-05-13 01:58:38,022 INFO : 1
2014-05-13 01:58:38,022 WARNING : Pig execution failed
2014-05-13 01:58:38,122 INFO : transport_obj closed