Sqoop导入错误：java.io.IOException:nextKeyValue中的SQLException
我已经编写了一个脚本来执行从oracle表到HDFS目录的增量数据导入。我使用以下sqoop命令进行导入：Sqoop导入错误：java.io.IOException:nextKeyValue中的SQLException,java,oracle,hadoop,sqoop,Java,Oracle,Hadoop,Sqoop,我已经编写了一个脚本来执行从oracle表到HDFS目录的增量数据导入。我使用以下sqoop命令进行导入： sqoop -- import \ --connect $JDBCconnectionString \ --username $dbUserName \ --password-file $passwordLocal \ --query 'select * from dmt_sim.dim_product WHERE $CONDITIONS' \ --
sqoop -- import \
--connect $JDBCconnectionString \
--username $dbUserName \
--password-file $passwordLocal \
--query 'select * from dmt_sim.dim_product WHERE $CONDITIONS' \
--split-by "PRODUCT_TITLE" \
--incremental append \
--check-column "KEY" \
--last-value "1" \
--append \
--fields-terminated-by '\t' \
--target-dir /user/ksrinivasan/dmn_product
16/01/25 06:19:29 INFO mapreduce.Job: Job job_1452256584707_106782 running in uber mode : false
06:19:36 16/01/25 06:19:29 INFO mapreduce.Job: map 0% reduce 0%
06:20:07 16/01/25 06:20:00 INFO mapreduce.Job: Task Id : attempt_1452256584707_106782_m_000000_0, Status : FAILED
06:20:07 Error: java.io.IOException: SQLException in nextKeyValue
06:20:07 at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
06:20:07 at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:553)
06:20:07 at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
06:20:07 at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
06:20:07 at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
06:20:07 at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
06:20:07 at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
06:20:07 at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
06:20:07 at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
06:20:07 at java.security.AccessController.doPrivileged(Native Method)
06:20:07 at javax.security.auth.Subject.doAs(Subject.java:415)
06:20:07 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
06:20:07 at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
06:20:07 Caused by: java.sql.SQLSyntaxErrorException: ORA-00907: missing right parenthesis
06:20:07
06:20:07 at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:445)
06:20:07 at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
06:20:07 at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:879)
06:20:07 at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:450)
06:20:07 at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
06:20:07 at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
06:20:07 at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
06:20:07 at oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:884)
06:20:07 at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1167)
06:20:07 at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1289)
06:20:07 at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3584)
06:20:07 at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3628)
06:20:07 at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1493)
06:20:07 at org.apache.sqoop.mapreduce.db.DBRecordReader.executeQuery(DBRecordReader.java:111)
06:20:07 at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:235)
06:20:07 ... 12 more
06:20:07
因此，如果其他人也遇到过同样的问题，并且他们对如何调试此类问题有一些见解，那就太好了？？？nextKeyValue中的SQLException
这意味着在您执行时，源键列中没有最后一个值“1”。检查所有可能列的值是否为空，特别检查日期为“0000-00-00”且您在dmt sim.dim产品的select子句中使用的日期列。 标识列并应用select to replace null中的if条件 或者和别的东西约会（你能认出的）
这是因为用于拆分的列不是数字（“产品名称”）
当Sqoop translate以给定的间隔“PRODUCT_TITLE”>=xx file_log.log（查看拆分语句是否正确）当Sqoop尝试导入的表包含保留关键字作为列名时，有时会发生这种情况。因此，请检查您的Oracle表“dmt\u sim.dim\u product”。