Apache spark Spark Thriftserver:未找到流jar异常

Apache spark Spark Thriftserver:未找到流jar异常,apache-spark,apache-spark-sql,Apache Spark,Apache Spark Sql,我正在尝试在thriftserver中运行Hive UDTF UDTF已注册,但未运行并失败,出现“未找到函数”异常 现在,奇怪的是,在尝试运行UDTF失败后,thriftserver上没有运行任何东西,甚至连基本的SELECT查询也没有。每个查询都会失败,出现以下异常: Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 36.0 failed 4 times, mo

我正在尝试在thriftserver中运行Hive UDTF

UDTF已注册,但未运行并失败,出现“未找到函数”异常

现在,奇怪的是,在尝试运行UDTF失败后,thriftserver上没有运行任何东西,甚至连基本的SELECT查询也没有。每个查询都会失败,出现以下异常:

Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 36.0 failed 4 times, most recent failure: Lost task 0.3 in stage 36.0 (TID 73, hdp8004d02.fuzzyl.com): java.lang.RuntimeException: Stream '/jars/experiments-1.0.jar' was not found.
这里,experiments-1.0.jar是我用来运行Hive UDTF的jar文件

只有当我重新启动thriftserver时,查询才会运行

我用spark 2.0.0在HDP2.5上运行它

错误的完整堆栈跟踪为:

17/02/23 13:51:17 ERROR SparkExecuteStatementOperation: Error running hive query:
org.apache.hive.service.cli.HiveSQLException: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 36.0 failed 4 times, most recent failure: Lost task 0.3 in stage 36.0 (TID 73, hdp8004d02.fuzzyl.com): java.lang.RuntimeException: Stream '/jars/experiments-1.0.jar' was not found.
        at org.apache.spark.network.client.TransportResponseHandler.handle(TransportResponseHandler.java:222)
        at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:121)
        at org.apache.spark.network.server.TransportChannelHandler.channelRead0(TransportChannelHandler.java:51)
        at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
        at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:266)
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
        at org.apache.spark.network.util.TransportFrameDecoder.channelRead(TransportFrameDecoder.java:85)
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:308)
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:294)
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:846)
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
        at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
        at java.lang.Thread.run(Thread.java:745)

请在资源管理器或日志中显示thrift服务容器的运行状态。thrift server作为一个应用程序启动,并处于运行状态。您如何启动应用程序?命令我运行的thriftserver作为服务安装在HDP2.5中。我通过使用beeline连接thiftserver来执行SQL查询
beeline-ujdbc:hive2://localhost:10016-d org.apache.hive.jdbc.HiveDriver