Apache kafka kafka使用flink:java.lang.NoClassDefFoundError:无法初始化类org.apache.http.conn.ssl.SSLConnectionSocketFactory打开TSDB
这是我的代码:Apache kafka kafka使用flink:java.lang.NoClassDefFoundError:无法初始化类org.apache.http.conn.ssl.SSLConnectionSocketFactory打开TSDB,apache-kafka,apache-flink,opentsdb,Apache Kafka,Apache Flink,Opentsdb,这是我的代码: def saveToOpenTSDB(rows: Iterator[String], url: String) { val requestConfig: RequestConfig = RequestConfig.custom().setSocketTimeout(2000).setConnectTimeout(2000).setConnectionRequestTimeout(2000).build() val httpClient: C
def saveToOpenTSDB(rows: Iterator[String], url: String) {
val requestConfig: RequestConfig = RequestConfig.custom().setSocketTimeout(2000).setConnectTimeout(2000).setConnectionRequestTimeout(2000).build()
val httpClient: CloseableHttpClient = HttpClients.createDefault() }
错误堆栈跟踪:
2018-10-25 12:40:39323信息org.apache.flink.client.cli.CliFrontend
---------------------------------------------------------------2018-10-25 12:40:39324 INFO org.apache.flink.client.cli.CliFrontend
-启动命令行客户端(版本:1.6.1,版本:23e2636,日期:2018年9月14日19:56:46 UTC)2018-10-25 12:40:39324信息
org.apache.flink.client.cli.CliFrontend-OS
当前用户:root 2018-10-25 12:40:39676信息
org.apache.flink.client.cli.CliFrontend-
当前Hadoop/Kerberos用户:root 2018-10-25 12:40:39676信息
org.apache.flink.client.cli.CliFrontend-JVM:
Java HotSpot(TM)64位服务器虚拟机-Oracle公司-
1.8/25.172-b11 2018-10-25 12:40:39676 INFO org.apache.flink.client.cli.CliFrontend-
最大堆大小:7136兆字节2018-10-25 12:40:39676信息
org.apache.flink.client.cli.CliFrontend-
JAVA_HOME:/usr/JAVA/jdk1.8.0_172 2018-10-25 12:40:39678信息
org.apache.flink.client.cli.CliFrontend-
Hadoop版本:2.6.5 2018-10-25 12:40:39678信息
org.apache.flink.client.cli.CliFrontend-JVM
选项:2018-10-2512:40:39678信息
org.apache.flink.client.cli.CliFrontend--Dlog.file=/root/flink-1.6.1/log/flink-root-client-cuiyk-cdn-test-10.log 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend --Dlog4j.configuration=file:/root/flink-1.6.1/conf/log4j-cli.properties 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend --Dlogback.configurationFile=file:/root/flink-1.6.1/conf/logback.xml 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend -程序参数:2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend-
运行2018-10-25 12:40:39678信息 org.apache.flink.client.cli.CliFrontend--c 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend -dataclean.FlinkDataCleanDemo 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend-
--parallelism 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend-4 2018-10-25 12:40:39678 INFO org.apache.flink.client.cli.CliFrontend ---jobmanager 2018-10-25 12:40:39679 INFO org.apache.flink.client.cli.CliFrontend-
cuiyk-cdn-test-4:42115 2018-10-25 12:40:39679信息 org.apache.flink.client.cli.CliFrontend-
/flinkkafka2tsdb.jar 2018-10-25 12:40:39679信息 org.apache.flink.client.cli.CliFrontend- 类路径: /1.1.1.1.1/lib/lib/flrik/flrik/flrik/flrik/Flik-1.6.1/1/1/lib/lib/flrik-1.6.1/lib/flrik-1.1.1.1.1.1/lib/lib/lib/lib/flffff4-4-4-1.1.6.6.1.1/1/1/1/lib/lib/lib/flrik/flrik/Flik-1.1.1.1.1.1.1.1.1.1.1.1.1.1.1.1/1/flrik/Flik-1.1.1.1.1.1/Flik-1/Flik-着色——哈卢卢卢卢卢卢卢克-着色——哈卢克克克克克克克克着色——哈卢卢卢卢卢卢卢卢卢卢卢卢/hadoop: 2018-10-25 12:40:39679 INFO org.apache.flink.client.cli.CliFrontend ---------------------------------------------------------------2018-10-25 12:40:39682信息 org.apache.flink.configuration.GlobalConfiguration- 正在加载配置属性:classloader.resolve-order, 第一家长2018-10-25 12:40:39682信息 org.apache.flink.configuration.GlobalConfiguration- 正在加载配置属性:jobmanager.rpc.address,localhost 2018-10-25 12:40:39682信息 org.apache.flink.configuration.GlobalConfiguration- 正在加载配置属性:jobmanager.rpc.port,6123 2018-10-25 12:40:39682 INFO org.apache.flink.configuration.GlobalConfiguration -正在加载配置属性:jobmanager.heap.size,1024m 2018-10-25 12:40:39682信息 org.apache.flink.configuration.GlobalConfiguration- 正在加载配置属性:taskmanager.heap.size,1024m 2018-10-25 12:40:39683信息 org.apache.flink.configuration.GlobalConfiguration- 正在加载配置属性:taskmanager.numberOfTaskSlots,1 2018-10-25 12:40:39683信息 org.apache.flink.configuration.GlobalConfiguration- 加载配置属性:parallelism.default,1 2018-10-25 12:40:39683 INFO org.apache.flink.configuration.GlobalConfiguration -加载配置属性:rest.port,8081 2018-10-25 12:40:39696 INFO org.apache.flink.warn.cli.FlinkYarnSessionCli
-在/tmp/.warn properties根目录下找到纱线属性文件。2018-10-25 12:40:39914信息 org.apache.flink.runtime.security.modules.HadoopModule-Hadoop 用户设置为root用户(身份验证:简单)2018-10-25 12:40:39936信息 org.apache.flink.client.cli.CliFrontend- 正在运行“run”命令。2018-10-25 12:40:39940信息 org.apache.flink.client.cli.CliFrontend- 根据JAR文件2018-10-25 12:40:40314信息构建程序 org.apache.flink.runtime.rest.RestClient-rest 客户端终结点已启动。2018-10-25 12:40:40316信息 org.apache.flink.client.cli.CliFrontend- 开始执行计划2018-10-25 12:40:40316信息 org.apache.flink.client.program.rest.RestClusterClient- 以交互模式启动程序(分离:错误)2018-10-25 12:40:40346警告 org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer09- 忽略配置的密钥反序列化器(密钥反序列化器)2018-10-25
//related dependecies:
<dependency>
<groupId>commons-httpclient</groupId>
<artifactId>commons-httpclient</artifactId>
<version>3.0</version>
</dependency>
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpclient</artifactId>
<version>4.4</version>
</dependency>
<relocations>
<relocation>
<pattern>org.apache.http</pattern>
<shadedPattern>shade.org.apache.http</shadedPattern>
</relocation>
</relocations>