Java Flink成功集成了配置单元编译,但未能执行
开发环境如下Java Flink成功集成了配置单元编译,但未能执行,java,maven,hadoop,hive,apache-flink,Java,Maven,Hadoop,Hive,Apache Flink,开发环境如下 Flink版本1.11 Hadoop 2.7.1 蜂巢1.2.1 JDK8 Maven 3.5.3 我通过$curlhttps://flink.apache.org/q/quickstart-SNAPSHOT.sh |bash-s1.11-SNAPSHOT 创建flink项目 我添加了一个到hive的链接,包括hive所需的hadoop依赖项。下面是我的maven配置文件的内容 4.0.0 com.credit.analyze 快速分析 0.1 罐子 快速分析作业 UTF-
$curlhttps://flink.apache.org/q/quickstart-SNAPSHOT.sh |bash-s1.11-SNAPSHOT
创建flink项目
4.0.0
com.credit.analyze
快速分析
0.1
罐子
快速分析作业
UTF-8
1.11.0
1.8
2.11
${java.version}
${java.version}
2.12.1
1.2.1
2.7.1
5.1.16
4.12
apache.snapshots
Apache开发快照存储库
https://repository.apache.org/content/repositories/snapshots/
假的
真的
org.apache.flink
弗林克爪哇
${flink.version}
org.apache.flink
flink-streaming-java_${scala.binary.version}
${flink.version}
org.apache.flink
flink-clients_${scala.binary.version}
${flink.version}
org.apache.flink
flink-table-api-java-bridge{scala.binary.version}
${flink.version}
org.apache.flink
flink-table-planner_${scala.binary.version}
${flink.version}
org.apache.flink
flink-table-planner-blink{scala.binary.version}
${flink.version}
org.apache.flink
flink-streaming-scala_${scala.binary.version}
${flink.version}
org.apache.flink
flink-connector-hive_${scala.binary.version}
${flink.version}
org.apache.flink
flink-table-api-java-bridge{scala.binary.version}
${flink.version}
org.apache.hive
蜂巢执行器
${hive.version}
org.apache.hadoop
hadoop客户端
${hadoop.version}
org.apache.flink
flink-connector-jdbc_${scala.binary.version}
${flink.version}
mysql
mysql连接器java
${mysql.version}
朱尼特
朱尼特
${junit.version}
org.apache.logging.log4j
log4j-slf4j-impl
${log4j.version}
运行时
org.apache.logging.log4j
log4japi
${log4j.version}
运行时
org.apache.logging.log4j
log4j型芯
${log4j.version}
运行时
org.apache.maven.plugins
maven编译器插件
3.1
${java.version}
${java.version}
org.apache.maven.plugins
maven阴影插件
3.1.1
包裹
阴凉处
flink:force shading
com.google.code.findbugs:jsr305
org.slf4j:*
org.apache.logging.log4j:*
*:*
META-INF/*.SF
META-INF/*.DSA
META-INF/*.RSA
com.credit.analyze.StreamingJob
org.eclipse.m2e
生命周期映射
1.0.0
org.apache.maven.plugins
maven阴影插件
[3.1.1,)
阴凉处
org.apache.maven.plugins
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
Caused by: java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)