Java 无法使用kafka storm向apache storm提交拓扑

将拓扑提交到Apache Storm（版本0.10.0.2.4.0.0-169）时出错，该版本使用Storm Kafka的卡夫卡喷口。我使用的是来自github的storm kafka的最新版本，运行的是kafka 0.9.0.2.4

我可以使用maven为storm core和storm kafka下载的jar文件来运行这个拓扑的一个相当普通的版本，但是我需要对spout类进行更改，所以我必须从源代码下载并自己构建它们，它在maven中的ubuntu开发环境中编译，但是我在将拓扑提交给storm时出错

“找到多个defaults.yaml资源。您可能正在使用拓扑jar构建Storm jar”

我假设这是因为我在maven依赖项中包含了storm core（我从源代码编译的本地版本（并添加到本地maven存储库中），因为storm kafka中需要它，而从mvn中提取的版本缺少storm kafka最新版本所需的类），如果将storm core设置为pom.xml中提供的值，则在提交时会出现以下错误-

“java.lang.class.NoClassDefFoundError:org/apache/storm/spoot/scheme”

我认为这是因为它试图使用包含的storm core版本，该版本缺少一些最新的文件

我似乎陷入了一个循环，为了编译最新版本的storm kafka，我需要最新版本的storm core，它需要从源代码处自行编译，但是我似乎无法在不引起冲突的情况下将其部署到服务器上

我需要更新storm服务器上的jar吗？我在这里担心的是，我最终需要更新它的依赖项等

下面是我的pom.xml文件

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.automatedintelligence.datastorm</groupId>
<artifactId>DataStorm</artifactId>
<version>0.0.1-SNAPSHOT</version>
<packaging>jar</packaging>
<name>DataStorm</name>
<url>https://github.com/markmcgookin/DataStorm</url>
<properties>
    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
</properties>
<repositories>
    <repository>
            <id>local-maven-repo</id>
            <url>file:///${project.basedir}/src/main/java/dependency/repo</url>
        </repository>
    <repository>
        <id>central</id>
        <url>http://central.maven.org/maven2/</url>
    </repository>
    <repository>
        <id>github-releases</id>
        <url>http://oss.sonatype.org/content/repositories/github-releases/</url>
    </repository>
    <repository>
        <id>mvnrepository</id>
        <url>http://mvnrepository.com/</url>
    </repository>
    <repository>
        <id>clojars.org</id>
        <url>http://clojars.org/repo</url>
    </repository>
    <repository>
        <id>twitter4j</id>
        <url>http://twitter4j.org/maven2</url>
    </repository>
</repositories>
<dependencies>
    <dependency>
        <groupId>com.googlecode.json-simple</groupId>
        <artifactId>json-simple</artifactId>
        <version>1.1</version>
    </dependency>
    <dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <version>3.8.1</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.apache.commons</groupId>
        <artifactId>commons-collections4</artifactId>
        <version>4.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.hbase</groupId>
        <artifactId>hbase-client</artifactId>
        <version>1.0.0</version>
        <exclusions>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-api</artifactId>
            </exclusion>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-log4j12</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>log4j</groupId>
                <artifactId>log4j</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>org.slf4j</groupId>
                <artifactId>log4j-over-slf4j</artifactId>
            </exclusion>
        </exclusions>
    </dependency>
    <dependency>                                                                                                                                       
        <groupId>org.apache.hadoop</groupId>                                                                                                           
        <artifactId>hadoop-common</artifactId>                                                                                                         
        <version>2.7.2</version>   
        <exclusions>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-api</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-log4j12</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>log4j</groupId>
                <artifactId>log4j</artifactId>
            </exclusion>
        </exclusions>                                                                                         
    </dependency> 
    <dependency>
        <groupId>storm</groupId>
        <artifactId>storm</artifactId>
        <version>0.9.0-rc2</version>
        <scope>provided</scope>
        <exclusions>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-api</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-log4j12</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>log4j</groupId>
                <artifactId>log4j</artifactId>
            </exclusion>
        </exclusions>
    </dependency>
    <dependency>
        <groupId>org.apache.kafka</groupId>
        <artifactId>kafka_2.11</artifactId>
        <version>0.9.0.0</version>
        <exclusions>
            <exclusion>
                <groupId>org.apache.zookeeper</groupId>
                <artifactId>zookeeper</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-log4j12</artifactId>
            </exclusion>
            <exclusion> 
                <groupId>log4j</groupId>
                <artifactId>log4j</artifactId>
            </exclusion>
            <exclusion>
                <groupId>org.slf4j</groupId>
                <artifactId>slf4j-api</artifactId>
            </exclusion>
        </exclusions>
    </dependency>
    <dependency>
        <groupId>org.apache.storm</groupId>
        <artifactId>storm-kafka</artifactId>
        <version>2.0.0</version>
    </dependency>
    <dependency>
        <groupId>org.apache.storm</groupId>
        <artifactId>storm-core</artifactId>
        <version>2.0.0</version>
        <scope>provided</scope>
    </dependency>
</dependencies>
<build>
    <plugins>
        <!-- bind the maven-assembly-plugin to the package phase
        this will create a jar file without the Storm
        dependencies suitable for deployment to a cluster.-->
        <plugin>
            <artifactId>maven-assembly-plugin</artifactId>
            <configuration>
                <descriptorRefs>
                    <descriptorRef>jar-with-dependencies</descriptorRef>
                </descriptorRefs>
                <archive>
                    <manifest>
                        <mainClass/>
                    </manifest>
                </archive>
            </configuration>
            <executions>
                <execution>
                    <id>make-assembly</id>
                    <phase>package</phase>
                    <goals>
                        <goal>single</goal>
                    </goals>
                </execution>
            </executions>
        </plugin>
        <plugin>
            <groupId>com.theoryinpractise</groupId>
            <artifactId>clojure-maven-plugin</artifactId>
            <version>1.3.8</version>
            <extensions>true</extensions>
            <configuration>
                <sourceDirectories>
                    <sourceDirectory>src/clj</sourceDirectory>
                </sourceDirectories>
            </configuration>
            <executions>
                <execution>
                    <id>compile</id>
                    <phase>compile</phase>
                    <goals>
                        <goal>compile</goal>
                    </goals>
                </execution>
                <execution>
                    <id>test</id>
                    <phase>test</phase>
                    <goals>
                        <goal>test</goal>
                    </goals>
                </execution>
            </executions>
        </plugin>
        <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-compiler-plugin</artifactId>
            <configuration>
                <source>1.6</source>
                <target>1.6</target>
                <excludes>
                    <exclude>sl4j:log4j:log4j:jar:</exclude>
                </excludes>
            </configuration>
        </plugin>
    </plugins>
</build>

4.0.0
com.automatedintelligence.datastorm
数据风暴
0.0.1-快照
罐子
数据风暴
https://github.com/markmcgookin/DataStorm
UTF-8
本地马文回购
文件：//${project.basedir}/src/main/java/dependency/repo
中心的
http://central.maven.org/maven2/
github发布
http://oss.sonatype.org/content/repositories/github-releases/
MVN还原
http://mvnrepository.com/
clojars.org
http://clojars.org/repo
twitter4j
http://twitter4j.org/maven2
com.googlecode.json-simple
简单json
1.1
朱尼特
朱尼特
3.8.1
测试
org.apache.commons
公共集合4
4
org.apache.hbase
hbase客户端
1.0.0
org.slf4j
slf4j api
org.slf4j
slf4j-log4j12
log4j
log4j
org.slf4j
log4j-over-slf4j
org.apache.hadoop
hadoop通用
2.7.2   
org.slf4j
slf4j api
org.slf4j
slf4j-log4j12
log4j
log4j
暴风雨
暴风雨
0.9.0-rc2
假如
org.slf4j
slf4j api
org.slf4j
slf4j-log4j12
log4j
log4j
org.apache.kafka
卡夫卡2.11
0.9.0.0
org.apache.zookeeper
动物园管理员
org.slf4j
slf4j-log4j12
log4j
log4j
org.slf4j
slf4j api
org.apache.storm
卡夫卡风暴
2.0.0
org.apache.storm
风暴核心
2.0.0
假如
maven汇编插件
带有依赖项的jar
组装
包裹
单一的
理论与实践
clojure maven插件
1.3.8
真的
src/clj
编译
编译
编译
测试
测试
测试
org.apache.maven.plugins
maven编译器插件
1.6
1.6
sl4j:log4j:log4j:jar:

---

我最终通过使用预编译解决了这个问题