设置apache spark时出现Maven pom.xml错误

我正在尝试设置apache流媒体。在下面的pom.xml中。当我加上

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.10</artifactId>
        <version>2.1.0</version>
    </dependency>

org.apache.spark
spark-core_2.10
2.1.0

pom文件出错，说明：在此行找到多个批注： -未能传输org.glassfish.hk2:hk2 utils:jar:2.4.0-b34

http://maven.apache.org/xsd/maven-4.0.0.xsd"> 4.0.0 com.iot.app.kafka iot卡夫卡制作人 1.0.0 IoT卡夫卡制作人

<dependencies>
    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.10</artifactId>
        <version>2.1.0</version>
    </dependency>


    <dependency>
        <groupId>org.apache.kafka</groupId>
        <artifactId>kafka-clients</artifactId>
        <version>0.9.0.0</version>
    </dependency>

    <!-- https://mvnrepository.com/artifact/org.apache.spark/spark-streaming-kafka_2.10 -->
    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-streaming-kafka_2.10</artifactId>
        <version>1.6.3</version>
    </dependency>


    <dependency>
        <groupId>org.spark-project.spark</groupId>
        <artifactId>unused</artifactId>
        <version>1.0.0</version>
        <scope>provided</scope>
    </dependency>

    <dependency>
        <groupId>com.fasterxml.jackson.core</groupId>
        <artifactId>jackson-core</artifactId>
        <version>2.6.6</version>
    </dependency>
    <dependency>
        <groupId>com.fasterxml.jackson.core</groupId>
        <artifactId>jackson-databind</artifactId>
        <version>2.6.6</version>
    </dependency>
    <dependency>
        <groupId>com.fasterxml.jackson.core</groupId>
        <artifactId>jackson-annotations</artifactId>
        <version>2.6.6</version>
    </dependency>
    <dependency>
        <groupId>log4j</groupId>
        <artifactId>log4j</artifactId>
        <version>1.2.17</version>
    </dependency>
    <dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <version>4.12</version>
    </dependency>
    <dependency>
        <groupId>com.google.guava</groupId>
        <artifactId>guava</artifactId>
        <version>19.0</version>
    </dependency>
</dependencies>

org.apache.spark
spark-core_2.10
2.1.0
org.apache.kafka
卡夫卡客户
0.9.0.0
org.apache.spark
spark-streaming-kafka_2.10
1.6.3
org.spark-project.spark
未使用
1.0.0
假如
com.fasterxml.jackson.core
杰克逊核心
2.6.6
com.fasterxml.jackson.core
杰克逊数据绑定
2.6.6
com.fasterxml.jackson.core
杰克逊注释
2.6.6
log4j
log4j
1.2.17
朱尼特
朱尼特
4.12
番石榴
番石榴
19

---

请有人帮助我解决此问题。在adavnce中，您需要使用相同版本的

spark core

和

spark streaming kafka

。请尝试将

spark streaming kafka

依赖项更改为：

<dependency>
    <groupId>org.apache.spark</groupId>
    <artifactId>spark-streaming-kafka-0-8_2.10</artifactId>
    <version>2.1.0</version>
</dependency>

org.apache.spark
spark-streaming-kafka-0-8_2.10
2.1.0

感谢您的输入。我添加了您提到的，并对maven进行了force更新。它成功了。