Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/scala/17.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Scala IntelliJ库导入错误_Scala_Apache Spark_Intellij Idea_Apache Kafka_Sbt - Fatal编程技术网

Scala IntelliJ库导入错误

Scala IntelliJ库导入错误,scala,apache-spark,intellij-idea,apache-kafka,sbt,Scala,Apache Spark,Intellij Idea,Apache Kafka,Sbt,我是scala新手,正在尝试在build.sbt中导入以下库。IntelliJ执行自动更新时,我会出现以下错误: Error while importing sbt project: List([info] welcome to sbt 1.3.13 (Oracle Corporation Java 1.8.0_251) [info] loading global plugins from C:\Users\diego\.sbt\1.0\plugins [info] loading proje

我是scala新手,正在尝试在build.sbt中导入以下库。IntelliJ执行自动更新时,我会出现以下错误:

Error while importing sbt project:

List([info] welcome to sbt 1.3.13 (Oracle Corporation Java 1.8.0_251)
[info] loading global plugins from C:\Users\diego\.sbt\1.0\plugins
[info] loading project definition from C:\Users\diego\development\Meetup\Stream-Processing\project
[info] loading settings for project stream-processing from build.sbt ...
[info] set current project to Stream-Processing (in build file:/C:/Users/diego/development/Meetup/Stream-Processing/)
[info] sbt server started at local:sbt-server-80d70f9339b81b4d026a
sbt:Stream-Processing>
[info] Defining Global / sbtStructureOptions, Global / sbtStructureOutputFile and 1 others.
[info] The new values will be used by cleanKeepGlobs
[info]  Run `last` for details.
[info] Reapplying settings...
[info] set current project to Stream-Processing (in build file:/C:/Users/diego/development/Meetup/Stream-Processing/)
[info] Applying State transformations org.jetbrains.sbt.CreateTasks from C:/Users/diego/.IntelliJIdea2019.3/config/plugins/Scala/repo/org.jetbrains/sbt-structure-extractor/scala_2.12/sbt_1.0/2018.2.1+4-88400d3f/jars/sbt-structure-extractor.jar
[info] Reapplying settings...
[info] set current project to Stream-Processing (in build file:/C:/Users/diego/development/Meetup/Stream-Processing/)
[warn]
[warn]  Note: Unresolved dependencies path:
[error] stack trace is suppressed; run 'last update' for the full output
[error] stack trace is suppressed; run 'last ssExtractDependencies' for the full output
[error] (update) sbt.librarymanagement.ResolveException: Error downloading org.apache.kafka:kafka-clients_2.11:2.3.1
[error]   Not found
[error]   Not found
[error]   not found: C:\Users\diego\.ivy2\local\org.apache.kafka\kafka-clients_2.11\2.3.1\ivys\ivy.xml
[error]   not found: https://repo1.maven.org/maven2/org/apache/kafka/kafka-clients_2.11/2.3.1/kafka-clients_2.11-2.3.1.pom
[error] (ssExtractDependencies) sbt.librarymanagement.ResolveException: Error downloading org.apache.kafka:kafka-clients_2.11:2.3.1
[error]   Not found
[error]   Not found
[error]   not found: C:\Users\diego\.ivy2\local\org.apache.kafka\kafka-clients_2.11\2.3.1\ivys\ivy.xml
[error]   not found: https://repo1.maven.org/maven2/org/apache/kafka/kafka-clients_2.11/2.3.1/kafka-clients_2.11-2.3.1.pom
[error] Total time: 2 s, completed Jun 28, 2020 12:11:24 PM
[info] shutting down sbt server)
这是我的build.sbt文件:

name := "Stream-Processing"

version := "1.0"

scalaVersion := "2.11.8"

libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.4"

// https://mvnrepository.com/artifact/org.apache.spark/spark-sql-kafka-0-10_2.12
libraryDependencies += "org.apache.spark" %% "spark-sql-kafka-0-10" % "2.4.4"

// https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients
libraryDependencies += "org.apache.kafka" %% "kafka-clients" % "2.3.1"

// https://mvnrepository.com/artifact/mysql/mysql-connector-java
libraryDependencies += "mysql" % "mysql-connector-java" % "8.0.18"

// https://mvnrepository.com/artifact/org.mongodb.spark/mongo-spark-connector
libraryDependencies += "org.mongodb.spark" %% "mongo-spark-connector" % "2.4.1"

我做了一个Scala项目只是为了确保Spark工作,我的python项目也使用Kafka工作,所以我确信这不是Spark/Kafka的问题。有什么原因导致我出现这个错误吗?

尝试在
卡夫卡客户端之前删除一个
%

libraryDependencies+=“org.apache.kafka”%“kafka客户端”%“2.3.1”
SBT中
%%
的语义是,它将使用的Scala版本附加到工件名称中,因此它变成
org.apache.kafka:kafka-clients_2.11:2.3.1
,正如错误消息所示。请注意
\u 2.11
后缀。

这是Scala库的一个很好的简写,但当与Java libs一起使用时,初学者可能会感到困惑。

尝试在“kafka客户端”之前删除一个
%

libraryDependencies+=“org.apache.kafka”%“kafka客户端”%“2.3.1”
SBT中
%%
的语义是,它将使用的Scala版本附加到工件名称中,因此它变成
org.apache.kafka:kafka-clients_2.11:2.3.1
,正如错误消息所示。请注意
\u 2.11
后缀。
这是Scala库的一个很好的简写,但当与Java libs一起使用时,初学者可能会感到困惑。

Kafka客户端是一个Java库,而不是Scala库。因此,您只需要使用一个
%%
而不是两个
%%
libraryDependencies+=“org.apache.kafka”%%“kafka客户端”%%“2.3.1”
这里的链接非常明确。kafka客户端是Java库,而不是Scala库。因此,您只需要使用一个
%%
而不是两个
%%
libraryDependencies+=“org.apache.kafka”%%“kafka客户端”%%“2.3.1”
您在那里的链接对此非常明确。