Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/scala/18.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Spring 错误:scalac:在类文件';中遇到对org.apache.spark.Logging的错误符号引用;HBaseContext.class';_Spring_Scala_Apache Spark_Hbase - Fatal编程技术网

Spring 错误:scalac:在类文件';中遇到对org.apache.spark.Logging的错误符号引用;HBaseContext.class';

Spring 错误:scalac:在类文件';中遇到对org.apache.spark.Logging的错误符号引用;HBaseContext.class';,spring,scala,apache-spark,hbase,Spring,Scala,Apache Spark,Hbase,我正在尝试将HBase与Spark 2.1.0和Scala 2.11.2结合使用 尝试运行我的Spring应用程序后,出现以下错误: 错误:scalac:对org.apache.spark.Logging的错误符号引用 在类文件“HBaseContext.class”中遇到。无法访问类型 登录包org.apache.spark。当前类路径可能是 缺少org.apache.spark.Logging的定义,或 HBaseContext.class可能是根据以下版本编译的: 与当前类路径上找到的不兼

我正在尝试将HBase与Spark 2.1.0和Scala 2.11.2结合使用

尝试运行我的Spring应用程序后,出现以下错误:

错误:scalac:对org.apache.spark.Logging的错误符号引用 在类文件“HBaseContext.class”中遇到。无法访问类型 登录包org.apache.spark。当前类路径可能是 缺少org.apache.spark.Logging的定义,或 HBaseContext.class可能是根据以下版本编译的: 与当前类路径上找到的不兼容

build.sbt

import sbt.ExclusionRule

name := "..."
version := "1.0"
scalaVersion := "2.11.2"

val elasticVersion = "5.4.1"

resolvers += "bintray-spark-packages" at "https://dl.bintray.com/spark-packages/maven/"

/* Dependencies */
libraryDependencies ++= Seq(
  // Framework and configuration
  "org.springframework.boot" % "spring-boot-starter-web" % "1.5.3.RELEASE",
  "org.springframework.cloud" % "spring-cloud-starter-config" % "1.3.1.RELEASE",
  "org.hibernate" % "hibernate-validator" % "5.2.4.Final",

  /* Dependencies */
  "com.fasterxml.jackson.core" % "jackson-core" % "2.8.7",
  "com.fasterxml.jackson.core" % "jackson-databind" % "2.8.7",
  "com.fasterxml.jackson.module" % "jackson-module-scala_2.11" % "2.8.7",

  // Spark
  "org.apache.spark" %% "spark-core" % "2.1.0",
  "org.apache.spark" %% "spark-sql" % "2.1.0",
  "org.apache.spark" %% "spark-mllib" % "2.1.0",
  "graphframes" % "graphframes" % "0.5.0-spark2.1-s_2.11",

  //JDBC
  "mysql" % "mysql-connector-java" % "5.1.35",

  // Persistence
  "org.elasticsearch" % "elasticsearch-spark-20_2.11" % elasticVersion,
  "org.mongodb.spark" % "mongo-spark-connector_2.11" % "2.0.0",
  "org.apache.hbase" % "hbase-spark" % "2.0.0-alpha-1"


).map(_.excludeAll(ExclusionRule("org.slf4j", "slf4j-log4j12"), ExclusionRule("log4j", "log4j")))


/* Assembly     */
assemblyMergeStrategy in assembly := {
  case PathList("META-INF", xs@_*) => MergeStrategy.discard
  case x => MergeStrategy.first
}