Warning: file_get_contents(/data/phpspider/zhask/data//catemap/9/java/329.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/node.js/42.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
无法将java datacatalog连接到google dataproc_Java_Scala_Apache Spark_Google Cloud Platform_Google Cloud Sdk - Fatal编程技术网

无法将java datacatalog连接到google dataproc

无法将java datacatalog连接到google dataproc,java,scala,apache-spark,google-cloud-platform,google-cloud-sdk,Java,Scala,Apache Spark,Google Cloud Platform,Google Cloud Sdk,我试图在Java数据目录下使用给定的示例进行POC,但失败了,因为我缺少依赖关系 Exception in thread "main" java.lang.NoClassDefFoundError: com/google/api/gax/core/BackgroundResource at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass

我试图在Java数据目录下使用给定的示例进行POC,但失败了,因为我缺少依赖关系

Exception in thread "main" java.lang.NoClassDefFoundError: com/google/api/gax/core/BackgroundResource
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:756)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
    at com.podium.dataprofiler.PodiumDataProfiler$.main(DataProfiler.scala:63)
    at com.podium.dataprofiler.PodiumDataProfiler.main(DataProfiler.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
    at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
    at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
    at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
    at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
    at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: com.google.api.gax.core.BackgroundResource
    at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
    ... 25 more

上面是我调用dataproc集群中的示例程序时填充的错误。如果您能提供任何帮助,我们将不胜感激。

您能解释一下您正在一步一步地做什么,以及没有发生什么事情吗?实际上,我们有一个scala程序,它使用java datacatalog标记一些元数据,在本地工作正常,但当我尝试运行GoogleDataProc中的相同代码会产生上述错误。您可以检查是否处理了所有依赖项,并且版本是否正确吗?