无法将java datacatalog连接到google dataproc
我试图在Java数据目录下使用给定的示例进行POC,但失败了,因为我缺少依赖关系无法将java datacatalog连接到google dataproc,java,scala,apache-spark,google-cloud-platform,google-cloud-sdk,Java,Scala,Apache Spark,Google Cloud Platform,Google Cloud Sdk,我试图在Java数据目录下使用给定的示例进行POC,但失败了,因为我缺少依赖关系 Exception in thread "main" java.lang.NoClassDefFoundError: com/google/api/gax/core/BackgroundResource at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass
Exception in thread "main" java.lang.NoClassDefFoundError: com/google/api/gax/core/BackgroundResource
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:756)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
at com.podium.dataprofiler.PodiumDataProfiler$.main(DataProfiler.scala:63)
at com.podium.dataprofiler.PodiumDataProfiler.main(DataProfiler.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.ClassNotFoundException: com.google.api.gax.core.BackgroundResource
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
... 25 more
上面是我调用dataproc集群中的示例程序时填充的错误。如果您能提供任何帮助,我们将不胜感激。您能解释一下您正在一步一步地做什么,以及没有发生什么事情吗?实际上,我们有一个scala程序,它使用java datacatalog标记一些元数据,在本地工作正常,但当我尝试运行GoogleDataProc中的相同代码会产生上述错误。您可以检查是否处理了所有依赖项,并且版本是否正确吗?