Java 无法验证GCS bucket和PKIX路径构建在创建和暂存GCP数据流模板时失败
我正在使用以下命令在云存储中创建和暂存gcp数据流模板:Java 无法验证GCS bucket和PKIX路径构建在创建和暂存GCP数据流模板时失败,java,maven,google-cloud-platform,google-cloud-dataflow,pkix,Java,Maven,Google Cloud Platform,Google Cloud Dataflow,Pkix,我正在使用以下命令在云存储中创建和暂存gcp数据流模板: mvn-X compile exec:java-Dexec.mainClass=main.java.TemplatePipeline-Dexec.args=“--runner=DataflowRunner--project=hv hcap开发--stagingLocation=gs://my bucket/staging--templateLocation=gs://my bucket/templates/template1” 生成失败,
mvn-X compile exec:java-Dexec.mainClass=main.java.TemplatePipeline-Dexec.args=“--runner=DataflowRunner--project=hv hcap开发--stagingLocation=gs://my bucket/staging--templateLocation=gs://my bucket/templates/template1”
生成失败,出现以下错误
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3.563 s
[INFO] Finished at: 2020-07-17T17:32:05-07:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:java (default-cli) on project dataflow-template: An exception occured while executing the Java class. Failed to construct instance from factory method DataflowRunner#fromOptions(interface org.apache.beam.sdk.options.PipelineOptions): InvocationTargetException: Unable to verify that GCS bucket gs://bucket-df-job exists. sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:3.0.0:java (default-cli) on project dataflow-template: An exception occured while executing the Java class. Failed to construct instance from factory method DataflowRunner#fromOptions(interface org.apache.beam.sdk.options.PipelineOptions)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: org.apache.maven.plugin.MojoExecutionException: An exception occured while executing the Java class. Failed to construct instance from factory method DataflowRunner#fromOptions(interface org.apache.beam.sdk.options.PipelineOptions)
at org.codehaus.mojo.exec.ExecJavaMojo.execute (ExecJavaMojo.java:311)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305)
at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192)
at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105)
at org.apache.maven.cli.MavenCli.execute (MavenCli.java:957)
at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:289)
at org.apache.maven.cli.MavenCli.main (MavenCli.java:193)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406)
at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347)
Caused by: java.lang.RuntimeException: Failed to construct instance from factory method DataflowRunner#fromOptions(interface org.apache.beam.sdk.options.PipelineOptions)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod (InstanceBuilder.java:224)
at org.apache.beam.sdk.util.InstanceBuilder.build (InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions (PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create (Pipeline.java:149)
at main.java.TemplatePipeline.main (TemplatePipeline.java:95)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:748)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod (InstanceBuilder.java:214)
at org.apache.beam.sdk.util.InstanceBuilder.build (InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions (PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create (Pipeline.java:149)
at main.java.TemplatePipeline.main (TemplatePipeline.java:95)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:748)
Caused by: java.lang.RuntimeException: Unable to verify that GCS bucket gs://bucket-df-job exists.
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.verifyPathIsAccessible (GcsPathValidator.java:86)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.validateOutputFilePrefixSupported (GcsPathValidator.java:53)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions (DataflowRunner.java:274)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod (InstanceBuilder.java:214)
at org.apache.beam.sdk.util.InstanceBuilder.build (InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions (PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create (Pipeline.java:149)
at main.java.TemplatePipeline.main (TemplatePipeline.java:95)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:748)
Caused by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.ssl.Alerts.getSSLException (Alerts.java:198)
at sun.security.ssl.SSLSocketImpl.fatal (SSLSocketImpl.java:1967)
at sun.security.ssl.Handshaker.fatalSE (Handshaker.java:331)
at sun.security.ssl.Handshaker.fatalSE (Handshaker.java:325)
at sun.security.ssl.ClientHandshaker.serverCertificate (ClientHandshaker.java:1689)
at sun.security.ssl.ClientHandshaker.processMessage (ClientHandshaker.java:226)
at sun.security.ssl.Handshaker.processLoop (Handshaker.java:1082)
at sun.security.ssl.Handshaker.process_record (Handshaker.java:1010)
at sun.security.ssl.SSLSocketImpl.readRecord (SSLSocketImpl.java:1079)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake (SSLSocketImpl.java:1388)
at sun.security.ssl.SSLSocketImpl.startHandshake (SSLSocketImpl.java:1416)
at sun.security.ssl.SSLSocketImpl.startHandshake (SSLSocketImpl.java:1400)
at sun.net.www.protocol.https.HttpsClient.afterConnect (HttpsClient.java:559)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect (AbstractDelegateHttpsURLConnection.java:185)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0 (HttpURLConnection.java:1340)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream (HttpURLConnection.java:1315)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream (HttpsURLConnectionImpl.java:264)
at com.google.api.client.http.javanet.NetHttpRequest.execute (NetHttpRequest.java:113)
at com.google.api.client.http.javanet.NetHttpRequest.execute (NetHttpRequest.java:84)
at com.google.api.client.http.HttpRequest.execute (HttpRequest.java:1012)
at com.google.auth.oauth2.UserCredentials.refreshAccessToken (UserCredentials.java:203)
at com.google.auth.oauth2.OAuth2Credentials.refresh (OAuth2Credentials.java:157)
at com.google.auth.oauth2.OAuth2Credentials.getRequestMetadata (OAuth2Credentials.java:145)
at com.google.auth.oauth2.UserCredentials.getRequestMetadata (UserCredentials.java:281)
at com.google.auth.http.HttpCredentialsAdapter.initialize (HttpCredentialsAdapter.java:91)
at com.google.cloud.hadoop.util.ChainingHttpRequestInitializer.initialize (ChainingHttpRequestInitializer.java:52)
at com.google.api.client.http.HttpRequestFactory.buildRequest (HttpRequestFactory.java:88)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.buildHttpRequest (AbstractGoogleClientRequest.java:422)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:541)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:474)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute (AbstractGoogleClientRequest.java:591)
at com.google.cloud.hadoop.util.ResilientOperation$AbstractGoogleClientRequestExecutor.call (ResilientOperation.java:171)
at com.google.cloud.hadoop.util.ResilientOperation.retry (ResilientOperation.java:67)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.getBucket (GcsUtil.java:521)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.bucketAccessible (GcsUtil.java:509)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.bucketAccessible (GcsUtil.java:482)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.verifyPathIsAccessible (GcsPathValidator.java:83)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.validateOutputFilePrefixSupported (GcsPathValidator.java:53)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions (DataflowRunner.java:274)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod (InstanceBuilder.java:214)
at org.apache.beam.sdk.util.InstanceBuilder.build (InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions (PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create (Pipeline.java:149)
at main.java.TemplatePipeline.main (TemplatePipeline.java:95)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:748)
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.validator.PKIXValidator.doBuild (PKIXValidator.java:450)
at sun.security.validator.PKIXValidator.engineValidate (PKIXValidator.java:317)
at sun.security.validator.Validator.validate (Validator.java:262)
at sun.security.ssl.X509TrustManagerImpl.validate (X509TrustManagerImpl.java:330)
at sun.security.ssl.X509TrustManagerImpl.checkTrusted (X509TrustManagerImpl.java:227)
at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted (X509TrustManagerImpl.java:132)
at sun.security.ssl.ClientHandshaker.serverCertificate (ClientHandshaker.java:1671)
at sun.security.ssl.ClientHandshaker.processMessage (ClientHandshaker.java:226)
at sun.security.ssl.Handshaker.processLoop (Handshaker.java:1082)
at sun.security.ssl.Handshaker.process_record (Handshaker.java:1010)
at sun.security.ssl.SSLSocketImpl.readRecord (SSLSocketImpl.java:1079)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake (SSLSocketImpl.java:1388)
at sun.security.ssl.SSLSocketImpl.startHandshake (SSLSocketImpl.java:1416)
at sun.security.ssl.SSLSocketImpl.startHandshake (SSLSocketImpl.java:1400)
at sun.net.www.protocol.https.HttpsClient.afterConnect (HttpsClient.java:559)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect (AbstractDelegateHttpsURLConnection.java:185)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0 (HttpURLConnection.java:1340)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream (HttpURLConnection.java:1315)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream (HttpsURLConnectionImpl.java:264)
at com.google.api.client.http.javanet.NetHttpRequest.execute (NetHttpRequest.java:113)
at com.google.api.client.http.javanet.NetHttpRequest.execute (NetHttpRequest.java:84)
at com.google.api.client.http.HttpRequest.execute (HttpRequest.java:1012)
at com.google.auth.oauth2.UserCredentials.refreshAccessToken (UserCredentials.java:203)
at com.google.auth.oauth2.OAuth2Credentials.refresh (OAuth2Credentials.java:157)
at com.google.auth.oauth2.OAuth2Credentials.getRequestMetadata (OAuth2Credentials.java:145)
at com.google.auth.oauth2.UserCredentials.getRequestMetadata (UserCredentials.java:281)
at com.google.auth.http.HttpCredentialsAdapter.initialize (HttpCredentialsAdapter.java:91)
at com.google.cloud.hadoop.util.ChainingHttpRequestInitializer.initialize (ChainingHttpRequestInitializer.java:52)
at com.google.api.client.http.HttpRequestFactory.buildRequest (HttpRequestFactory.java:88)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.buildHttpRequest (AbstractGoogleClientRequest.java:422)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:541)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:474)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute (AbstractGoogleClientRequest.java:591)
at com.google.cloud.hadoop.util.ResilientOperation$AbstractGoogleClientRequestExecutor.call (ResilientOperation.java:171)
at com.google.cloud.hadoop.util.ResilientOperation.retry (ResilientOperation.java:67)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.getBucket (GcsUtil.java:521)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.bucketAccessible (GcsUtil.java:509)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.bucketAccessible (GcsUtil.java:482)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.verifyPathIsAccessible (GcsPathValidator.java:83)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.validateOutputFilePrefixSupported (GcsPathValidator.java:53)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions (DataflowRunner.java:274)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod (InstanceBuilder.java:214)
at org.apache.beam.sdk.util.InstanceBuilder.build (InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions (PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create (Pipeline.java:149)
at main.java.TemplatePipeline.main (TemplatePipeline.java:95)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:748)
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at sun.security.provider.certpath.SunCertPathBuilder.build (SunCertPathBuilder.java:141)
at sun.security.provider.certpath.SunCertPathBuilder.engineBuild (SunCertPathBuilder.java:126)
at java.security.cert.CertPathBuilder.build (CertPathBuilder.java:280)
at sun.security.validator.PKIXValidator.doBuild (PKIXValidator.java:445)
at sun.security.validator.PKIXValidator.engineValidate (PKIXValidator.java:317)
at sun.security.validator.Validator.validate (Validator.java:262)
at sun.security.ssl.X509TrustManagerImpl.validate (X509TrustManagerImpl.java:330)
at sun.security.ssl.X509TrustManagerImpl.checkTrusted (X509TrustManagerImpl.java:227)
at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted (X509TrustManagerImpl.java:132)
at sun.security.ssl.ClientHandshaker.serverCertificate (ClientHandshaker.java:1671)
at sun.security.ssl.ClientHandshaker.processMessage (ClientHandshaker.java:226)
at sun.security.ssl.Handshaker.processLoop (Handshaker.java:1082)
at sun.security.ssl.Handshaker.process_record (Handshaker.java:1010)
at sun.security.ssl.SSLSocketImpl.readRecord (SSLSocketImpl.java:1079)
at sun.security.ssl.SSLSocketImpl.performInitialHandshake (SSLSocketImpl.java:1388)
at sun.security.ssl.SSLSocketImpl.startHandshake (SSLSocketImpl.java:1416)
at sun.security.ssl.SSLSocketImpl.startHandshake (SSLSocketImpl.java:1400)
at sun.net.www.protocol.https.HttpsClient.afterConnect (HttpsClient.java:559)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect (AbstractDelegateHttpsURLConnection.java:185)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0 (HttpURLConnection.java:1340)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream (HttpURLConnection.java:1315)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream (HttpsURLConnectionImpl.java:264)
at com.google.api.client.http.javanet.NetHttpRequest.execute (NetHttpRequest.java:113)
at com.google.api.client.http.javanet.NetHttpRequest.execute (NetHttpRequest.java:84)
at com.google.api.client.http.HttpRequest.execute (HttpRequest.java:1012)
at com.google.auth.oauth2.UserCredentials.refreshAccessToken (UserCredentials.java:203)
at com.google.auth.oauth2.OAuth2Credentials.refresh (OAuth2Credentials.java:157)
at com.google.auth.oauth2.OAuth2Credentials.getRequestMetadata (OAuth2Credentials.java:145)
at com.google.auth.oauth2.UserCredentials.getRequestMetadata (UserCredentials.java:281)
at com.google.auth.http.HttpCredentialsAdapter.initialize (HttpCredentialsAdapter.java:91)
at com.google.cloud.hadoop.util.ChainingHttpRequestInitializer.initialize (ChainingHttpRequestInitializer.java:52)
at com.google.api.client.http.HttpRequestFactory.buildRequest (HttpRequestFactory.java:88)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.buildHttpRequest (AbstractGoogleClientRequest.java:422)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:541)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed (AbstractGoogleClientRequest.java:474)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute (AbstractGoogleClientRequest.java:591)
at com.google.cloud.hadoop.util.ResilientOperation$AbstractGoogleClientRequestExecutor.call (ResilientOperation.java:171)
at com.google.cloud.hadoop.util.ResilientOperation.retry (ResilientOperation.java:67)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.getBucket (GcsUtil.java:521)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.bucketAccessible (GcsUtil.java:509)
at org.apache.beam.sdk.extensions.gcp.util.GcsUtil.bucketAccessible (GcsUtil.java:482)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.verifyPathIsAccessible (GcsPathValidator.java:83)
at org.apache.beam.sdk.extensions.gcp.storage.GcsPathValidator.validateOutputFilePrefixSupported (GcsPathValidator.java:53)
at org.apache.beam.runners.dataflow.DataflowRunner.fromOptions (DataflowRunner.java:274)
at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke (Method.java:498)
at org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod (InstanceBuilder.java:214)
at org.apache.beam.sdk.util.InstanceBuilder.build (InstanceBuilder.java:155)
at org.apache.beam.sdk.PipelineRunner.fromOptions (PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.create (Pipeline.java:149)
at main.java.TemplatePipeline.main (TemplatePipeline.java:95)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:748)
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
我已使用从终端登录到GCP
gcloud auth应用程序默认登录名
和export GOOGLE_CLOUD_凭证=${PATH}
此外,我还使用
sudo keytool-import-trustcacerts-file/path/to/google.cer-alias google-keystore$JAVA_HOME/jre/lib/security/cacerts
并验证它是否存在
非常感谢您为解决此问题提供的任何帮助。原因有二
bucket df job
。如果是这样,创建bucket
GOOGLE\u APPLICATION\u凭据
,该服务帐户是否有权访问GCS存储桶?如果没有,请授予访问权限,然后再次尝试构建数据流模板
这可能有两个原因
bucket df job
。如果是这样,创建bucket
GOOGLE\u APPLICATION\u凭据
,该服务帐户是否有权访问GCS存储桶?如果没有,请授予访问权限,然后再次尝试构建数据流模板
除了确保您输入了正确的bucket名称/路径外,我还要确保:
查看此项以确保您具备所有要求,因为您正处于数据流的创建阶段。除了确保您输入了正确的bucket名称/路径之外,我还将确保:
查看此内容以确保您具备所有要求,因为您正处于数据流的创建阶段。感谢@bigbounty的回复。bucket存在于我的帐户中,在“权限”选项卡下,我可以看到我的服务帐户。此外,我已将bucket操作的所有权限授予服务帐户。不幸的是,它仍然显示相同的错误。我创建了一个python版本,它使用相同的资源和凭据运行良好。感谢@bigbounty的回复。bucket存在于我的帐户中,在“权限”选项卡下,我可以看到我的服务帐户。此外,我已将bucket操作的所有权限授予服务帐户。不幸的是,它仍然显示相同的错误。我创建了一个python版本,它使用相同的资源和凭据运行良好。谢谢@eyoto。我已经确保所有这些都设置好了,但不确定为什么它不能与Java和Maven代码一起工作。不过,我的python代码的替代版本(创建和暂存数据流模板)工作得很好。如果这是一个帐户或权限问题,我相信它也不会起作用。谢谢@eyoto。我已经确保所有这些都设置好了,但不确定为什么它不能与Java和Maven代码一起工作。不过,我的python代码的替代版本(创建和暂存数据流模板)工作得很好。如果这是一个帐户或权限问题,我相信它也不会起作用。