elasticsearch Elasticsearch到BigQuery管道部署在云数据融合实例上失败,elasticsearch,google-cloud-platform,google-bigquery,google-cloud-dataproc,google-cloud-data-fusion,elasticsearch,Google Cloud Platform,Google Bigquery,Google Cloud Dataproc,Google Cloud Data Fusion" /> elasticsearch Elasticsearch到BigQuery管道部署在云数据融合实例上失败,elasticsearch,google-cloud-platform,google-bigquery,google-cloud-dataproc,google-cloud-data-fusion,elasticsearch,Google Cloud Platform,Google Bigquery,Google Cloud Dataproc,Google Cloud Data Fusion" />

elasticsearch Elasticsearch到BigQuery管道部署在云数据融合实例上失败

elasticsearch Elasticsearch到BigQuery管道部署在云数据融合实例上失败,elasticsearch,google-cloud-platform,google-bigquery,google-cloud-dataproc,google-cloud-data-fusion,elasticsearch,Google Cloud Platform,Google Bigquery,Google Cloud Dataproc,Google Cloud Data Fusion,我正在部署一个数据融合管道,它从elasticsearch的索引中获取数据,并将数据加载到bigQuery表中。管道只是由elasticsearch插件连接器到BigQuery连接器组成。当我运行管道时,它会生成以下错误。 错误的来源是 io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService#548-runtime-startup-1 java.io.IOException:

我正在部署一个数据融合管道,它从elasticsearch的索引中获取数据,并将数据加载到bigQuery表中。管道只是由elasticsearch插件连接器到BigQuery连接器组成。当我运行管道时,它会生成以下错误。 错误的来源是

io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService#548-runtime-startup-1
java.io.IOException: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out)
    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:88) ~[na:na]
    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillPreparer.lambda$start$0(RemoteExecutionTwillPreparer.java:436) ~[na:na]
    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService$ControllerFactory.lambda$create$0(RemoteExecutionTwillRunnerService.java:524) ~[na:na]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_232]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_232]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_232]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_232]
    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_232]
Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out)
    at com.jcraft.jsch.Util.createSocket(Util.java:349) ~[com.jcraft.jsch-0.1.54.jar:na]
    at com.jcraft.jsch.Session.connect(Session.java:215) ~[com.jcraft.jsch-0.1.54.jar:na]
    at com.jcraft.jsch.Session.connect(Session.java:183) ~[com.jcraft.jsch-0.1.54.jar:na]
    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:85) ~[na:na]
    ... 7 common frames omitted
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.8.0_232]
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[na:1.8.0_232]
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[na:1.8.0_232]
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_232]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_232]
    at java.net.Socket.connect(Socket.java:607) ~[na:1.8.0_232]
    at java.net.Socket.connect(Socket.java:556) ~[na:1.8.0_232]
    at java.net.Socket.<init>(Socket.java:452) ~[na:1.8.0_232]
    at java.net.Socket.<init>(Socket.java:229) ~[na:1.8.0_232]
    at com.jcraft.jsch.Util.createSocket(Util.java:343) ~[com.jcraft.jsch-0.1.54.jar:na]
    ... 10 common frames omitted
实际误差为

io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService#548-runtime-startup-1
java.io.IOException: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out)
    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:88) ~[na:na]
    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillPreparer.lambda$start$0(RemoteExecutionTwillPreparer.java:436) ~[na:na]
    at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService$ControllerFactory.lambda$create$0(RemoteExecutionTwillRunnerService.java:524) ~[na:na]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_232]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_232]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_232]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_232]
    at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_232]
Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out)
    at com.jcraft.jsch.Util.createSocket(Util.java:349) ~[com.jcraft.jsch-0.1.54.jar:na]
    at com.jcraft.jsch.Session.connect(Session.java:215) ~[com.jcraft.jsch-0.1.54.jar:na]
    at com.jcraft.jsch.Session.connect(Session.java:183) ~[com.jcraft.jsch-0.1.54.jar:na]
    at io.cdap.cdap.common.ssh.DefaultSSHSession.<init>(DefaultSSHSession.java:85) ~[na:na]
    ... 7 common frames omitted
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.8.0_232]
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[na:1.8.0_232]
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[na:1.8.0_232]
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_232]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_232]
    at java.net.Socket.connect(Socket.java:607) ~[na:1.8.0_232]
    at java.net.Socket.connect(Socket.java:556) ~[na:1.8.0_232]
    at java.net.Socket.<init>(Socket.java:452) ~[na:1.8.0_232]
    at java.net.Socket.<init>(Socket.java:229) ~[na:1.8.0_232]
    at com.jcraft.jsch.Util.createSocket(Util.java:343) ~[com.jcraft.jsch-0.1.54.jar:na]
    ... 10 common frames omitted
java.io.IOException:com.jcraft.jsch.jscheexception:java.net.ConnectException:Connection timeout(连接超时)
在io.cdap.cdap.common.ssh.DefaultSSHSession.(DefaultSSHSession.java:88)~[na:na]
在io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillPreparer.lambda$start$0(RemoteExecutionTwillPreparer.java:436)~[na:na]
在io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillRunnerService$ControllerFactory.lambda$create$0(RemoteExecutionTwillRunnerService.java:524)~[na:na]
在java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)~[na:1.8.0\u 232]
在java.util.concurrent.FutureTask.run(FutureTask.java:266)~[na:1.8.0232]
在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)~[na:1.8.0_232]
在java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)~[na:1.8.0_232]
在java.lang.Thread.run(Thread.java:748)~[na:1.8.0_232]
原因:com.jcraft.jsch.JSchException:java.net.ConnectException:连接超时(连接超时)
在com.jcraft.jsch.Util.createSocket(Util.java:349)~[com.jcraft.jsch-0.1.54.jar:na]
在com.jcraft.jsch.Session.connect(Session.java:215)~[com.jcraft.jsch-0.1.54.jar:na]
在com.jcraft.jsch.Session.connect(Session.java:183)~[com.jcraft.jsch-0.1.54.jar:na]
在io.cdap.cdap.common.ssh.DefaultSSHSession.(DefaultSSHSession.java:85)~[na:na]
... 省略了7个公共框架
原因:java.net.ConnectException:连接超时(连接超时)
在java.net.PlainSocketImpl.socketConnect(本机方法)~[na:1.8.0_232]
在java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)~[na:1.8.0_232]
在java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)~[na:1.8.0_232]
在java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)~[na:1.8.0_232]
在java.net.socksocketimpl.connect(socksocketimpl.java:392)~[na:1.8.0_232]
在java.net.Socket.connect(Socket.java:607)~[na:1.8.0_232]
在java.net.Socket.connect(Socket.java:556)~[na:1.8.0_232]
在java.net.Socket.(Socket.java:452)~[na:1.8.0_232]
在java.net.Socket.(Socket.java:229)~[na:1.8.0_232]
在com.jcraft.jsch.Util.createSocket(Util.java:343)~[com.jcraft.jsch-0.1.54.jar:na]
... 省略10个公共框架

如何解决此问题?

请参阅中记录的网络要求

具体而言:

新项目从默认网络开始。默认网络是 预填充防火墙规则,默认允许ssh,允许 TCP端口22上从任何源到中任何实例的传入连接 网络。如果您使用的网络中不存在此类规则 云数据融合实例,需要创建这样一个规则


数据融合是一种GCP工具,您可以在其中创建管道,而无需显式编码任何内容。您可以通过拖放相关插件来创建管道。。。我使用了两个插件1)Elasticsearch源插件2)BigQuery接收器连接器对不起,你是对的,我搞混了一些东西,你能给我介绍一下吗??