Google cloud dataflow 云数据流429错误-“;资源已用尽(例如检查配额)。”;
我们的一个作业开始抛出以下警告/错误:Google cloud dataflow 云数据流429错误-“;资源已用尽(例如检查配额)。”;,google-cloud-dataflow,Google Cloud Dataflow,我们的一个作业开始抛出以下警告/错误: 856573 [main] WARN com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob - There were problems getting current job status: com.google.api.client.googleapis.json.GoogleJsonResponseException: 429 Too Many Requests { "code"
856573 [main] WARN com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob - There were problems getting current job status:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 429 Too Many Requests
{
"code" : 429,
"errors" : [ {
"domain" : "global",
"message" : "Resource has been exhausted (e.g. check quota).",
"reason" : "rateLimitExceeded"
} ],
"message" : "Resource has been exhausted (e.g. check quota).",
"status" : "RESOURCE_EXHAUSTED"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:145)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1056)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob.getState(DataflowPipelineJob.java:188)
at com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob.waitToFinish(DataflowPipelineJob.java:126)
at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(BlockingDataflowPipelineRunner.java:86)
at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(BlockingDataflowPipelineRunner.java:47)
at com.google.cloud.dataflow.sdk.Pipeline.run(Pipeline.java:145)
at com.tls.cdf.job.AbstractCloudDataFlowJob.execute(AbstractCloudDataFlowJob.java:100)
at com.tls.cdf.CloudDataFlowJobExecutor.main(CloudDataFlowJobExecutor.java:44)
起初我们认为这是一个为作业分配所需资源(VM)的错误,但实际上作业运行良好,并且能够根据需要扩展。似乎是在试图检索作业状态时出现了问题
有趣的是,每次在应用程序中抛出错误(作业运行时报告了多个错误),开发人员控制台也会执行以下操作:
工作id是:2015-05-04_20_49_53-2521857061976321751
此警告/错误与什么有关?我们的最终报告监控信息存在问题。我们已经把零钱退了,你现在应该没事了。如果您仍有问题,请告知我们。抱歉给你添麻烦了 他又开始了工作。相同的警告/错误。工作编号:2015-05-04_22_24_18-14351181703270116638今天我也想到了。错误现在消失了。干得好错误再次出现,但现在是503的“服务当前不可用”:441910[main]WARN com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob-获取当前作业状态时出现问题:com.google.api.client.googleapis.json.googlejson响应异常:503服务不可用{“代码”:503,“错误”:[{“域”:“全局”,“消息”:“服务当前不可用。”,“原因”:“backendError”}],“消息”:“服务当前不可用。”,“状态”:“不可用”}