Google cloud dataflow 云数据流429错误-“;资源已用尽(例如检查配额)。”;

Google cloud dataflow 云数据流429错误-“;资源已用尽(例如检查配额)。”;,google-cloud-dataflow,Google Cloud Dataflow,我们的一个作业开始抛出以下警告/错误: 856573 [main] WARN com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob - There were problems getting current job status: com.google.api.client.googleapis.json.GoogleJsonResponseException: 429 Too Many Requests { "code"

我们的一个作业开始抛出以下警告/错误:

856573 [main] WARN  com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob  - There were problems getting current job status: 
com.google.api.client.googleapis.json.GoogleJsonResponseException: 429 Too Many Requests
{
  "code" : 429,
  "errors" : [ {
    "domain" : "global",
    "message" : "Resource has been exhausted (e.g. check quota).",
    "reason" : "rateLimitExceeded"
  } ],
  "message" : "Resource has been exhausted (e.g. check quota).",
  "status" : "RESOURCE_EXHAUSTED"
}
    at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:145)
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1056)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
    at com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob.getState(DataflowPipelineJob.java:188)
    at com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob.waitToFinish(DataflowPipelineJob.java:126)
    at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(BlockingDataflowPipelineRunner.java:86)
    at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(BlockingDataflowPipelineRunner.java:47)
    at com.google.cloud.dataflow.sdk.Pipeline.run(Pipeline.java:145)
    at com.tls.cdf.job.AbstractCloudDataFlowJob.execute(AbstractCloudDataFlowJob.java:100)
    at com.tls.cdf.CloudDataFlowJobExecutor.main(CloudDataFlowJobExecutor.java:44)
起初我们认为这是一个为作业分配所需资源(VM)的错误,但实际上作业运行良好,并且能够根据需要扩展。似乎是在试图检索作业状态时出现了问题

有趣的是,每次在应用程序中抛出错误(作业运行时报告了多个错误),开发人员控制台也会执行以下操作:

工作id是:2015-05-04_20_49_53-2521857061976321751


此警告/错误与什么有关?

我们的最终报告监控信息存在问题。我们已经把零钱退了,你现在应该没事了。如果您仍有问题,请告知我们。抱歉给你添麻烦了

他又开始了工作。相同的警告/错误。工作编号:2015-05-04_22_24_18-14351181703270116638今天我也想到了。错误现在消失了。干得好错误再次出现,但现在是503的“服务当前不可用”:441910[main]WARN com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob-获取当前作业状态时出现问题:com.google.api.client.googleapis.json.googlejson响应异常:503服务不可用{“代码”:503,“错误”:[{“域”:“全局”,“消息”:“服务当前不可用。”,“原因”:“backendError”}],“消息”:“服务当前不可用。”,“状态”:“不可用”}