Google cloud dataflow 数据流作业错误："'；资源'；项目/<；已删除>/分区/us-central1-a/disks/<；已删除>-线束-0'；未准备好'；
今天早上，我们的一条管道出现了一个我们从未见过的错误。此外，我们必须手动删除一个已启动的VM，以取消/停止作业 数据流服务中是否有任何可能导致此错误的更改Google cloud dataflow 数据流作业错误："'；资源'；项目/<；已删除>/分区/us-central1-a/disks/<；已删除>-线束-0'；未准备好'；,google-cloud-dataflow,Google Cloud Dataflow,今天早上，我们的一条管道出现了一个我们从未见过的错误。此外，我们必须手动删除一个已启动的VM，以取消/停止作业 数据流服务中是否有任何可能导致此错误的更改 0 [main] INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: wi
0 [main] INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 49 files. Enable logging at DEBUG level to see which files will be staged.
2243 [main] INFO com.<removed>.cdf.dfp.DFPDenormalizationCloudDataFlowJob - Successfully created cloud dataflow service pipeline
2282 [main] INFO com.<removed>.cdf.dfp.DFPDenormalizationCloudDataFlowJob - Last loaded table was found. It will be processed for denormalization: Clicks_06_2015
2282 [main] INFO com.<removed>.cdf.dfp.DFPDenormalizationCloudDataFlowJob - Last loaded table was found. It will be processed for denormalization: ActiveViews_06_2015
2282 [main] INFO com.<removed>.cdf.dfp.DFPDenormalizationCloudDataFlowJob - Last loaded table was found. It will be processed for denormalization: Impressions_06_2015
2435 [main] WARN com.google.cloud.dataflow.sdk.Pipeline - Transform <removed>:<removed>.advertisers2 does not have a stable unique name. In the future, this will prevent reloading streaming pipelines
2615 [main] WARN com.google.cloud.dataflow.sdk.Pipeline - Transform <removed>:<removed>.lineitems2 does not have a stable unique name. In the future, this will prevent reloading streaming pipelines
2616 [main] WARN com.google.cloud.dataflow.sdk.Pipeline - Transform <removed>:<removed>.creative2name2 does not have a stable unique name. In the future, this will prevent reloading streaming pipelines
2616 [main] WARN com.google.cloud.dataflow.sdk.Pipeline - Transform <removed>:<removed>.adunit2site2 does not have a stable unique name. In the future, this will prevent reloading streaming pipelines
3236 [main] INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
3241 [main] INFO com.google.cloud.dataflow.sdk.util.PackageUtil - Uploading 49 files from PipelineOptions.filesToStage to staging location to prepare for execution.
41834 [main] INFO com.google.cloud.dataflow.sdk.util.PackageUtil - Uploading PipelineOptions.filesToStage complete: 10 files newly uploaded, 39 files cached
Dataflow SDK version: 0.4.150602
51003 [main] INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner - To access the Dataflow monitoring console, please navigate to https://console.developers.google.com/project/<removed>/dataflow/job/2015-06-11_16_39_02-17130055143605818331
Submitted job: 2015-06-11_16_39_02-17130055143605818331
51004 [main] INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud alpha dataflow jobs --project=<removed> cancel 2015-06-11_16_39_02-17130055143605818331
2015-06-11T23:39:02.506Z: Detail: (b056559940543e6a): Expanding GroupByKey operations into optimizable parts.
2015-06-11T23:39:02.509Z: Detail: (b056559940543d60): Annotating graph with Autotuner information.
2015-06-11T23:39:02.759Z: Detail: (b0565599405437a9): Fusing adjacent ParDo, Read, Write, and Flatten operations
2015-06-11T23:39:02.762Z: Detail: (b05655994054369f): Fusing consumer Impressions_06_2015-ParDoDFP-transform into Impressions_06_2015-BQ-Read
2015-06-11T23:39:02.764Z: Detail: (b056559940543595): Fusing consumer Impressions_06_2015-BQ-Write into Impressions_06_2015-ParDoDFP-transform
2015-06-11T23:39:02.766Z: Detail: (b05655994054348b): Fusing consumer ActiveViews_06_2015-ParDoDFP-transform into ActiveViews_06_2015-BQ-Read
2015-06-11T23:39:02.767Z: Detail: (b056559940543381): Fusing consumer ActiveViews_06_2015-BQ-Write into ActiveViews_06_2015-ParDoDFP-transform
2015-06-11T23:39:02.769Z: Detail: (b056559940543277): Fusing consumer Clicks_06_2015-ParDoDFP-transform into Clicks_06_2015-BQ-Read
2015-06-11T23:39:02.771Z: Detail: (b05655994054316d): Fusing consumer Clicks_06_2015-BQ-Write into Clicks_06_2015-ParDoDFP-transform
2015-06-11T23:39:02.818Z: Detail: (b056559940543987): Adding StepResource setup and teardown to workflow graph.
2015-06-11T23:39:18.614Z: Error: (5494fb7a460f58a8): Workflow failed. Causes: (20fbc2bb0e7cb0b1): One or more operations had an error: 'operation-1434065943092-518467f1f5b21-8d000d8a-d5cd5762': 'The resource 'projects/<removed>/zones/us-central1-a/disks/dfp-denormalization-job-1-06111639-3db5-harness-0' is not ready'.
2015-06-11T23:39:18.651Z: Detail: (4fb958a4957733a5): Cleaning up.
2015-06-11T23:40:36.126Z: Error: (d41cf136c17a5e79): Workflow failed. Causes: (20fbc2bb0e7cb0b1): One or more operations had an error: 'operation-1434065943092-518467f1f5b21-8d000d8a-d5cd5762': 'The resource 'projects/<removed>/zones/us-central1-a/disks/dfp-denormalization-job-1-06111639-3db5-harness-0' is not ready'.
2015-06-11T23:43:05.998Z: Warning: (c5964e114f42988b): Job 2015-06-11_16_39_02-17130055143605818331 is already finishing. Ignoring cancel request.
2015-06-11T23:48:04.715Z: Warning: (cf462c726cde3704): Job 2015-06-11_16_39_02-17130055143605818331 is already finishing. Ignoring cancel request.
2015-06-11T23:50:35.529Z: Warning: Internal Issue (4fb958a495773599): 65177287:8503
748739 [main] INFO com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner - Job finished with status FAILED
748740 [main] ERROR com.<removed>.cdf.dfp.DFPDenormalizationCloudDataFlowJob - Job "dfp-denormalization-job-1434066640362" failed. Job may be retried.
0[main]INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner-PipelineOptions.filesToStage。默认为类路径中的文件：将暂存49个文件。在调试级别启用日志记录以查看将暂存哪些文件。
2243[main]INFO com..cdf.dfp.DFPDenormalizationCloudDataFlowJob-已成功创建云数据流服务管道
2282[main]INFO com..cdf.dfp.DFPDenormalizationCloudDataFlowJob-找到上次加载的表。将对其进行非规范化处理：点击
2282[main]INFO com..cdf.dfp.DFPDenormalizationCloudDataFlowJob-找到上次加载的表。将对其进行非规范化处理：ActiveViews_06_2015
2282[main]INFO com..cdf.dfp.DFPDenormalizationCloudDataFlowJob-找到上次加载的表。将对其进行非规范化处理：印痕（2015年6月）
2435[main]WARN com.google.cloud.dataflow.sdk.Pipeline-Transform:。广告客户2没有稳定的唯一名称。将来，这将防止重新加载流式管道
2615[main]WARN com.google.cloud.dataflow.sdk.Pipeline-Transform:.lineitems2没有稳定的唯一名称。将来，这将防止重新加载流式管道
2616[main]WARN com.google.cloud.dataflow.sdk.Pipeline-Transform:.creative2name2没有稳定的唯一名称。将来，这将防止重新加载流式管道
2616[main]WARN com.google.cloud.dataflow.sdk.Pipeline-Transform:.adunit2site2没有稳定的唯一名称。将来，这将防止重新加载流式管道
3236[main]INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner-在数据流服务上执行管道，这将对谷歌计算引擎使用和其他谷歌云服务产生计费影响。
3241[main]INFO com.google.cloud.dataflow.sdk.util.PackageUtil-将49个文件从PipelineOptions.filesToStage上载到暂存位置以准备执行。
41834[main]INFO com.google.cloud.dataflow.sdk.util.PackageUtil-上传PipelineOptions.filesToStage完成：新上传10个文件，缓存39个文件
数据流SDK版本：0.4.150602
51003[main]INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner-要访问数据流监控控制台，请导航到https://console.developers.google.com/project//dataflow/job/2015-06-11_16_39_02-17130055143605818331
提交作业：2015-06-11_16_39_02-17130055143605818331
51004[main]INFO com.google.cloud.dataflow.sdk.runners.DataflowPipelineRunner-要使用“gcloud”工具取消作业，请运行：
>gcloud alpha数据流作业——项目=取消2015-06-11_16_39_02-17130055143605818331
2015-06-11T23:39:02.506Z:细节：（b056559940543e6a）：将GroupByKey操作扩展为可优化的部分。
2015-06-11T23:39:02.509Z:详图：（b056559940543d60）：使用自动调谐信息对图形进行注释。
2015-06-11T23:39:02.759Z:细节：（b0565599405437a9）：融合相邻ParDo、读取、写入和展平操作
2015-06-11T23:39:02.762Z:细节：（b05655994054369f）：融合消费者印象
2015-06-11T23:39:02.764Z:细节：（b056559940543595）：融合消费者印象
2015-06-11T23:39:02.766Z:细节：（b05655994054348b）：融合消费者动态视图
2015-06-11T23:39:02.767Z:细节：（b056559940543381）：融合消费者动态视图
2015-06-11T23:39:02.769Z:细节：（b056559940543277）：融合消费者点击
2015-06-11T23:39:02.771Z:细节：（b05655994054316d）：融合消费者点击量
2015-06-11T23:39:02.818Z:详细信息：（b056559940543987）：将步骤资源设置和拆卸添加到工作流图中。
2015-06-11T23:39:18.614Z:错误：（5494fb7a460f58a8）：工作流失败。原因：（20fbc2bb0e7cb0b1）：一个或多个操作出现错误：“操作-143406594392-518467f1f5b21-8d000d8a-d5cd5762”：“资源”项目//区域/us-central1-a/磁盘/dfp-denormalization-job-1-06111639-3db5-harness-0“未就绪”。
2015-06-11T23:39:18.651Z:详图：（4fb958a4957733a5）：清理。
2015-06-11T23:40:36.126Z:错误：（d41cf136c17a5e79）：工作流失败。原因：（20fbc2bb0e7cb0b1）：一个或多个操作出现错误：“操作-143406594392-518467f1f5b21-8d000d8a-d5cd5762”：“资源”项目//区域/us-central1-a/磁盘/dfp-denormalization-job-1-06111639-3db5-harness-0“未就绪”。
2015-06-11T23:43:05.998Z:警告：（c5964e114f42988b）：作业2015-06-11_16_39_02-17130055143605818331已完成。忽略取消请求。
2015-06-11T23:48:04.715Z:警告：（cf462c726cde3704）：作业2015-06-11_16_39_02-17130055143605818331已完成。忽略取消请求。
2015-06-11T23:50:35.529Z:警告：内部问题（4fb958a495773599）：65177287:8503
748739[main]INFO com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner-作业已完成，状态为失败
748740[main]错误com..cdf.dfp.DFPDenormalizationCloudDataFlowJob-作业“dfp-denormalization-Job-143406640362”失败。作业可能会重试。