Apache spark spark无法获取块错误

我和spark一起做了一份很大的工作。我犯了这样的错误

15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18444_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18504_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18692_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18779_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18818_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18877_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_18923_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_19109_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_19125_7412, and will not retry (0 retries)
15/07/15 18:58:17 ERROR storage.ShuffleBlockFetcherIterator: Failed to get block(s) from bhdp4005.prod.bdd.jp.local:53161
15/07/15 18:58:17 ERROR shuffle.RetryingBlockFetcher: Failed to fetch block shuffle_7_19312_7412, and will not retry (0 retries)

我不知道是什么导致了这种错误。 我正在使用Spark 1.4.0 环境方面：

---

--驱动程序内存60G--num executors 130--master warn cluster--executor内存45G

ShuffleBlockFetcheriator无法获取异常在运行的执行器尝试访问不再可用的块时会被注意到。这可能是因为前一个执行器被杀死，或者该块现在无法访问