Amazon s3 火花S3 SocketTimeoutException
我的spark应用程序在尝试下拉S3文件时遇到套接字超时异常。在我的IDE中,它可以作为Java“main”应用程序正常工作,但在本地机器上以独立模式启动./spark submit脚本时会出现如下错误Amazon s3 火花S3 SocketTimeoutException,amazon-s3,apache-spark,Amazon S3,Apache Spark,我的spark应用程序在尝试下拉S3文件时遇到套接字超时异常。在我的IDE中,它可以作为Java“main”应用程序正常工作,但在本地机器上以独立模式启动./spark submit脚本时会出现如下错误 15/05/06 14:02:33 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times; aborting job Exception in thread "main" org.apache.spark.SparkExceptio
15/05/06 14:02:33 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times;
aborting job
Exception in thread "main" org.apache.spark.SparkException:
Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most
recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost):
java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
在单机模式下,此代码是否在驱动程序/工作程序中运行?有什么日志我应该查一下吗
谢谢,
兰吉特