Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/amazon-s3/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Amazon s3 火花S3 SocketTimeoutException_Amazon S3_Apache Spark - Fatal编程技术网

Amazon s3 火花S3 SocketTimeoutException

Amazon s3 火花S3 SocketTimeoutException,amazon-s3,apache-spark,Amazon S3,Apache Spark,我的spark应用程序在尝试下拉S3文件时遇到套接字超时异常。在我的IDE中,它可以作为Java“main”应用程序正常工作,但在本地机器上以独立模式启动./spark submit脚本时会出现如下错误 15/05/06 14:02:33 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times; aborting job Exception in thread "main" org.apache.spark.SparkExceptio

我的spark应用程序在尝试下拉S3文件时遇到套接字超时异常。在我的IDE中,它可以作为Java“main”应用程序正常工作,但在本地机器上以独立模式启动./spark submit脚本时会出现如下错误

15/05/06 14:02:33 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times;
aborting job 

Exception in thread "main" org.apache.spark.SparkException:
Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most 
recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): 

java.net.SocketTimeoutException: connect timed out
at java.net.PlainSocketImpl.socketConnect(Native Method)
在单机模式下,此代码是否在驱动程序/工作程序中运行?有什么日志我应该查一下吗

谢谢, 兰吉特