Python 403使用Toil连接AWS云中的S3铲斗时禁止
我是Tail的新手,AWS试图在Tail文档中运行HelloWorld.py示例。我已经在我本地的mac笔记本电脑上成功安装了toil和相关的python软件包,并在AWS上设置了我的帐户。我已经创建了一个小型领导/工作集群Python 403使用Toil连接AWS云中的S3铲斗时禁止,python,amazon-web-services,amazon-s3,boto,Python,Amazon Web Services,Amazon S3,Boto,我是Tail的新手,AWS试图在Tail文档中运行HelloWorld.py示例。我已经在我本地的mac笔记本电脑上成功安装了toil和相关的python软件包,并在AWS上设置了我的帐户。我已经创建了一个小型领导/工作集群 $ cgcloud create-cluster toil -s 2 -t m3.large and started it: $ cgcloud ssh toil-leader 这将我的屏幕提示更改为: mesosbox@ip-172-31-25-135:~$ 然后
$ cgcloud create-cluster toil -s 2 -t m3.large
and started it:
$ cgcloud ssh toil-leader
这将我的屏幕提示更改为:
mesosbox@ip-172-31-25-135:~$
然后,在mac电脑的另一个窗口中,我使用以下命令启动了Tail HellowWorld示例:
$ python2.7 HelloWorld.py --batchSystem=mesos --mesosMaster=mesos-master:5050 aws:us-west-2:my-aws-jobstore
我得到了以下结果:
Apples-Air 2017-06-02 19:30:53,524 MainThread INFO toil.lib.bioio: Root logger is at level 'INFO', 'toil' logger at level 'INFO'.
Apples-Air 2017-06-02 19:30:53,524 MainThread INFO toil.lib.bioio: Root logger is at level 'INFO', 'toil' logger at level 'INFO'.
Apples-Air 2017-06-02 19:30:54,852 MainThread WARNING toil.jobStores.aws.jobStore: Exception during panic
Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 209, in initialize
self.destroy()
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 1334, in destroy
self._bind(create=False, block=False)
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 241, in _bind
versioning=True)
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 721, in _bindBucket
bucket = self.s3.get_bucket(bucket_name, validate=True)
File "/usr/local/lib/python2.7/site-packages/boto/s3/connection.py", line 502, in get_bucket
return self.head_bucket(bucket_name, headers=headers)
File "/usr/local/lib/python2.7/site-packages/boto/s3/connection.py", line 535, in head_bucket
raise err
S3ResponseError: S3ResponseError: 403 Forbidden
Traceback (most recent call last):
File "helloWorld.py", line 22, in <module>
print(Job.Runner.startToil(j, options)) #Prints Hello, world!, ….
File "/usr/local/lib/python2.7/site-packages/toil/job.py", line 740, in startToil
with Toil(options) as toil:
File "/usr/local/lib/python2.7/site-packages/toil/common.py", line 614, in __enter__
jobStore.initialize(config)
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 209, in initialize
self.destroy()
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 206, in initialize
self._bind(create=True)
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 241, in _bind
versioning=True)
File "/usr/local/lib/python2.7/site-packages/toil/jobStores/aws/jobStore.py", line 721, in _bindBucket
bucket = self.s3.get_bucket(bucket_name, validate=True)
File "/usr/local/lib/python2.7/site-packages/boto/s3/connection.py", line 502, in get_bucket
return self.head_bucket(bucket_name, headers=headers)
File "/usr/local/lib/python2.7/site-packages/boto/s3/connection.py", line 535, in head_bucket
raise err
boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden
Apple Air 2017-06-02 19:30:53524主线程信息oil.lib.bioio:根记录器处于“INFO”级别,“oil”记录器处于“INFO”级别。
Apple Air 2017-06-02 19:30:53524主线程信息oil.lib.biio:根记录器处于“INFO”级别,“oil”记录器处于“INFO”级别。
Apple Air 2017-06-02 19:30:54852主线程警告toil.jobStores.aws.jobStore:恐慌期间异常
回溯(最近一次呼叫最后一次):
文件“/usr/local/lib/python2.7/site packages/toil/jobStores/aws/jobStore.py”,第209行,在初始化中
自我毁灭
文件“/usr/local/lib/python2.7/site packages/oil/jobStores/aws/jobStore.py”,第1334行,在destroy中
自绑定(创建=False,块=False)
文件“/usr/local/lib/python2.7/site packages/oil/jobStores/aws/jobStore.py”,第241行,在绑定中
版本控制=真)
文件“/usr/local/lib/python2.7/site packages/oil/jobStores/aws/jobStore.py”,第721行,在_bindBucket中
bucket=self.s3.get\u bucket(bucket\u name,validate=True)
文件“/usr/local/lib/python2.7/site packages/boto/s3/connection.py”,第502行,在get_bucket中
返回self.head\u bucket(bucket\u name,headers=headers)
文件“/usr/local/lib/python2.7/site packages/boto/s3/connection.py”,第535行,在head_bucket中
提出错误
S3响应错误:S3响应错误:403禁止
回溯(最近一次呼叫最后一次):
文件“helloWorld.py”,第22行,在
打印(Job.Runner.startToil(j,选项))#打印你好,世界…。
文件“/usr/local/lib/python2.7/site packages/toil/job.py”,第740行,在startToil中
将Toil(选项)作为Toil:
文件“/usr/local/lib/python2.7/site packages/oil/common.py”,第614行,输入__
jobStore.initialize(配置)
文件“/usr/local/lib/python2.7/site packages/toil/jobStores/aws/jobStore.py”,第209行,在初始化中
自我毁灭
文件“/usr/local/lib/python2.7/site packages/toil/jobStores/aws/jobStore.py”,第206行,在初始化中
self.\u bind(create=True)
文件“/usr/local/lib/python2.7/site packages/oil/jobStores/aws/jobStore.py”,第241行,在绑定中
版本控制=真)
文件“/usr/local/lib/python2.7/site packages/oil/jobStores/aws/jobStore.py”,第721行,在_bindBucket中
bucket=self.s3.get\u bucket(bucket\u name,validate=True)
文件“/usr/local/lib/python2.7/site packages/boto/s3/connection.py”,第502行,在get_bucket中
返回self.head\u bucket(bucket\u name,headers=headers)
文件“/usr/local/lib/python2.7/site packages/boto/s3/connection.py”,第535行,在head_bucket中
提出错误
boto.exception.S3ResponseError:S3ResponseError:403禁止
请帮忙。谢谢。
---约翰我意识到这个答案有点晚了。我注意到的一个问题是中间派论点 相反,您的命令应该是
python2.7 HelloWorld.py --batchSystem=mesos --mesosMaster=172.31.25.135:5050 aws:us-west-2:my-aws-jobstore
请注意,我用来自的实际IP地址替换了mesos master
mesosbox@ip-172-31-25-135:~$
希望在未来,人们根本不需要通过这一论点,但截至2017年7月26日,这一论点尚未实施
此外,如果您想了解更多有关Toil的问题,您可能会更幸运地访问Toil Github页面。您可以访问S3存储桶吗??能够登录吗???