Amazon ec2 麻省理工学院';s星簇错误,超过200+;节点

Amazon ec2 麻省理工学院';s星簇错误,超过200+;节点,amazon-ec2,starcluster,Amazon Ec2,Starcluster,是否有人遇到过集群大小大于200个节点的问题?无论何时尝试,都会出现以下错误: 7/dist-packages/boto/ec2/connection.py", line 585, in get_all_instances  max_results=max_results)  File "/usr/local/lib/python2.7/dist-packages/boto/ec2/connection.py", line 681, in get_all_reservations    [(

是否有人遇到过集群大小大于200个节点的问题?无论何时尝试,都会出现以下错误:

7/dist-packages/boto/ec2/connection.py", line 585, in get_all_instances
   max_results=max_results)
 File "/usr/local/lib/python2.7/dist-packages/boto/ec2/connection.py", line 681, in get_all_reservations
   [('item', Reservation)], verb='POST')
 File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 1186, in get_list
   raise self.ResponseError(response.status, response.reason, body)
EC2ResponseError: EC2ResponseError: 400 Bad Request
<?xml version="1.0" encoding="UTF-8"?>
<Response><Errors><Error><Code>FilterLimitExceeded</Code><Message>The maximum number of filter values specified on a single call is 200</Message></Error></Errors><RequestID>290b6e93-22b4-4450-b487-64d9174d166e</RequestID></Response>
我正在使用starcluster开发分支0.95.6,因为它支持较新的c4 ec2实例

下面是我的星团配置,XXXX代替了私人信息:

####################################
## StarCluster Configuration File ##
####################################
[global]

DEFAULT_TEMPLATE=cluster

#############################################
## AWS Credentials and Connection Settings ##
#############################################
[aws info]

AWS_ACCESS_KEY_ID = XXXXXXX
AWS_SECRET_ACCESS_KEY = XXXXXXXX
AWS_USER_ID=XXXXXX

AWS_REGION_NAME = eu-east-1


###########################
## Defining EC2 Keypairs ##
###########################

[key mykey]
KEY_LOCATION= XXXXXX


################################
## Defining Cluster Templates ##
################################


[cluster cluster]
KEYNAME = mykey
CLUSTER_SIZE = 400
CLUSTER_USER = sgeadmin

CLUSTER_SHELL = bash

NODE_IMAGE_ID = ami-52a0c53b

NODE_INSTANCE_TYPE = c4.large

AVAILABILITY_ZONE = us-east-1a

VOLUMES = cluster, datastore

PERMISSIONS = ssh

SPOT_BID = 0.07



#############################
## Configuring EBS Volumes ##
#############################

[volume cluster]
VOLUME_ID = xxxxx
MOUNT_PATH = /home

[volume datastore]
VOLUME_ID = xxxxx
MOUNT_PATH = /data/


############################################
## Configuring Security Group Permissions ##
############################################

[permission ssh]
IP_PROTOCOL = tcp
FROM_PORT = 22
TO_PORT = 22

这看起来像是由AWS api中的限制引起的StarCluster错误。StarCluster发送一个包含200多个项目的筛选列表,该列表被AWS拒绝。应该制作一个补丁,以便StarCluster发送多个请求。

您可以粘贴Connection.py文件吗?Connections.py文件: