Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/amazon-s3/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Amazon web services 如何在S3中列出前缀下的所有对象_Amazon Web Services_Amazon S3_Boto3 - Fatal编程技术网

Amazon web services 如何在S3中列出前缀下的所有对象

Amazon web services 如何在S3中列出前缀下的所有对象,amazon-web-services,amazon-s3,boto3,Amazon Web Services,Amazon S3,Boto3,前缀下有超过3k个对象。我使用以下代码列出所有对象以获取它们的名称,但API仅检索1000个对象。 s3\u client=boto3.client('s3')) 使用分页器循环浏览多个页面。见: response = s3_client.list_objects( Bucket = "my-bucket", Prefix = "my-prefix", MaxKeys=50000 ) s3 = boto3.resource('s3') bucket = s3.Buck

前缀下有超过3k个对象。我使用以下代码列出所有对象以获取它们的名称,但API仅检索1000个对象。 s3\u client=boto3.client('s3'))


使用分页器循环浏览多个页面。见:

response = s3_client.list_objects(
    Bucket = "my-bucket",
    Prefix = "my-prefix",
    MaxKeys=50000
)


s3 = boto3.resource('s3')
bucket = s3.Bucket(S3)

print(len(response['Contents'])) # only retrieve 1000
import boto3

client = boto3.client('s3')
paginator = client.get_paginator('list_objects')
operation_parameters = {'Bucket': 'my-bucket',
                        'Prefix': 'my-prefix'}
page_iterator = paginator.paginate(**operation_parameters)
for page in page_iterator:
    print(page['Contents'])