Amazon web services 从AWS S3下载日志文件:运行时错误:
我要下载特定bucket中的所有日志文件(最终是我拥有的每个bucket),下面是我正在使用的代码Amazon web services 从AWS S3下载日志文件:运行时错误:,amazon-web-services,go,amazon-s3,Amazon Web Services,Go,Amazon S3,我要下载特定bucket中的所有日志文件(最终是我拥有的每个bucket),下面是我正在使用的代码 package main import ( "fmt" "os" "path/filepath" "github.com/aws/aws-sdk-go/aws" "github.com/aws/aws-sdk-go/aws/session" "github.com/aws/aws-sdk-go/service/s3" "github.co
package main
import (
"fmt"
"os"
"path/filepath"
"github.com/aws/aws-sdk-go/aws"
"github.com/aws/aws-sdk-go/aws/session"
"github.com/aws/aws-sdk-go/service/s3"
"github.com/aws/aws-sdk-go/service/s3/s3manager"
)
var (
// variables empty for security
Bucket = "" // Download from this bucket
Prefix = "" // Using this key prefix
LocalDirectory = "s3logs" // Into this directory
)
func main() {
client := s3.New(session.New(), &aws.Config{Region: aws.String("us-west-1")})
params := &s3.ListObjectsInput{Bucket: &Bucket, Prefix: &Prefix}
manager := s3manager.NewDownloader(client)
d := downloader{bucket: Bucket, dir: LocalDirectory, Downloader: manager}
client.ListObjectsPages(params, d.eachPage)
}
type downloader struct {
*s3manager.Downloader
bucket, dir string
}
func (d *downloader) eachPage(page *s3.ListObjectsOutput, more bool) bool {
for _, obj := range page.Contents {
d.downloadToFile(*obj.Key)
}
return true
}
func (d *downloader) downloadToFile(key string) {
// Create the directories in the path
file := filepath.Join(d.dir, key)
if err := os.MkdirAll(filepath.Dir(file), 0775); err != nil {
panic(err)
}
fmt.Printf("Downloading " + key)
// Setup the local file
fd, err := os.Create(file)
if err != nil {
panic(err)
}
defer fd.Close()
// Download the file using the AWS SDK
fmt.Printf("Downloading s3://%s/%s to %s...\n", d.bucket, key, file)
params := &s3.GetObjectInput{Bucket: &d.bucket, Key: &key}
d.Download(fd, params)
}
然而,当我运行这段代码时,我收到一个紧急错误
无法在s3manager.NewDownloader的参数中使用client(类型*s3.s3)作为client.ConfigProvider类型:
*s3.s3未实现client.ConfigProvider(缺少ClientConfig方法)
我不知道这段代码什么地方不起作用,有什么想法和/或修复方法您正在将
nil
传递给s3manager。新下载程序
需要会话
sess := session.New()
manager := s3manager.NewDownloader(sess)
在我的代码中,客户机变量是一个s3会话。所以我应该能够将client而不是nil传递到NewDownloader。但是,当我这样做时,我收到错误。/test.go:25:无法在s3manager.NewDownloader的参数中将client(type*s3.s3)用作client.ConfigProvider类型:*s3.s3未实现client.ConfigProvider(缺少ClientConfig方法)。我已修改了上述错误和源。我还尝试了会话上方的you's方法:=session.New()manager:=s3manager.NewDownloader(sess),但会抛出错误会话没有方法New(),我的代码基于aws示例代码。@msanti:no,
client
不是client.ConfigProvider
。只需创建一个会话,并将其用于您的客户和经理。谢谢!很抱歉给你带来了混乱