Amazon web services 将dynamodb表导出为csv数据管道
我正在尝试将DynamoDB数据作为.CSV文件导出到S3。我用过Amazon web services 将dynamodb表导出为csv数据管道,amazon-web-services,aws-cli,amazon-data-pipeline,Amazon Web Services,Aws Cli,Amazon Data Pipeline,我正在尝试将DynamoDB数据作为.CSV文件导出到S3。我用过 { "id" : "DynamoDBDataType", "type" : "CSV", "column" : [ "Name GsaDynamoDBDataType", "Score INT", "DateOfBirth TIMESTAMP" ] } 并将其与要写入的s3 bucket关联 { "directoryPath": "#{myOutputS3Loc}/#{format(
{
"id" : "DynamoDBDataType",
"type" : "CSV",
"column" : [
"Name GsaDynamoDBDataType",
"Score INT",
"DateOfBirth TIMESTAMP"
]
}
并将其与要写入的s3 bucket关联
{
"directoryPath": "#{myOutputS3Loc}/#{format(@scheduledStartTime, 'YYYY-MM-dd-HH-mm-ss')}",
"name": "S3BackupLocation",
"id": "S3BackupLocation",
"type": "S3DataNode",
"dataFormat": {
"ref": "DynamoDBDataType"
}
}
有什么想法吗?必须分两个阶段完成,首先将数据以DynamoDB的导出格式导出到S3。然后可以使用其他作业将其转换为CSV。下面是一个示例管道