Json 通过jolt转换复制配置不同的文档
我的目标是获取子树中具有数组的输入文档,并将整个文档复制到文档副本的数组中,在每个后续副本中设置该数组中的各个值 例如: 起始文件:Json 通过jolt转换复制配置不同的文档,json,jolt,Json,Jolt,我的目标是获取子树中具有数组的输入文档,并将整个文档复制到文档副本的数组中,在每个后续副本中设置该数组中的各个值 例如: 起始文件: { "config": { "activeConfig": { "sourceDatabase": "test", "targetSites": [ { "siteName": "location1", "targetDatabase": "devl",
{
"config": {
"activeConfig": {
"sourceDatabase": "test",
"targetSites": [
{
"siteName": "location1",
"targetDatabase": "devl",
"siteShortName": "123"
},
{
"siteName": "location2",
"targetDatabase": "123",
"siteShortName": "123"
}
]
}
},
"secondData": {
"queries": [
{
"Tablename": "abc",
"Query": "123"
}
]
}
}
预期产出:
[ {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite" : {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
},
{
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite" : {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
}
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
} ]
到目前为止,我拥有的震动规范如下:
[
{
"operation": "shift",
"spec": {
"config": {
"activeConfig": {
"targetSites": {
"*": {
"@4": "[]",
"@": "[].config.activeConfig.currentSite"
}
}
}
}
}
}
]
这让我很接近,但不是很接近
[ {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ]
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
}, {
"config" : {
"activeConfig" : {
"currentSite" : {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}
}
}
}, {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ]
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
}, {
"config" : {
"activeConfig" : {
"currentSite" : {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
}
}
}
} ]
这个规范创建了我正在寻找的结构,但没有合并它们。因此,我的最终数组中包含4项,原始文档的2份副本,以及配置数组中的两项。我的目标是将配置数组中的这两个项合并到文档副本中,因此我有两个原始文档的副本,每个副本都配置了一个值
我唯一接近的另一个规格是
[
{
"operation": "shift",
"spec": {
"config": {
"activeConfig": {
"targetSites": {
"*": {
"@4": "[&]",
"@": "[&].config.activeConfig.currentSite"
}
}
}
}
}
}
]
这将在最终数组中生成两个文档副本,但currentSite部分最终会在每个副本中生成配置数组中的所有值,而不是每个副本中的1个值
[ {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ]
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
}, {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ]
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
} ]
(至于原因,本文档的下一步是将其拆分为NiFi流中的两个流文件,这将允许单独配置每个文件)
感谢您提供的任何意见或帮助
更新:
发现了另一个我很难理解的有趣行为
当我使用以下规范时,我得到的输出对我来说毫无意义
规格:
输出:
[ {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite0" : {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
},
"currentSite1" : {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
}
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
}, {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite0" : {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
},
"currentSite1" : {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
}
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
} ]
我尝试将输出路径“@”:“[&].config.activeConfig.currentSite&”更改为在两个位置使用&。这类似于我上面的第二个示例,其中两个值都在两个副本中结束,但您可以看到,在本例中,一个值在currentSite0中结束,另一个值在currentSite1中结束,在数组索引0和1中结束。这意味着在表达式“[&].config.activeConfig.currentSite&”中求值时,&的行为就像同时具有值0和1一样。很明显,我忽略了行为的一些细微差别。必须使用两班制。一般来说,在对数组执行“填充”操作时,必须对您要执行的每个“操作”执行移位操作 在您的情况下,您1)希望将内容复制到输出数组中,2)复制特定的targetsite 规格
这就解释了为什么我想不出来。。。我真的很努力想把这一切都做到一个。这看起来正是我所需要的,也教会了我更多关于震动的知识。除了提供答案外,我还感谢您的解释意见。干杯
[ {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite0" : {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
},
"currentSite1" : {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
}
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
}, {
"config" : {
"activeConfig" : {
"sourceDatabase" : "test",
"targetSites" : [ {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
}, {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
} ],
"currentSite0" : {
"siteName" : "location1",
"targetDatabase" : "devl",
"siteShortName" : "123"
},
"currentSite1" : {
"siteName" : "location2",
"targetDatabase" : "123",
"siteShortName" : "123"
}
}
},
"secondData" : {
"queries" : [ {
"Tablename" : "abc",
"Query" : "123"
} ]
}
} ]
[
// Step 1: Make the copies of the input data, based on the number
// of items in the targetSites array.
{
"operation": "shift",
"spec": {
"config": {
"activeConfig": {
"targetSites": {
"*": { // targetSites array index
// go back up 4 levels and grab the whole tree "@4"
// and write it to the output as a top level array
// indexed by the "targetSites array index"
"@4": "[&1]"
}
}
}
}
}
},
{
// Step 2 : Annoyingly copy everything across, but use the
// value of the top level array index, to copy the "right"
// data out of the targetSites array.
"operation": "shift",
"spec": {
"*": { // top level array index
"config": {
"sourceDatabase": "[&2].config.sourceDatabase", // straight copy across
"activeConfig": {
"targetSites": {
"@": "[&4].config.activeConfig.targetSites", // straight copy across
//
// Nifty but very rarely used feature.
// Use "&3" to lookup the "current" value of the top level array index
// and then use that as an index into the targetSites array, and copy
// that across as "currentSite"
"&3": "[&4].config.activeConfig.currentSite"
}
}
},
"secondData": "[&1].secondData" // straight copy across
}
}
}
]