Graph OrientDB ETL查询边缘查找-如何访问$input?
我正在尽我最大的努力从我一直保存在MongoDB中的一个大数据集进行ETL导入。我已经成功导入了顶点,我觉得我离导入边还有一点距离 我很确定错误在这个变压器中:Graph OrientDB ETL查询边缘查找-如何访问$input?,graph,etl,orientdb,Graph,Etl,Orientdb,我正在尽我最大的努力从我一直保存在MongoDB中的一个大数据集进行ETL导入。我已经成功导入了顶点,我觉得我离导入边还有一点距离 我很确定错误在这个变压器中: {"edge":{"class":"Friend", "joinFieldName":"id", "lookup": "select from Character WHERE $input.id IN character_friends", "unresolvedLinkAction":"CREATE"}}, 所以我要做的是
{"edge":{"class":"Friend", "joinFieldName":"id",
"lookup": "select from Character WHERE $input.id IN character_friends",
"unresolvedLinkAction":"CREATE"}},
所以我要做的是使id=FOO的文档与字符数组中包含FOO的所有其他文档有一条边。
如果我执行
select from Character WHERE FOO IN character_friends
在浏览器中,我得到了大量文档,因此我猜我的问题是$input.id要么没有返回我期望的id,要么根本没有被识别为变量
文档如下所示:
{
id: FOO,
character_friends: [BAR, BAZ, QUX]
(and a bunch of other junk)
}
似乎您正在插入一个属性“id”,但它保留在蓝图标准中。您可以将其重命名(使用“field”transformers)或在Orient Loader中进行设置:
standardElementConstraints: false,
然后我创建了文件/temp/datasets/charles.json,其中包含以下内容:
[
{
name: "Joe",
id: 1,
friends: [2,4,5],
enemies: [6]
},
{
name: "Suzie",
id: 2,
friends: [1,4,6],
enemies: [5,2]
}
]
这条管道:
{
config: {
log: "debug",
parallel: false
},
source : {
file: { path: "/temp/datasets/charles.json", lock : true }
},
extractor : {
json: {}
},
transformers : [
{ merge: { joinFieldName:"id", lookup:"Account.id" } },
{ vertex: { class: "Account"} },
{ edge: {
"class": "Friend",
"joinFieldName": "friends",
"lookup": "Account.id",
"unresolvedLinkAction": "CREATE"
} },
{ edge: {
"class": "Enemy",
"joinFieldName": "enemies",
"lookup": "Account.id",
"unresolvedLinkAction": "CREATE"
} }
],
loader : {
orientdb: {
dbURL: "plocal:/temp/databases/charles",
dbUser: "admin",
dbPassword: "admin",
dbAutoDropIfExists: true,
dbAutoCreate: true,
standardElementConstraints: false,
tx: false,
wal: false,
batchCommit: 1000,
dbType: "graph",
classes: [{name: 'Account', extends:"V"}, {name: 'Friend', extends:"E"}, {name: 'Enemy', extends:"E"}],
indexes: [{class:"Account", fields:["id:integer"], type:"UNIQUE_HASH_INDEX" }]
}
}
}
确保使用默认版本的ETL jar的最新版本(替换为$ORIENTDB/lib)。最新版本可从以下网站下载:
或者获取专业的OrientDB ETL 2.0.2