无法通过Kafka Connect从MongoDB向neo4j发送数据
我正在尝试使用Confluent社区平台和MongoDB和neo4j连接器将数据从MongoDB发送到neo4j。我使用的是neo4j社区版4.2.3 我将Mongo配置为源,neo4j配置为接收器。以下是我的连接器配置:无法通过Kafka Connect从MongoDB向neo4j发送数据,mongodb,apache-kafka,neo4j,apache-kafka-connect,confluent-platform,Mongodb,Apache Kafka,Neo4j,Apache Kafka Connect,Confluent Platform,我正在尝试使用Confluent社区平台和MongoDB和neo4j连接器将数据从MongoDB发送到neo4j。我使用的是neo4j社区版4.2.3 我将Mongo配置为源,neo4j配置为接收器。以下是我的连接器配置: curl -X PUT http://localhost:8083/connectors/source-mongodb-test/config -H "Content-Type: application/json" -d '{ "ta
curl -X PUT http://localhost:8083/connectors/source-mongodb-test/config -H "Content-Type: application/json" -d '{
"tasks.max":1,
"connector.class":"com.mongodb.kafka.connect.MongoSourceConnector",
"key.converter":"org.apache.kafka.connect.storage.StringConverter",
"value.converter":"org.apache.kafka.connect.storage.StringConverter",
"connection.uri":"<my-connection.uri>",
"database":"data",
"collection":"test",
"pipeline":"",
"topic.namespace.map":"{\"data\": \"default-topic\", \"data.test\": \"my-mongotesttopic\"}"
}'
然而,我无法将标题输入neo4j。我还尝试将sinkconfig中的cypher查询设置为CREATE(t:Object),当我将数据插入mongoDB时,它创建了一个带有对象标签的简单节点。因此,卡夫卡-->neo4j的连接似乎起作用。我还尝试了不同的方法来定义name属性的内容,如event.title、event.fulldocument.title等,但没有任何效果。在接收器配置中是否有我忘记的东西,或者密码查询是否有问题
提前感谢:-)因为您使用的是禁用模式的StringConverter或JSON,所以不会提取任何字段
curl -X PUT http://localhost:8083/connectors/sink-neo4j-test/config -H "Content-Type: application/json" -d '{
"topics": "my-mongotesttopic",
"connector.class": "streams.kafka.connect.sink.Neo4jSinkConnector",
"kafka.key.deserializer":"org.apache.kafka.common.serialization.ByteArrayDeserializer",
"kafka.value.deserializer":"org.apache.kafka.common.serialization.ByteArrayDeserializer",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"value.converter": "org.apache.kafka.connect.json.JsonConverter",
"value.converter.schemas.enable":"false",
"errors.retry.timeout": "-1",
"errors.retry.delay.max.ms": "1000",
"errors.tolerance": "all",
"errors.log.enable": true,
"errors.log.include.messages": true,
"neo4j.server.uri": "bolt://<myIP>:7687",
"neo4j.authentication.basic.username": "neo4j",
"neo4j.authentication.basic.password": "<password>",
"neo4j.topic.cypher.my-mongotesttopic":
"CREATE (t:Object {name: event.title})"
}'
{
"_id": {"_data": "82608B06B9000000012B022C0100296E5A1004B52723604929469DA4FBB4F1CD6C528B46645F69640064608B06B9941B272EACC036740004"},
"operationType": "insert",
"clusterTime": {
"$timestamp": {
"t": 1619723961,
"i": 1
}
},
"fullDocument": {
"_id": {"$oid": "608b06b9941b272eacc03674"},
"title": "Titel 9"
},
"ns": {
"db": "data",
"coll": "test"
},
"documentKey": {
"_id": {"$oid": "608b06b9941b272eacc03674"}
}
}