Apache kafka 用于Kafka-JSON消息内容的Oracle GoldenGate适配器

Apache kafka 用于Kafka-JSON消息内容的Oracle GoldenGate适配器,apache-kafka,oracle-golden-gate,Apache Kafka,Oracle Golden Gate,在我的金门卡夫卡大数据。当我尝试更新记录时,我在json文件的after部分中只得到更新的列和主键列 {"table":"MYSCHEMATOPIC.PASSPORTS","op_type":"U","op_ts":"2018-03-17 13:57:50.000000","current_ts":"2018-03-17T13:57:53.901000","pos":"00000000030000010627","before":{"PASSPORT_ID":71541893,"PPS_ID":

在我的金门卡夫卡大数据。当我尝试更新记录时,我在json文件的after部分中只得到更新的列和主键列

{"table":"MYSCHEMATOPIC.PASSPORTS","op_type":"U","op_ts":"2018-03-17 13:57:50.000000","current_ts":"2018-03-17T13:57:53.901000","pos":"00000000030000010627","before":{"PASSPORT_ID":71541893,"PPS_ID":71541892,"PASSPORT_NO":"1234567","PASSPORT_NO_NUMERIC":241742,"PASSPORT_TYPE_ID":7,"ISSUE_DATE":null,"EXPIRY_DATE":"0060-12-21 00:00:00","ISSUE_PLACE_EN":"UN-DEFINED","ISSUE_PLACE_AR":"?????? ????????","ISSUE_COUNTRY_ID":203,"ISSUE_GOV_COUNTRY_ID":203,"IS_ACTIVE":1,"PREV_PASSPORT_ID":null,"CREATED_DATE":"2003-06-08 00:00:00","CREATED_BY":-9,"MODIFIED_DATE":null,"MODIFIED_BY":null,"IS_SETTLED":0,"MAIN_PASSPORT_PERSON_INFO_ID":34834317,"NATIONALITY_ID":590},
"after":{"PASSPORT_ID":71541893,"NATIONALITY_ID":589}}
在json out的后面部分,我想显示所有列

如何在后面部分中获取所有列

gg.handlerlist = kafkahandler
gg.handler.kafkahandler.type=kafka gg.handler.kafkahandler.KafkaProducerConfigFile=custom_kafka_producer.properties
    #The following resolves the topic name using the short table name
    gg.handler.kafkahandler.topicMappingTemplate=passports

    gg.handler.kafkahandler.format=json
    gg.handler.kafkahandler.BlockingSend =false
    gg.handler.kafkahandler.includeTokens=false
    gg.handler.kafkahandler.mode=op
    #gg.handler.kafkahandler.format.insertOpKey=I
    #gg.handler.kafkahandler.format.updateOpKey=U
    #gg.handler.kafkahandler.format.deleteOpKey=D
    #gg.handler.kafkahandler.format.truncateOpKey=T
    #gg.handler.kafkahandler.format.includeColumnNames=TRUE
    goldengate.userexit.timestamp=utc
    goldengate.userexit.writers=javawriter
    javawriter.stats.display=TRUE
    javawriter.stats.full=TRUE
    gg.log=log4j
    gg.log.level=info
  gg.report.time=30sec

尝试改用-这包括完整的有效负载。完成设置过程。

您好,此问题通过在金门侧添加以下更改得到解决


添加TRANDATA表\u name ALLCOLS

本文不再提供。在映像前后获取有效负载中的所有列的设置是什么?我已经修复了链接看起来很好,尽管我是一个合流迷,但我认为如果您忽略模式漂移方面,这一切都可以在没有合流的情况下运行?如果您不想使用Avro,是的,它只是香草Apache Kafka。但是你:)不,我同意你的看法,但是我们这里有一个用例,在这个用例中,模式漂移不是那么动态,也不是很受控制。但我在别处用过,也读过你的文章!周末好。