将卡夫卡流数据从C#库摄取到德鲁伊
在过去的几天里,我一直试图将卡夫卡的一些数据吸收到德鲁伊身上,但直到现在,我失败得很惨 我正在使用Confluent的C#库创建一些基本数据,如下所示:将卡夫卡流数据从C#库摄取到德鲁伊,c#,apache-kafka,druid,confluent-platform,C#,Apache Kafka,Druid,Confluent Platform,在过去的几天里,我一直试图将卡夫卡的一些数据吸收到德鲁伊身上,但直到现在,我失败得很惨 我正在使用Confluent的C#库创建一些基本数据,如下所示: using (var p = new ProducerBuilder<string, string>(config).Build()) { try { var dr = await p.ProduceAsync("Test", new M
using (var p = new ProducerBuilder<string, string>(config).Build())
{
try
{
var dr = await p.ProduceAsync("Test", new Message<string, string> { Key = "Random", Value = i.ToString(), Timestamp = new Timestamp(DateTime.UtcNow, TimestampType.CreateTime) });
Console.WriteLine($"Delivered '{dr.Value}' to '{dr.TopicPartitionOffset}'");
p.Flush(TimeSpan.FromSeconds(10));
}
我希望有人能在那里发现错误
提前谢谢
编辑:
由摄取任务创建的日志
{
"0": {
"index_kafka_Test_4b0ecd3ab842a29_bebmfiod": {
"movingAverages": {
"buildSegments": {
"5m": {
"processed": 0,
"unparseable": 1,
"thrownAway": 0,
"processedWithError": 0
},
"15m": {
"processed": 0,
"unparseable": 1,
"thrownAway": 0,
"processedWithError": 0
},
"1m": {
"processed": 0,
"unparseable": 1,
"thrownAway": 0,
"processedWithError": 0
}
}
},
"totals": {
"buildSegments": {
"processed": 0,
"processedWithError": 0,
"thrownAway": 0,
"unparseable": 8
}
}
}
}
}
你能分享完整的错误跟踪吗?很遗憾,我没有看到错误跟踪。只有任务的一个状态,请稍等@Giorgosmyriantous我编辑了这个问题,并将其添加到日志中,我读了日志,也许这会有用?你能分享完整的错误跟踪吗?很遗憾,我没有看到错误跟踪。只有任务的一个状态,请稍等@Giorgosmyriantous我编辑了这个问题,并将其添加到日志中,我读了日志,也许这会有用?
{
"0": {
"index_kafka_Test_4b0ecd3ab842a29_bebmfiod": {
"movingAverages": {
"buildSegments": {
"5m": {
"processed": 0,
"unparseable": 1,
"thrownAway": 0,
"processedWithError": 0
},
"15m": {
"processed": 0,
"unparseable": 1,
"thrownAway": 0,
"processedWithError": 0
},
"1m": {
"processed": 0,
"unparseable": 1,
"thrownAway": 0,
"processedWithError": 0
}
}
},
"totals": {
"buildSegments": {
"processed": 0,
"processedWithError": 0,
"thrownAway": 0,
"unparseable": 8
}
}
}
}
}