Avro Python from CSV-Avro.io.AvroTypeException:数据不是模式的示例
我是Avro的新手。我试图解析一个包含一个字符串值和一个int值的简单CSV文件,但我得到了一个错误:avro.io.AvroTypeException:数据不是模式的示例 我使用的模式是:Avro Python from CSV-Avro.io.AvroTypeException:数据不是模式的示例,python,avro,Python,Avro,我是Avro的新手。我试图解析一个包含一个字符串值和一个int值的简单CSV文件,但我得到了一个错误:avro.io.AvroTypeException:数据不是模式的示例 我使用的模式是: {"namespace": "paymenttransaction", "type": "record", "name": "Payment", "fields": [ {"name": "TransactionId", "type": "string"}, {"name": "I
{"namespace": "paymenttransaction",
"type": "record",
"name": "Payment",
"fields": [
{"name": "TransactionId", "type": "string"},
{"name": "Id", "type": "int"}
]
}
CSV文件包含以下内容:
TransactionId,Id
2018040101000222749,1
我为制作人运行的Python代码是:
from confluent_kafka import avro
from confluent_kafka.avro import AvroProducer
import csv
value_schema = avro.load('/home/daniela/avro/example.avsc')
AvroProducerConf = {'bootstrap.servers': 'localhost:9092',
'schema.registry.url': 'http://localhost:8081',
}
avroProducer = AvroProducer(AvroProducerConf, default_value_schema=value_schema)
with open('/home/usertest/avro/data/paymenttransactions.csv') as file:
reader = csv.DictReader(file, delimiter=",")
for row in reader:
avroProducer.produce(topic='test', value=row)
print(row)
avroProducer.flush()
我做错了什么?这是因为Id仍然是字符串,而schema需要int 尝试:
with open('/home/usertest/avro/data/paymenttransactions.csv') as file:
reader = csv.DictReader(file, delimiter=",")
for row in reader:
data_set = {"TransactionId": row["TransactionId"], "Id": int(row["Id"])}
avroProducer.produce(topic='test', value=data_set)
print(row)
avroProducer.flush()