Warning: file_get_contents(/data/phpspider/zhask/data//catemap/9/java/314.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Java Avro生成的对象可序列化问题_Java_Apache Spark_Avro - Fatal编程技术网

Java Avro生成的对象可序列化问题

Java Avro生成的对象可序列化问题,java,apache-spark,avro,Java,Apache Spark,Avro,我在JAVA spark代码中使用Avro生成的对象。但是,当我将对象放入lambda时,它抛出序列化异常。下面是代码。请注意,我的AvroEntity不是一个简单的Pojo,而是一个嵌套的实体类 JavaPairRDD<AvroEntity, Double> entityPairRDD = entityJavaRDD.mapToPair(new PairFunction<AvroEntity, AvroEntity, Double>() {

我在JAVA spark代码中使用Avro生成的对象。但是,当我将对象放入lambda时,它抛出序列化异常。下面是代码。请注意,我的AvroEntity不是一个简单的Pojo,而是一个嵌套的实体类

        JavaPairRDD<AvroEntity, Double> entityPairRDD = entityJavaRDD.mapToPair(new PairFunction<AvroEntity, AvroEntity, Double>() {
            @Override
            public Tuple2<AvroEntity, Double> call(AvroEntity avroEntity) throws Exception {
                return new Tuple2<>(AvroEntity, 1.0);
            }
        });
    compile('org.apache.avro:avro:1.8.2') {
             exclude group: 'org.slf4j', module: 'slf4j-log4j12' 
    }