Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Scala/Spark测试失败,带有“S”;copyAndReset必须返回零值副本;_Scala_Apache Spark - Fatal编程技术网

Scala/Spark测试失败,带有“S”;copyAndReset必须返回零值副本;

Scala/Spark测试失败,带有“S”;copyAndReset必须返回零值副本;,scala,apache-spark,Scala,Apache Spark,将Spark framework从1.6切换到2.1后,运行我的测试会导致多次出现以下错误: [info] java.lang.AssertionError: assertion failed: copyAndReset must return a zero value copy [info] at scala.Predef$.assert(Predef.scala:170) [info] at org.apache.spark.util.AccumulatorV2.writeRep

将Spark framework从1.6切换到2.1后,运行我的测试会导致多次出现以下错误:

[info]   java.lang.AssertionError: assertion failed: copyAndReset must return a zero value copy
[info]   at scala.Predef$.assert(Predef.scala:170)
[info]   at org.apache.spark.util.AccumulatorV2.writeReplace(AccumulatorV2.scala:163)
[info]   at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
[info]   at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[info]   at java.lang.reflect.Method.invoke(Method.java:497)
[info]   at java.io.ObjectStreamClass.invokeWriteReplace(ObjectStreamClass.java:1075)
[info]   at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1136)
[info]   at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
[info]   at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
[info]   at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
[info]   ...

你知道发生了什么事以及我如何解决这个问题吗?

似乎你的代码(或你正在使用的第三方库)的某个地方假设了Spark的早期版本,特别是使用2.X中不推荐的旧累加器API,请看啊,我确实找到了对旧累加器的引用。谢谢