Scala/Spark测试失败,带有“S”;copyAndReset必须返回零值副本;
将Spark framework从1.6切换到2.1后,运行我的测试会导致多次出现以下错误:Scala/Spark测试失败,带有“S”;copyAndReset必须返回零值副本;,scala,apache-spark,Scala,Apache Spark,将Spark framework从1.6切换到2.1后,运行我的测试会导致多次出现以下错误: [info] java.lang.AssertionError: assertion failed: copyAndReset must return a zero value copy [info] at scala.Predef$.assert(Predef.scala:170) [info] at org.apache.spark.util.AccumulatorV2.writeRep
[info] java.lang.AssertionError: assertion failed: copyAndReset must return a zero value copy
[info] at scala.Predef$.assert(Predef.scala:170)
[info] at org.apache.spark.util.AccumulatorV2.writeReplace(AccumulatorV2.scala:163)
[info] at sun.reflect.GeneratedMethodAccessor1.invoke(Unknown Source)
[info] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[info] at java.lang.reflect.Method.invoke(Method.java:497)
[info] at java.io.ObjectStreamClass.invokeWriteReplace(ObjectStreamClass.java:1075)
[info] at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1136)
[info] at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
[info] at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
[info] at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
[info] ...
你知道发生了什么事以及我如何解决这个问题吗?似乎你的代码(或你正在使用的第三方库)的某个地方假设了Spark的早期版本,特别是使用2.X中不推荐的旧累加器API,请看啊,我确实找到了对旧累加器的引用。谢谢