Scala 移除n+;从df开始的1行
我有一个数据帧Scala 移除n+;从df开始的1行,scala,apache-spark,apache-spark-sql,Scala,Apache Spark,Apache Spark Sql,我有一个数据帧 number time td 1 1 1 1 1 11 1 2 2 1 10 9 1 14 10 2 1 1 2 11 10 2 15 20 2 15 21 2 16 21 2 17 21 2
number time td
1 1 1
1 1 11
1 2 2
1 10 9
1 14 10
2 1 1
2 11 10
2 15 20
2 15 21
2 16 21
2 17 21
2 18 21
如果当前td>10,我需要删除第n+1行,然后移动到第n+2行,并重复此步骤
结果
number time td
1 1 1
1 1 11
1 10 9
1 14 10
2 1 1
2 11 10
2 15 20
2 16 21
2 18 21
我如何才能做到这一点?检查下面的代码
scala> df.show(false)
+------+----+---+
|number|time|td |
+------+----+---+
|1 |1 |1 |
|1 |1 |11 |
|1 |2 |2 |
|1 |10 |9 |
|1 |14 |10 |
|2 |1 |1 |
|2 |11 |10 |
|2 |15 |20 |
|2 |15 |21 |
|2 |16 |21 |
|2 |17 |21 |
|2 |18 |21 |
+------+----+---+
输出
+------+----+---+
|number|time|td |
+------+----+---+
|1 |1 |1 |
|1 |1 |11 |
|1 |10 |9 |
|1 |14 |10 |
|2 |1 |1 |
|2 |11 |10 |
|2 |15 |20 |
|2 |16 |21 |
|2 |18 |21 |
+------+----+---+
+------+----+---+
|number|time|td |
+------+----+---+
|1 |1 |1 |
|1 |1 |11 |
|1 |10 |9 |
|1 |14 |10 |
|2 |1 |1 |
|2 |11 |10 |
|2 |15 |20 |
|2 |16 |21 |
|2 |18 |21 |
+------+----+---+