Scala 如何将单行单列的org.apache.spark.sql.DataFrame转换为整数值
考虑使用从spark内部查询配置单元数据Scala 如何将单行单列的org.apache.spark.sql.DataFrame转换为整数值,scala,apache-spark,hive,Scala,Apache Spark,Hive,考虑使用从spark内部查询配置单元数据 val selectMemCntQry = "select column1 from table1 where column2 = "+col_2_val val table_col2 = sparkSession.sql(selectMemCntQry) val diff = table_col2 - file_member_count 其中file\u member\u count是一个整数值。我知道表\u col2的结果总是指向一
val selectMemCntQry = "select column1 from table1 where column2 = "+col_2_val
val table_col2 = sparkSession.sql(selectMemCntQry)
val diff = table_col2 - file_member_count
其中file\u member\u count是一个整数值。我知道表\u col2的结果总是指向一个数字
我想从一个整数值中减去查询结果,但我面临的错误是
值-不是org.apache.spark.sql.DataFrame的成员
import org.apache.spark.sql.Row
val Row(colum1: Integer) = sparkSession.sql(selectMemCntQry).first
colum1 - file_member_count
或
或
sparkSession.sql(selectMemCntQry).first.getAs[Integer]("column1") - file_member_count
sparkSession.sql(selectMemCntQry).as[Integer].first - file_member_count