I am trying to filter a DataFrame by storing only those rows for which a particular column of the row is not empty.
The operation is as follows:
df.filter($"stringColumn" !== "")
My compiler shows that! == deprecated since I upgraded to Spark 2.0.1
How to check if row column value is empty in Spark> 2.0?
source
share