spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yeikel <em...@yeikel.com>
Subject Re: "where" clause able to access fields not in its schema
Date Thu, 14 Feb 2019 01:03:51 GMT
This is indeed strange. To add to the question , I can see that if I use a
filter I get an exception (as expected) , so I am not sure what's the
difference between the  where clause and filter : 


b.filter(s=> {
val bar : String = s.getAs("bar")

bar.equals("20")
}).show

* java.lang.IllegalArgumentException: Field "bar" does not exist.*





--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message