spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From janardhan shetty <janardhan...@gmail.com>
Subject Re: [Spark1.6] Or (||) operator not working in DataFrame
Date Sun, 07 Aug 2016 15:40:22 GMT
Can you try 'or' keyword instead?
On Aug 7, 2016 7:43 AM, "Divya Gehlot" <divya.htconex@gmail.com> wrote:

> Hi,
> I have use case where I need to use or[||] operator in filter condition.
> It seems its not working its taking the condition before the operator and
> ignoring the other filter condition after or operator.
> As any body faced similar issue .
>
> Psuedo code :
> df.filter(col("colName").notEqual("no_value") ||
> col("colName").notEqual(""))
>
> Am I missing something.
> Would really appreciate the help.
>
>
> Thanks,
> Divya
>

Mime
View raw message