spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wang, Daoyuan" <daoyuan.w...@intel.com>
Subject RE: IF statement doesn't work in Spark-SQL?
Date Tue, 20 Jan 2015 09:59:59 GMT
Hi Xuelin,

What version of Spark are you using?

Thanks,
Daoyuan

From: Xuelin Cao [mailto:xuelincao2014@gmail.com]
Sent: Tuesday, January 20, 2015 5:22 PM
To: User
Subject: IF statement doesn't work in Spark-SQL?


Hi,

      I'm trying to migrate some hive scripts to Spark-SQL. However, I found some statement
is incompatible in Spark-sql.

      Here is my SQL. And the same SQL works fine in HIVE environment.

    SELECT
      if(ad_user_id>1000, 1000, ad_user_id) as user_id
    FROM
      ad_search_keywords

     What I found is, the parser reports error on the "if" statement:

No function to evaluate expression. type: AttributeReference, tree: ad_user_id#4


     Anyone have any idea about this?


Mime
View raw message