spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: Re: spark table to hive table
Date Tue, 01 Jul 2014 22:50:25 GMT
We do support LIKE and RLIKE, though up until recently
<https://github.com/marmbrus/spark/commit/41db44c428a10f4453462d002d226798bb8fbdda>
the keywords were incorrectly case sensitive.


On Tue, Jul 1, 2014 at 11:16 AM, John Omernik <john@omernik.com> wrote:

> Michael -
>
> Does Spark SQL support rlike and like yet? I am running into that same
> error with a basic select * from table where field like '%foo%' using the
> hql() funciton.
>
> Thanks
>
>
>
>
> On Wed, May 28, 2014 at 2:22 PM, Michael Armbrust <michael@databricks.com>
> wrote:
>
>> On Tue, May 27, 2014 at 6:08 PM, JaeBoo Jung <itsjb.jung@samsung.com>
>> wrote:
>>
>>>  I already tried HiveContext as well as SqlContext.
>>>
>>> But it seems that Spark's HiveContext is not completely same as Apache
>>> Hive.
>>>
>>> For example, SQL like 'SELECT RANK() OVER(ORDER BY VAL1 ASC) FROM TEST
>>> LIMIT 10' works fine in Apache Hive,
>>>
>> Spark SQL doesn't support window functions yet (SPARK-1442
>> <https://issues.apache.org/jira/browse/SPARK-1442>).  Sorry for the
>> non-obvious error message!
>>
>
>

Mime
View raw message