Did you try the Hive Context? Look under Hive Support here:

http://people.apache.org/~pwendell/catalyst-docs/sql-programming-guide.html




On Tue, May 27, 2014 at 2:09 AM, 정재부 <itsjb.jung@samsung.com> wrote:

Hi all,

 

I'm trying to compare functions available in Spark1.0 hql to original HiveQL.

But, when I tested functions such as 'rank', Spark didn't support some HiveQL functions.

In case of Shark, it supports functions as well as Hive so I want to convert parquet file, Spark SQL table to Hive Table and analyze it with Shark.

Is there any way to do this?

 

Thanks,

Kevin

_____________________________________________

Kevin Jung
Assistant Engineer / BDA Lab 
T +82-2-6155-8349 M +82-10-9288-1984
F +82-2-6155-0251 E itsjb.jung@samsung.com


www.sds.samsung.com