Did you try the Hive Context? Look under Hive Support here:


On Tue, May 27, 2014 at 2:09 AM, 정재부 <itsjb.jung@samsung.com> wrote:

Hi all,


I'm trying to compare functions available in Spark1.0 hql to original HiveQL.

But, when I tested functions such as 'rank', Spark didn't support some HiveQL functions.

In case of Shark, it supports functions as well as Hive so I want to convert parquet file, Spark SQL table to Hive Table and analyze it with Shark.

Is there any way to do this?





Kevin Jung
Assistant Engineer / BDA Lab 
T +82-2-6155-8349 M +82-10-9288-1984
F +82-2-6155-0251 E itsjb.jung@samsung.com