spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kanth...@gmail.com
Subject Re: Does Spark SQL uses Calcite?
Date Fri, 11 Aug 2017 06:51:34 GMT
I also wonder why there isn't a jdbc connector for spark sql?

Sent from my iPhone

> On Aug 10, 2017, at 2:45 PM, Jules Damji <dmatrix@comcast.net> wrote:
> 
> Yes, it's more used in Hive than Spark 
> 
> Sent from my iPhone
> Pardon the dumb thumb typos :)
> 
>> On Aug 10, 2017, at 2:24 PM, Sathish Kumaran Vairavelu <vsathishkumaran@gmail.com>
wrote:
>> 
>> I think it is for hive dependency.
>>> On Thu, Aug 10, 2017 at 4:14 PM kant kodali <kanth909@gmail.com> wrote:
>>> Since I see a calcite dependency in Spark I wonder where Calcite is being used?
>>> 
>>>> On Thu, Aug 10, 2017 at 1:30 PM, Sathish Kumaran Vairavelu <vsathishkumaran@gmail.com>
wrote:
>>>> Spark SQL doesn't use Calcite
>>>> 
>>>>> On Thu, Aug 10, 2017 at 3:14 PM kant kodali <kanth909@gmail.com>
wrote:
>>>>> Hi All, 
>>>>> 
>>>>> Does Spark SQL uses Calcite? If so, what for? I thought the Spark SQL
has catalyst which would generate its own logical plans, physical plans and other optimizations.

>>>>> 
>>>>> Thanks,
>>>>> Kant
>>> 

Mime
View raw message