spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "bit1129@163.com" <bit1...@163.com>
Subject Re: RE: Explanation on the Hive in the Spark assembly
Date Sat, 14 Mar 2015 02:53:07 GMT
Thanks Daoyuan. 
What do you mean by running some native command, I never thought that hive will run without
an computing engine like Hadoop MR or spark. Thanks.



bit1129@163.com
 
From: Wang, Daoyuan
Date: 2015-03-13 16:39
To: bit1129@163.com; user
Subject: RE: Explanation on the Hive in the Spark assembly
Hi bit1129,
 
1, hive in spark assembly removed most dependencies of hive on Hadoop to avoid conflicts.
2, this hive is used to run some native command, which does not rely on spark or mapreduce.
 
Thanks,
Daoyuan
 
From: bit1129@163.com [mailto:bit1129@163.com] 
Sent: Friday, March 13, 2015 4:24 PM
To: user
Subject: Explanation on the Hive in the Spark assembly
 
Hi, sparkers,
 
I am kind of confused about hive in the spark assembly.  I think hive in the spark assembly
is not the same thing as Hive On Spark(Hive On Spark,  is meant to run hive using spark execution
engine).
So, my question is:
1. What is the difference between Hive in the spark assembly and Hive on Hadoop? 
2. Does Hive in the spark assembly use Spark execution engine or Hadoop MR engine?
Thanks.
 
 


bit1129@163.com
Mime
View raw message