hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15302) Relax the requirement that HoS needs Spark built w/o Hive
Date Thu, 01 Dec 2016 17:18:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15712522#comment-15712522
] 

Marcelo Vanzin commented on HIVE-15302:
---------------------------------------

bq. For #2, I think we still need SPARK_HOME unless we clone a simplified spark installation
in Hive directory structure, which is not ideal.

You can create your own command line to run the SparkSubmit class with the correct classpath
and command line arguments. That's basically all that the spark-submit script does anyway.
Since HoS's use case is a lot simpler, it shouldn't be hard to do (you don't need to support
all the different combinations or arguments that the spark-submit script handles).

> Relax the requirement that HoS needs Spark built w/o Hive
> ---------------------------------------------------------
>
>                 Key: HIVE-15302
>                 URL: https://issues.apache.org/jira/browse/HIVE-15302
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Rui Li
>            Assignee: Rui Li
>
> This requirement becomes more and more unacceptable as SparkSQL becomes widely adopted.
Let's use this JIRA to find out how we can relax the limitation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message