spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-17605) Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr
Date Fri, 17 Feb 2017 09:13:41 GMT

     [ https://issues.apache.org/jira/browse/SPARK-17605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen resolved SPARK-17605.
-------------------------------
    Resolution: Won't Fix

> Add option spark.usePython and spark.useR for applications that use both pyspark and
sparkr
> -------------------------------------------------------------------------------------------
>
>                 Key: SPARK-17605
>                 URL: https://issues.apache.org/jira/browse/SPARK-17605
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Submit
>            Reporter: Jeff Zhang
>
> For applications (zeppelin & livy ) that use both pyspark and sparkr, we have to
duplicate the code in SparkSubmit to figure the where is the requirement resources for pyspark
& sparkr (pyspark.zip, py4j, sparkr.zip and R file in jars). It would be better to provide
option spark.usePython and spark.useR, so that downstream project which use both pyspark and
sparkr in one spark application don't need to duplicate the code in SparkSubmit, can just
leverage these 2 options. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message