spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1126) spark-submit script for running compiled binaries
Date Sat, 29 Mar 2014 21:41:15 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13954464#comment-13954464
] 

ASF GitHub Bot commented on SPARK-1126:
---------------------------------------

Github user pwendell commented on the pull request:

    https://github.com/apache/spark/pull/86#issuecomment-39009977
  
    Hey @sryza I'm going to submit a PR with some suggested follow-on changes, but I think
we can go ahead and merge this for now as a starting point. Thanks for your work on this!


> spark-submit script for running compiled binaries
> -------------------------------------------------
>
>                 Key: SPARK-1126
>                 URL: https://issues.apache.org/jira/browse/SPARK-1126
>             Project: Apache Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 0.9.0
>            Reporter: Sandy Pérez González
>            Assignee: Sandy Pérez González
>            Priority: Blocker
>             Fix For: 1.0.0
>
>
> It would be useful to have a script, roughly similar to the "hadoop jar" command that
is used for running compiled binaries against Spark.
> The script would do two things:
> * Set up the Spark classpath on the client side, so that users don't need to know where
Spark jars are installed or bundle all of Spark inside their app jar.
> * Provide a layer over the different modes that apps can be run, so that the same spark-jar
invocation could run the driver inside a YARN application master or in the client process,
depending on the cluster setup.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message