spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Larry Xiao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1986) lib.Analytics should be in org.apache.spark.examples
Date Mon, 04 Aug 2014 08:22:11 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084423#comment-14084423
] 

Larry Xiao commented on SPARK-1986:
-----------------------------------

Hi Ankur
Yes I like Analytics to be in examples
And I'd like to take on this issue

> lib.Analytics should be in org.apache.spark.examples
> ----------------------------------------------------
>
>                 Key: SPARK-1986
>                 URL: https://issues.apache.org/jira/browse/SPARK-1986
>             Project: Spark
>          Issue Type: Improvement
>          Components: GraphX
>            Reporter: Ankur Dave
>            Assignee: Ankur Dave
>
> The org.apache.spark.graphx.lib.Analytics driver is currently hard to run; the user has
to figure out the correct invocation involving spark-submit. Instead, it should be put into
the examples package to enable running it using bin/run-example.
> Here is how Analytics must be invoked currently:
> {code}
> ~/spark/bin/spark-submit --master spark://$(wget -q -O - http://169.254.169.254/latest/meta-data/public-hostname):7077
--class org.apache.spark.graphx.lib.Analytics ~/spark/assembly/target/scala-2.10/spark-assembly-1.1.0-SNAPSHOT-hadoop1.0.4.jar
triangles /soc-LiveJournal1.txt --numEPart=256
> {code}
> Any JAR can be supplied in place of the assembly jar, as long as it exists.
> Here is how it will be invoked after this issue is fixed:
> {code}
> MASTER=spark://$(wget -q -O - http://169.254.169.254/latest/meta-data/public-hostname):7077
~/spark/bin/run-example GraphXAnalytics triangles /soc-LiveJournal1.txt --numEPart=256
> {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message