spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Larry Xiao (JIRA)" <>
Subject [jira] [Commented] (SPARK-1986) lib.Analytics should be in org.apache.spark.examples
Date Mon, 04 Aug 2014 08:22:11 GMT


Larry Xiao commented on SPARK-1986:

Hi Ankur
Yes I like Analytics to be in examples
And I'd like to take on this issue

> lib.Analytics should be in org.apache.spark.examples
> ----------------------------------------------------
>                 Key: SPARK-1986
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: GraphX
>            Reporter: Ankur Dave
>            Assignee: Ankur Dave
> The org.apache.spark.graphx.lib.Analytics driver is currently hard to run; the user has
to figure out the correct invocation involving spark-submit. Instead, it should be put into
the examples package to enable running it using bin/run-example.
> Here is how Analytics must be invoked currently:
> {code}
> ~/spark/bin/spark-submit --master spark://$(wget -q -O -
--class org.apache.spark.graphx.lib.Analytics ~/spark/assembly/target/scala-2.10/spark-assembly-1.1.0-SNAPSHOT-hadoop1.0.4.jar
triangles /soc-LiveJournal1.txt --numEPart=256
> {code}
> Any JAR can be supplied in place of the assembly jar, as long as it exists.
> Here is how it will be invoked after this issue is fixed:
> {code}
> MASTER=spark://$(wget -q -O -
~/spark/bin/run-example GraphXAnalytics triangles /soc-LiveJournal1.txt --numEPart=256
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message