spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vincent Warmerdam (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+
Date Mon, 06 Jul 2015 13:14:04 GMT

    [ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615007#comment-14615007
] 

Vincent Warmerdam commented on SPARK-8724:
------------------------------------------

```
spark_link <- system('cat /root/spark-ec2/cluster-url', intern=TRUE)

.libPaths(c(.libPaths(), '/root/spark/R/lib')) 
Sys.setenv(SPARK_HOME = '/root/spark') 
Sys.setenv(PATH = paste(Sys.getenv(c('PATH')), '/root/spark/bin', sep=':')) 
library(SparkR) 

sc <- sparkR.init(spark_link) 
sqlContext <- sparkRSQL.init(sc) 

cat('Spark Context available as \"sc\". \\n')
cat('Spark SQL Context available as \"sqlContext\". \\n')
```

A tutorial on how to do this will soon be available on the Rstudio blog as well. 

> Need documentation on how to deploy or use SparkR in Spark 1.4.0+
> -----------------------------------------------------------------
>
>                 Key: SPARK-8724
>                 URL: https://issues.apache.org/jira/browse/SPARK-8724
>             Project: Spark
>          Issue Type: Bug
>          Components: R
>    Affects Versions: 1.4.0
>            Reporter: Felix Cheung
>            Priority: Minor
>
> As of now there doesn't seem to be any official documentation on how to deploy SparkR
with Spark 1.4.0+
> Also, cluster manager specific documentation (like http://spark.apache.org/docs/latest/spark-standalone.html)
does not call out what mode is supported for SparkR and details on deployment steps.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message