spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From patcharee <>
Subject sparkR 3rd library
Date Mon, 04 Sep 2017 06:46:40 GMT

I am using spark.lapply to execute an existing R script in standalone 
mode. This script calls a function 'rbga' from a 3rd library 'genalg'. 
This rbga function works fine in sparkR env when I call it directly, but 
when I apply this to spark.lapply I get the error

could not find function "rbga"
     at org.apache.spark.api.r.RRunner.compute(RRunner.scala:108)
     at org.apache.spark.api.r.BaseRRDD.compute(RRDD.scala:51)
     at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
     at org.apache.spark.rdd.RDD.iterator(RDD.scala

Any ideas/suggestions?

BR, Patcharee

To unsubscribe e-mail:

View raw message