spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yadid Ayzenberg <ya...@media.mit.edu>
Subject combining python and java in a single Spark application
Date Mon, 06 Oct 2014 18:43:51 GMT
Hello,

This may seem like a strange question, but is it possible to combine 
python and java code in a single application.
i.e. I would like to create the spark context in java and then perform 
RDD transformations in python, or use parts of MLlib in python and 
others in Java.
one solution that comes to mind is to pass the data to an external 
python process via pipe, but this seems cumbersome. Can someone provide 
a better alternative?

Yadid

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message