spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yash Sharma <>
Subject Re: Python to Scala
Date Sat, 18 Jun 2016 06:13:15 GMT
Couple of things that can work-
- If you know the logic- just forget the python script and write it in
java/scala from scratch
- If you have python functions and libraries used- Pyspark is probably the
best bet.
- If you have specific questions on how to solve a particular
implementation issue you are facing- ask it here :)

Apart from that its really difficult to understand what you are asking.

- Thanks, via mobile,  excuse brevity.
On Jun 18, 2016 3:27 PM, "Aakash Basu" <> wrote:

> I don't have a sound knowledge in Python and on the other hand we are
> working on Spark on Scala, so I don't think it will be allowed to run
> PySpark along with it, so the requirement is to convert the code to scala
> and use it. But I'm finding it difficult.
> Did not find a better forum for help than ours. Hence this mail.
> On 18-Jun-2016 10:39 AM, "Stephen Boesch" <> wrote:
>> What are you expecting us to do?  Yash provided a reasonable approach -
>> based on the info you had provided in prior emails.  Otherwise you can
>> convert it from python to spark - or find someone else who feels
>> comfortable to do it.  That kind of inquiry would likelybe appropriate on a
>> job board.
>> 2016-06-17 21:47 GMT-07:00 Aakash Basu <>:
>>> Hey,
>>> Our complete project is in Spark on Scala, I code in Scala for Spark,
>>> though am new, but I know it and still learning. But I need help in
>>> converting this code to Scala. I've nearly no knowledge in Python, hence,
>>> requested the experts here.
>>> Hope you get me now.
>>> Thanks,
>>> Aakash.
>>> On 18-Jun-2016 10:07 AM, "Yash Sharma" <> wrote:
>>>> You could use pyspark to run the python code on spark directly. That
>>>> will cut the effort of learning scala.
>>>> - Thanks, via mobile,  excuse brevity.
>>>> On Jun 18, 2016 2:34 PM, "Aakash Basu" <> wrote:
>>>>> Hi all,
>>>>> I've a python code, which I want to convert to Scala for using it in
>>>>> Spark program. I'm not so well acquainted with python and learning scala
>>>>> now. Any Python+Scala expert here? Can someone help me out in this please?
>>>>> Thanks & Regards,
>>>>> Aakash.

View raw message