spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ayan guha <>
Subject Re: Python vs. Scala
Date Wed, 06 Sep 2017 05:35:09 GMT
And I have just the opposite experience ie I know Python but I see scala
demands more :)

I think there are few fair points on both sides, and scala wins:

1. Feature parity: Definitely scala wins. Not only new spark features, but
if you intend to use 3rd party connectors (such as Azure services).

2. performance: no serialisation overhead as scala objects are in JVM
itself. But it is relevant ONLY for UDF/Custom Python functions.

3. Code complexity: Python is much faster to code, but this is more of

4. data science - here python is first class citizen, almost no feature gap
between scala and python api

IMHO, both has sweet spots.......and i would highly recommend to learn
python for just sake of sheer fun to code with it :)


On Wed, Sep 6, 2017 at 1:46 PM, Adaryl Wakefield <> wrote:

> Is there any performance difference in writing your application in python
> vs. scala? I’ve resisted learning Python because it’s an interpreted
> scripting language, but the market seems to be demanding Python skills.
> Adaryl "Bob" Wakefield, MBA
> Principal
> Mass Street Analytics, LLC
> 913.938.6685
> Twitter: @BobLovesData <>

Best Regards,
Ayan Guha

View raw message