spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ayan guha <guha.a...@gmail.com>
Subject Re: Python vs. Scala
Date Wed, 06 Sep 2017 05:35:09 GMT
And I have just the opposite experience ie I know Python but I see scala
demands more :)

I think there are few fair points on both sides, and scala wins:

1. Feature parity: Definitely scala wins. Not only new spark features, but
if you intend to use 3rd party connectors (such as Azure services).

2. performance: no serialisation overhead as scala objects are in JVM
itself. But it is relevant ONLY for UDF/Custom Python functions.

3. Code complexity: Python is much faster to code, but this is more of
choice....

4. data science - here python is first class citizen, almost no feature gap
between scala and python api

IMHO, both has sweet spots.......and i would highly recommend to learn
python for just sake of sheer fun to code with it :)

best
Ayan

On Wed, Sep 6, 2017 at 1:46 PM, Adaryl Wakefield <
adaryl.wakefield@hotmail.com> wrote:

> Is there any performance difference in writing your application in python
> vs. scala? I’ve resisted learning Python because it’s an interpreted
> scripting language, but the market seems to be demanding Python skills.
>
>
>
> Adaryl "Bob" Wakefield, MBA
> Principal
> Mass Street Analytics, LLC
> 913.938.6685
>
> www.massstreet.net
>
> www.linkedin.com/in/bobwakefieldmba
> Twitter: @BobLovesData <http://twitter.com/BobLovesData>
>
>
>



-- 
Best Regards,
Ayan Guha

Mime
View raw message