spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nicholas Chammas <nicholas.cham...@gmail.com>
Subject Re: Scala Vs Python
Date Fri, 02 Sep 2016 15:03:59 GMT
I apologize for my harsh tone. You are right, it was unnecessary and
discourteous.

On Fri, Sep 2, 2016 at 11:01 AM Mich Talebzadeh <mich.talebzadeh@gmail.com>
wrote:

> Hi,
>
> You made such statement:
>
> "That's complete nonsense."
>
> That is a strong language and void of any courtesy. Only dogmatic
> individuals make such statements, engaging the keyboard before thinking
> about it.
>
> You are perfectly in your right to agree to differ. However, that does not
> give you the right to call other peoples opinion nonsense.
>
>
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
> On 2 September 2016 at 15:54, Nicholas Chammas <nicholas.chammas@gmail.com
> > wrote:
>
>> You made a specific claim -- that Spark will move away from Python --
>> which I responded to with clear references and data. How on earth is that a
>> "religious argument"?
>>
>> I'm not saying that Python is better than Scala or anything like that.
>> I'm just addressing your specific claim about its future in the Spark
>> project.
>>
>> On Fri, Sep 2, 2016 at 10:48 AM Mich Talebzadeh <
>> mich.talebzadeh@gmail.com> wrote:
>>
>>> Right so. We are back into religious arguments. Best of luck
>>>
>>>
>>>
>>> Dr Mich Talebzadeh
>>>
>>>
>>>
>>> LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>
>>>
>>>
>>> http://talebzadehmich.wordpress.com
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>> On 2 September 2016 at 15:35, Nicholas Chammas <
>>> nicholas.chammas@gmail.com> wrote:
>>>
>>>> On Fri, Sep 2, 2016 at 3:58 AM Mich Talebzadeh <
>>>> mich.talebzadeh@gmail.com> wrote:
>>>>
>>>>> I believe as we progress in time Spark is going to move away from
>>>>> Python. If you look at 2014 Databricks code examples, they were
>>>>> mostly in Python. Now they are mostly in Scala for a reason.
>>>>>
>>>>
>>>> That's complete nonsense.
>>>>
>>>> First off, you can find dozens and dozens of Python code examples here:
>>>> https://github.com/apache/spark/tree/master/examples/src/main/python
>>>>
>>>> The Python API was added to Spark in 0.7.0
>>>> <http://spark.apache.org/news/spark-0-7-0-released.html>, back in
>>>> February of 2013, before Spark was even accepted into the Apache incubator.
>>>> Since then it's undergone major and continuous development. Though it does
>>>> lag behind the Scala API in some areas, it's a first-class language and
>>>> bringing it up to parity with Scala is an explicit project goal. A quick
>>>> example off the top of my head is all the work that's going into model
>>>> import/export for Python: SPARK-11939
>>>> <https://issues.apache.org/jira/browse/SPARK-11939>
>>>>
>>>> Additionally, according to the 2015 Spark Survey
>>>> <http://cdn2.hubspot.net/hubfs/438089/DataBricks_Surveys_-_Content/Spark-Survey-2015-Infographic.pdf?t=1472746902480>,
>>>> 58% of Spark users use the Python API, more than any other language save
>>>> for Scala (71%). (Users can select multiple languages on the survey.)
>>>> Python users were also the 3rd-fastest growing "demographic" for Spark,
>>>> after Windows and Spark Streaming users.
>>>>
>>>> Any notion that Spark is going to "move away from Python" is completely
>>>> contradicted by the facts.
>>>>
>>>> Nick
>>>>
>>>>
>>>
>

Mime
View raw message