spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rubén Berenguel <rbereng...@gmail.com>
Subject Re: Do you use single-quote syntax for the DataFrame API?
Date Sun, 31 Mar 2019 14:07:26 GMT
I favour using either $”foo” or columnar expressions, but know of several
developers who prefer single quote syntax and consider it a better practice.

R

On 31 March 2019 at 15:15:00, Sean Owen (srowen@apache.org) wrote:

> FWIW I use "foo" in Pyspark or col("foo") where necessary, and $"foo" in
> Scala
>
> On Sun, Mar 31, 2019 at 1:58 AM Reynold Xin <rxin@databricks.com> wrote:
>
>> As part of evolving the Scala language, the Scala team is considering
>> removing single-quote syntax for representing symbols. Single-quote syntax
>> is one of the ways to represent a column in Spark's DataFrame API. While I
>> personally don't use them (I prefer just using strings for column names, or
>> using expr function), I see them used quite a lot by other people's code,
>> e.g.
>>
>> df.select('id, 'name).show()
>>
>> I want to bring this to more people's attention, in case they are
>> depending on this. The discussion thread is:
>> https://contributors.scala-lang.org/t/proposal-to-deprecate-and-remove-symbol-literals/2953
>>
>>
>>
>>

Mime
View raw message