spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rubén Berenguel <>
Subject Re: Do you use single-quote syntax for the DataFrame API?
Date Sun, 31 Mar 2019 14:07:26 GMT
I favour using either $”foo” or columnar expressions, but know of several
developers who prefer single quote syntax and consider it a better practice.


On 31 March 2019 at 15:15:00, Sean Owen ( wrote:

> FWIW I use "foo" in Pyspark or col("foo") where necessary, and $"foo" in
> Scala
> On Sun, Mar 31, 2019 at 1:58 AM Reynold Xin <> wrote:
>> As part of evolving the Scala language, the Scala team is considering
>> removing single-quote syntax for representing symbols. Single-quote syntax
>> is one of the ways to represent a column in Spark's DataFrame API. While I
>> personally don't use them (I prefer just using strings for column names, or
>> using expr function), I see them used quite a lot by other people's code,
>> e.g.
>>'id, 'name).show()
>> I want to bring this to more people's attention, in case they are
>> depending on this. The discussion thread is:

View raw message