spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vikas Garg <sperry...@gmail.com>
Subject Re: Spark Dataset withColumn issue
Date Thu, 12 Nov 2020 15:48:24 GMT
I am deriving the col2 using with colunn which is why I cant use it like
you told me

On Thu, Nov 12, 2020, 20:11 German Schiavon <gschiavonspark@gmail.com>
wrote:

> ds.select("Col1", "Col2", "Col3")
>
> On Thu, 12 Nov 2020 at 15:28, Vikas Garg <sperry.it@gmail.com> wrote:
>
>> In Spark Datase, if we add additional column using
>> withColumn
>> then the column is added in the last.
>>
>> e.g.
>> val ds1 = ds.select("Col1", "Col3").withColumn("Col2", lit("sample"))
>>
>> the the order of columns is >> Col1  |  Col3  |  Col2
>>
>> I want the order to be  >> Col1  |  Col2  |  Col3
>>
>> How can I achieve this?
>>
>

Mime
View raw message