spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ?
Date Mon, 09 Oct 2017 18:38:50 GMT
Hi Koert,

Thanks! If I have this  Dataset<Seq<Map<String, X>>> what would be the
Enconding?is it Encoding.kryo(Seq.class) ?

Also shouldn't List be supported? Should I create a ticket for this?


On Mon, Oct 9, 2017 at 6:10 AM, Koert Kuipers <koert@tresata.com> wrote:

> it supports Dataset<Seq<Map<String, X>>> where X must be a supported
type
> also. Object is not a supported type.
>
> On Mon, Oct 9, 2017 at 7:36 AM, kant kodali <kanth909@gmail.com> wrote:
>
>> Hi All,
>>
>> I am wondering if spark supports Dataset<List<Map<String,Object>>>
?
>>
>> when I do the following it says no map function available?
>>
>> Dataset<List<Map<String,Object>>> resultDs = ds.map(lambda,
>> Encoders.bean(List.class));
>>
>> Thanks!
>>
>>
>>
>

Mime
View raw message