spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ayan guha <guha.a...@gmail.com>
Subject Re: Json Parsing.
Date Thu, 07 Dec 2017 00:37:29 GMT
On Thu, 7 Dec 2017 at 11:37 am, ayan guha <guha.ayan@gmail.com> wrote:

> You can use get_json function
>
> On Thu, 7 Dec 2017 at 10:39 am, satyajit vegesna <
> satyajit.apasprk@gmail.com> wrote:
>
>> Does spark support automatic detection of schema from a json string in a
>> dataframe.
>>
>> I am trying to parse a json string and do some transofrmations on to it
>> (would like append new columns to the dataframe) , from the data i stream
>> from kafka.
>>
>> But i am not very sure, how i can parse the json in structured streaming.
>> And i would not be interested in creating a schema, as the data form kafka
>> is going to maintain different schema objects in value column.
>>
>> Any advice or help would be appreciated.
>>
>> Regards,
>> Satyajit.
>>
> --
> Best Regards,
> Ayan Guha
>
-- 
Best Regards,
Ayan Guha

Mime
View raw message