spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: is it ok to make I/O calls in UDF? other words is it a standard practice ?
Date Mon, 23 Apr 2018 22:35:28 GMT
yes for sure it works. I am just not sure if it is a good idea when getting
a stream of messages from kafka?

On Mon, Apr 23, 2018 at 2:54 PM, Sathish Kumaran Vairavelu <
vsathishkumaran@gmail.com> wrote:

> I have made simple rest call within UDF and it worked but not sure if it
> can be applied for large datasets but may be for small lookup files. Thanks
>
> On Mon, Apr 23, 2018 at 4:28 PM kant kodali <kanth909@gmail.com> wrote:
>
>> Hi All,
>>
>> Is it ok to make I/O calls in UDF? other words is it a standard practice?
>>
>> Thanks!
>>
>

Mime
View raw message