spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jungtaek Lim <kabh...@gmail.com>
Subject Re: is it ok to make I/O calls in UDF? other words is it a standard practice ?
Date Tue, 24 Apr 2018 22:58:56 GMT
Another thing you may want to be aware is, if the result is not idempotent,
your query result is also not idempotent. For fault-tolerance there's a
chance for record (row) to be replayed (recomputed).

-Jungtaek Lim (HeartSaVioR)

2018년 4월 24일 (화) 오후 2:07, Jörn Franke <jornfranke@gmail.com>님이 작성:

> What is your use case?
>
> > On 23. Apr 2018, at 23:27, kant kodali <kanth909@gmail.com> wrote:
> >
> > Hi All,
> >
> > Is it ok to make I/O calls in UDF? other words is it a standard practice?
> >
> > Thanks!
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>

Mime
View raw message