spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Davies <michael.belldav...@gmail.com>
Subject Re: Will higher order functions in spark SQL be pushed upstream?
Date Thu, 19 Apr 2018 18:51:07 GMT
Hi Herman, 

That’s great and thanks for quick reply. The JIRA has an example of transform and refers
to a presto doc with lots of functions. Do you know which functions will be supported. I am
interested in using filter for example.

Cheers

Mick


> On 19 Apr 2018, at 10:46, Herman van Hövell tot Westerflier <herman@databricks.com>
wrote:
> 
> Hi Mick,
> 
> Higher order functions will be in the next release of Spark (2.4). See SPARK-23908 <https://issues.apache.org/jira/browse/SPARK-23908>
for more information. The PR should be out in a few weeks.
> 
> - Herman
> 
> On Thu, Apr 19, 2018 at 11:20 AM, Mick Davies <michael.belldavies@gmail.com <mailto:michael.belldavies@gmail.com>>
wrote:
> Hi,
> Regarding higher order functions
> 
> > Yes, we intend to contribute this to open source.
> 
> It doesn't look like this is in 2.3.0, at least I can't find it.
> 
> Do you know when it might reach open source.
> 
> Thanks
> 
> Mick
> 
> 
> 
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ <http://apache-spark-developers-list.1001551.n3.nabble.com/>
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org <mailto:dev-unsubscribe@spark.apache.org>
> 
> 


Mime
View raw message