spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haopu Wang" <>
Subject RE: Can I call aggregate UDF in DataFrame?
Date Thu, 02 Apr 2015 05:13:21 GMT
Great! Thank you!



From: Reynold Xin [] 
Sent: Thursday, April 02, 2015 8:11 AM
To: Haopu Wang
Cc: user;
Subject: Re: Can I call aggregate UDF in DataFrame?


You totally can.


There is also an attempt at adding stddev here already:




On Thu, Mar 26, 2015 at 12:37 AM, Haopu Wang <>

Specifically there are only 5 aggregate functions in class
org.apache.spark.sql.GroupedData: sum/max/min/mean/count.

Can I plugin a function to calculate stddev?

Thank you!

To unsubscribe, e-mail:
For additional commands, e-mail:


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message