spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Russell Spitzer <russell.spit...@gmail.com>
Subject Re: Select top (100) percent equivalent in spark
Date Tue, 04 Sep 2018 20:45:29 GMT
RDD: Top
http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.rdd.RDD@top(num:Int)(implicitord:Ordering[T]):Array[T
]
Which is pretty much what Sean suggested

For Dataframes I think doing a order and limit would be equivalent after
optimizations.

On Tue, Sep 4, 2018 at 2:28 PM Sean Owen <srowen@gmail.com> wrote:

> Sort and take head(n)?
>
> On Tue, Sep 4, 2018 at 12:07 PM Chetan Khatri <chetan.opensource@gmail.com>
> wrote:
>
>> Dear Spark dev, anything equivalent in spark ?
>>
>

Mime
View raw message