spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael David Pedersen <michael.d.peder...@googlemail.com>
Subject Re: Efficient filtering on Spark SQL dataframes with ordered keys
Date Wed, 02 Nov 2016 17:42:46 GMT
Awesome, thank you Michael for the detailed example!

I'll look into whether I can use this approach for my use case. If so, I
could avoid the overhead of repeatedly registering a temp table for one-off
queries, instead registering the table once and relying on the injected
strategy. Don't know how much of an impact this overhead has in praxis
though.

Cheers,
Michael

Mime
View raw message