spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <hol...@pigscanfly.ca>
Subject Re: Loop through Dataframes
Date Mon, 07 Oct 2019 00:40:53 GMT
So if you want to process the contents of a dataframe locally but not pull
all of the data back at once toLocaliterator is probably what you're
looking for, it's still not great though so maybe you can share the root
problem which your trying to solve and folks might have some suggestions
there.

On Sun, Oct 6, 2019 at 2:49 PM KhajaAsmath Mohammed <mdkhajaasmath@gmail.com>
wrote:

>
> Hi,
>
> What is the best approach to loop through 3 dataframes in scala based on
> some keys instead of using collect.
>
> Thanks,
> Asmath
>


-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Mime
View raw message