spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jaonary Rabarisoa <jaon...@gmail.com>
Subject Re: Need advice to create an objectfile of set of images from Spark
Date Wed, 09 Jul 2014 12:42:31 GMT
The idea is to run a job that use images as input so that each work will
process a subset of the images


On Wed, Jul 9, 2014 at 2:30 PM, Mayur Rustagi <mayur.rustagi@gmail.com>
wrote:

> RDD can only keep objects. How do you plan to encode these images so that
> they can be loaded. Keeping the whole image as a single object in 1 rdd
> would perhaps not be super optimized.
> Regards
> Mayur
>
> Mayur Rustagi
> Ph: +1 (760) 203 3257
> http://www.sigmoidanalytics.com
> @mayur_rustagi <https://twitter.com/mayur_rustagi>
>
>
>
> On Wed, Jul 9, 2014 at 12:17 PM, Jaonary Rabarisoa <jaonary@gmail.com>
> wrote:
>
>> Hi all,
>>
>> I need to run a spark job that need a set of images as input. I need
>> something that load these images as RDD but I just don't know how to do
>> that. Do some of you have any idea ?
>>
>> Cheers,
>>
>>
>> Jao
>>
>
>

Mime
View raw message