spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From rapelly kartheek <kartheek.m...@gmail.com>
Subject Fwd: rsync problem
Date Fri, 19 Sep 2014 08:28:31 GMT
---------- Forwarded message ----------
From: rapelly kartheek <kartheek.mbms@gmail.com>
Date: Fri, Sep 19, 2014 at 1:51 PM
Subject: Re: rsync problem
To: Tobias Pfeiffer <tgp@preferred.jp>


any idea why the cluster is dying down???

On Fri, Sep 19, 2014 at 1:47 PM, rapelly kartheek <kartheek.mbms@gmail.com>
wrote:

> ,
>
>
> * you have copied a lot of files from various hosts to
> username@slave3:path*
> only from one node to all the other nodes...
>
> On Fri, Sep 19, 2014 at 1:45 PM, rapelly kartheek <kartheek.mbms@gmail.com
> > wrote:
>
>> Hi Tobias,
>>
>> I've copied the files from master to all the slaves.
>>
>> On Fri, Sep 19, 2014 at 1:37 PM, Tobias Pfeiffer <tgp@preferred.jp>
>> wrote:
>>
>>> Hi,
>>>
>>> On Fri, Sep 19, 2014 at 5:02 PM, rapelly kartheek <
>>> kartheek.mbms@gmail.com> wrote:
>>>>
>>>> This worked perfectly. But, I wanted to simultaneously rsync all the
>>>> slaves. So, added the other slaves as following:
>>>>
>>>> rsync -avL --progress path/to/spark-1.0.0  username@destinationhostname
>>>> :path/to/destdirectory username@slave2:path username@slave3:path and
>>>> so on.
>>>>
>>>
>>> The rsync man page says
>>>    rsync [OPTION...] SRC... [USER@]HOST:DEST
>>> so as I understand your command, you have copied a lot of files from
>>> various hosts to username@slave3:path. I don't think rsync can copy to
>>> various locations at once.
>>>
>>> Tobias
>>>
>>>
>>
>

Mime
View raw message