spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: Cant start master on windows 7
Date Tue, 01 Dec 2015 08:33:30 GMT
Neat! It should be part of the docs.

Do you also happen to know why people are seeing the weird networking
problems with unresolvable network addresses? It looks the issue is
"polluting" Spark mailing list/SO quite often. Why don't you run into
the issue? Did you change anything network-related? Thanks for any
help!

Pozdrawiam,
Jacek

--
Jacek Laskowski | https://medium.com/@jaceklaskowski/ |
http://blog.jaceklaskowski.pl
Mastering Spark https://jaceklaskowski.gitbooks.io/mastering-apache-spark/
Follow me at https://twitter.com/jaceklaskowski
Upvote at http://stackoverflow.com/users/1305344/jacek-laskowski


On Mon, Nov 30, 2015 at 10:44 PM, Tim Barthram <Tim.Barthram@iag.com.au> wrote:
> Hi Jacek,
>
> To run a spark master on my windows box, I've created a .bat file with contents something
like:
>
> .\bin\spark-class.cmd org.apache.spark.deploy.master.Master --host <my_pc>
>
>
> For the worker:
>
> .\bin\spark-class.cmd org.apache.spark.deploy.worker.Worker spark://<mypc>:7077
>
>
> To wrap these in services, I've user yasw or nssm.
>
> Thanks,
> Tim
>
>
>
>
> -----Original Message-----
> From: Jacek Laskowski [mailto:jacek@japila.pl]
> Sent: Tuesday, 1 December 2015 4:18 AM
> To: Shuo Wang
> Cc: user
> Subject: Re: Cant start master on windows 7
>
> On Fri, Nov 27, 2015 at 4:27 PM, Shuo Wang <shuo.x.wang@gmail.com> wrote:
>
>> I am trying to use the start-master.sh script on windows 7.
>
> From http://spark.apache.org/docs/latest/spark-standalone.html:
>
> "Note: The launch scripts do not currently support Windows. To run a
> Spark cluster on Windows, start the master and workers by hand."
>
> Can you start the command by hand? Just copy and paste the command
> from the logs. Mind the spaces!
>
> Jacek
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
> _____________________________________________________________________
>
> The information transmitted in this message and its attachments (if any) is intended
> only for the person or entity to which it is addressed.
> The message may contain confidential and/or privileged material. Any review,
> retransmission, dissemination or other use of, or taking of any action in reliance
> upon this information, by persons or entities other than the intended recipient is
> prohibited.
>
> If you have received this in error, please contact the sender and delete this e-mail
> and associated material from any computer.
>
> The intended recipient of this e-mail may only use, reproduce, disclose or distribute
> the information contained in this e-mail and any attached files, with the permission
> of the sender.
>
> This message has been scanned for viruses.
> _____________________________________________________________________

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message