spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jakob Odersky <ja...@odersky.com>
Subject Re: Installing Spark on Mac
Date Fri, 11 Mar 2016 08:29:02 GMT
Some more diagnostics/suggestions:

1) are other services listening to ports in the 4000 range (run
"netstat -plunt")? Maybe there is an issue with the error message
itself.

2) are you sure the correct java version is used? java -version

3) can you revert all installation attempts you have done so far,
including files installed by brew/macports or maven and try again?

4) are there any special firewall rules in place, forbidding
connections on localhost?

This is very weird behavior you're seeing. Spark is supposed to work
out-of-the-box with ZERO configuration necessary for running a local
shell. Again, my prime suspect is a previous, failed Spark
installation messing up your config.

On Thu, Mar 10, 2016 at 12:24 PM, Tristan Nixon <stuff@memeticlabs.org> wrote:
> If you type ‘whoami’ in the terminal, and it responds with ‘root’ then you’re
the superuser.
> However, as mentioned below, I don’t think its a relevant factor.
>
>> On Mar 10, 2016, at 12:02 PM, Aida Tefera <aida1.tefera@gmail.com> wrote:
>>
>> Hi Tristan,
>>
>> I'm afraid I wouldn't know whether I'm running it as super user.
>>
>> I have java version 1.8.0_73 and SCALA version 2.11.7
>>
>> Sent from my iPhone
>>
>>> On 9 Mar 2016, at 21:58, Tristan Nixon <stuff@memeticlabs.org> wrote:
>>>
>>> That’s very strange. I just un-set my SPARK_HOME env param, downloaded a fresh
1.6.0 tarball,
>>> unzipped it to local dir (~/Downloads), and it ran just fine - the driver port
is some randomly generated large number.
>>> So SPARK_HOME is definitely not needed to run this.
>>>
>>> Aida, you are not running this as the super-user, are you?  What versions of
Java & Scala do you have installed?
>>>
>>>> On Mar 9, 2016, at 3:53 PM, Aida Tefera <aida1.tefera@gmail.com> wrote:
>>>>
>>>> Hi Jakob,
>>>>
>>>> Tried running the command env|grep SPARK; nothing comes back
>>>>
>>>> Tried env|grep Spark; which is the directory I created for Spark once I downloaded
the tgz file; comes back with PWD=/Users/aidatefera/Spark
>>>>
>>>> Tried running ./bin/spark-shell ; comes back with same error as below; i.e
could not bind to port 0 etc.
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 9 Mar 2016, at 21:42, Jakob Odersky <jakob@odersky.com> wrote:
>>>>>
>>>>> As Tristan mentioned, it looks as though Spark is trying to bind on
>>>>> port 0 and then 1 (which is not allowed). Could it be that some
>>>>> environment variables from you previous installation attempts are
>>>>> polluting your configuration?
>>>>> What does running "env | grep SPARK" show you?
>>>>>
>>>>> Also, try running just "/bin/spark-shell" (without the --master
>>>>> argument), maybe your shell is doing some funky stuff with the
>>>>> brackets.
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>

On Thu, Mar 10, 2016 at 12:24 PM, Tristan Nixon <stuff@memeticlabs.org> wrote:
> If you type ‘whoami’ in the terminal, and it responds with ‘root’ then you’re
the superuser.
> However, as mentioned below, I don’t think its a relevant factor.
>
>> On Mar 10, 2016, at 12:02 PM, Aida Tefera <aida1.tefera@gmail.com> wrote:
>>
>> Hi Tristan,
>>
>> I'm afraid I wouldn't know whether I'm running it as super user.
>>
>> I have java version 1.8.0_73 and SCALA version 2.11.7
>>
>> Sent from my iPhone
>>
>>> On 9 Mar 2016, at 21:58, Tristan Nixon <stuff@memeticlabs.org> wrote:
>>>
>>> That’s very strange. I just un-set my SPARK_HOME env param, downloaded a fresh
1.6.0 tarball,
>>> unzipped it to local dir (~/Downloads), and it ran just fine - the driver port
is some randomly generated large number.
>>> So SPARK_HOME is definitely not needed to run this.
>>>
>>> Aida, you are not running this as the super-user, are you?  What versions of
Java & Scala do you have installed?
>>>
>>>> On Mar 9, 2016, at 3:53 PM, Aida Tefera <aida1.tefera@gmail.com> wrote:
>>>>
>>>> Hi Jakob,
>>>>
>>>> Tried running the command env|grep SPARK; nothing comes back
>>>>
>>>> Tried env|grep Spark; which is the directory I created for Spark once I downloaded
the tgz file; comes back with PWD=/Users/aidatefera/Spark
>>>>
>>>> Tried running ./bin/spark-shell ; comes back with same error as below; i.e
could not bind to port 0 etc.
>>>>
>>>> Sent from my iPhone
>>>>
>>>>> On 9 Mar 2016, at 21:42, Jakob Odersky <jakob@odersky.com> wrote:
>>>>>
>>>>> As Tristan mentioned, it looks as though Spark is trying to bind on
>>>>> port 0 and then 1 (which is not allowed). Could it be that some
>>>>> environment variables from you previous installation attempts are
>>>>> polluting your configuration?
>>>>> What does running "env | grep SPARK" show you?
>>>>>
>>>>> Also, try running just "/bin/spark-shell" (without the --master
>>>>> argument), maybe your shell is doing some funky stuff with the
>>>>> brackets.
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message