spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kelum Perera <kelum0...@gmail.com>
Subject Re: spark-shell not starting ( in a Kali linux 2 OS)
Date Sun, 13 Nov 2016 10:44:22 GMT
Thanks Oshadha & Sean,

Now, When i enter "spark-shell", this error pops as;

bash: /root/spark/bin/pyspark: Permission denied

Same error comes for "pyspark" too.

Any help on this.

Thanks for your help.
Kelum



On Sun, Nov 13, 2016 at 2:14 PM, Oshadha Gunawardena <
oshadha.rocky@gmail.com> wrote:

> On Nov 13, 2016 10:20 AM, "Kelum Perera" <kelum0823@gmail.com> wrote:
> >
> > Dear Users,
> >
> > I'm a newbie, trying to get spark-shell using kali linux OS, but getting
> error - "spark-shell: command not found"
> >
> > I'm running on Kali Linux 2 (64bit)
> >
> > I followed several tutorial including:
> > https://www.tutorialspoint.com/apache_spark/apache_spark_ins
> tallation.htm
> > https://www.youtube.com/watch?v=wo8Q_j8bnQU
> >
> > Scala (2.11.8), python (2.7), Java (1.8.0_111), spark (1.6.3) are
> available in /usr/local/
> >
> > I have amended the "bashrc" for the paths of above folders & sourced it.
> >
> > export SCALA_HOME=/root/scala
> > export PATH=$SCALA_HOME/bin:$PATH
> >
> > export SCALA_HOME=/root/spark
> > export PATH=$SPARK_HOME/bin:$PATH
> >
> >
> > When i run "echo $SCALA_HOME" it shows the path correctly.
> > but for "echo $SPARK_HOME" its a just empty line prints but no error
> pops & courser moves to next line.
> >
> > I tried keeping the files in "/usr/local/" folder too, but same result.
> > Also i tried with "pyspark", but the same result
> >
> > Its great if someone can help me on this.
> >
> >
> > Thanks for your time & effort.
> > Regards,
> > kelum
> >
> >
>
> In your spark path configuration it should be 'SPARK_HOME=/root/spark'
>
> Then do a 'source /.bashrc'
>

Mime
View raw message