spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Singh <mohit1...@gmail.com>
Subject Re: Using Python IDE for Spark Application Development
Date Wed, 06 Aug 2014 23:22:30 GMT
My naive set up..
Adding
os.environ['SPARK_HOME'] = "/path/to/spark"
sys.path.append("/path/to/spark/python")
on top of my script.
from pyspark import SparkContext
from pyspark import SparkConf
Execution works from within pycharm...

Though my next step is to figure out autocompletion and I bet there are
better ways to develop apps for spark..



On Wed, Aug 6, 2014 at 4:16 PM, Sathish Kumaran Vairavelu <
vsathishkumaran@gmail.com> wrote:

> Hello,
>
> I am trying to use the python IDE PyCharm for Spark application
> development. How can I use pyspark with Python IDE? Can anyone help me with
> this?
>
>
> Thanks
>
> Sathish
>
>
>


-- 
Mohit

"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."
-Socrates

Mime
View raw message