spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Singh <>
Subject Re: Using Python IDE for Spark Application Development
Date Wed, 06 Aug 2014 23:22:30 GMT
My naive set up..
os.environ['SPARK_HOME'] = "/path/to/spark"
on top of my script.
from pyspark import SparkContext
from pyspark import SparkConf
Execution works from within pycharm...

Though my next step is to figure out autocompletion and I bet there are
better ways to develop apps for spark..

On Wed, Aug 6, 2014 at 4:16 PM, Sathish Kumaran Vairavelu <> wrote:

> Hello,
> I am trying to use the python IDE PyCharm for Spark application
> development. How can I use pyspark with Python IDE? Can anyone help me with
> this?
> Thanks
> Sathish


"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."

View raw message