spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Re: IntelliJ Runtime error
Date Sat, 04 Apr 2015 18:20:55 GMT
Thanks Cheng. Yes, the problem is that the way to set up to run inside
Intellij changes v frequently.  It is unfortunately not simply a one-time
investment to get IJ debugging working properly: the steps required are a
moving target approximately monthly to bi-monthly.

Doing remote debugging is probably a good choice to reduce the dev
environment volatility/maintenance.



2015-04-04 5:46 GMT-07:00 Cheng Lian <lian.cs.zju@gmail.com>:

> I found in general it's a pain to build/run Spark inside IntelliJ IDEA. I
> guess most people resort to this approach so that they can leverage the
> integrated debugger to debug and/or learn Spark internals. A more
> convenient way I'm using recently is resorting to the remote debugging
> feature. In this way, by adding driver/executor Java options, you may build
> and start the Spark applications/tests/daemons in the normal way and attach
> the debugger to it. I was using this to debug the HiveThriftServer2, and it
> worked perfectly.
>
> Steps to enable remote debugging:
>
> 1. Menu "Run / Edit configurations..."
> 2. Click the "+" button, choose "Remote"
> 3. Choose "Attach" or "Listen" in "Debugger mode" according to your actual
> needs
> 4. Copy, edit, and add Java options suggested in the dialog to
> `--driver-java-options` or `--executor-java-options`
> 5. If you're using attaching mode, first start your Spark program, then
> start remote debugging in IDEA
> 6. If you're using listening mode, first start remote debugging in IDEA,
> and then start your Spark program.
>
> Hope this can be helpful.
>
> Cheng
>
>
> On 4/4/15 12:54 AM, sara mustafa wrote:
>
>> Thank you, it works with me when I changed the dependencies from provided
>> to
>> compile.
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-
>> developers-list.1001551.n3.nabble.com/IntelliJ-Runtime-
>> error-tp11383p11385.html
>> Sent from the Apache Spark Developers List mailing list archive at
>> Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message