spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Bind Exception
Date Tue, 20 Jan 2015 04:48:18 GMT
Have you seen these threads ?

http://search-hadoop.com/m/JW1q5tMFlb
http://search-hadoop.com/m/JW1q5dabji1

Cheers

On Mon, Jan 19, 2015 at 8:33 PM, Deep Pradhan <pradhandeep1991@gmail.com>
wrote:

> Hi Ted,
> When I am running the same job with small data, I am able to run. But when
> I run it with relatively bigger set of data, it is giving me
> OutOfMemoryError: GC overhead limit exceeded.
> The first time I run the job, no output. When I run for second time, I am
> getting this error. I am aware that, the memory is getting full, but is
> there any way to avoid this?
> I have a single node Spark cluster.
>
> Thank You
>
> On Tue, Jan 20, 2015 at 9:52 AM, Deep Pradhan <pradhandeep1991@gmail.com>
> wrote:
>
>> I had the Spark Shell running through out. Is it because of that?
>>
>> On Tue, Jan 20, 2015 at 9:47 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>>
>>> Was there another instance of Spark running on the same machine ?
>>>
>>> Can you pastebin the full stack trace ?
>>>
>>> Cheers
>>>
>>> On Mon, Jan 19, 2015 at 8:11 PM, Deep Pradhan <pradhandeep1991@gmail.com
>>> > wrote:
>>>
>>>> Hi,
>>>> I am running a Spark job. I get the output correctly but when I see the
>>>> logs file I see the following:
>>>> AbstractLifeCycle: FAILED.....: java.net.BindException: Address already
>>>> in use...
>>>>
>>>> What could be the reason for this?
>>>>
>>>> Thank You
>>>>
>>>
>>>
>>
>

Mime
View raw message