tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bikas Saha <bi...@hortonworks.com>
Subject RE: Tez local mode non-daemon thread
Date Tue, 09 Sep 2014 18:17:42 GMT
In that case, the graceful shutdown on success/failure of DAG should stop
this thread. If not then this is a bug. The normal task scheduler uses
yarn client libraries that also run threads and work correctly.

For the non-graceful shutdown case, this should be a daemon thread.

Either ways, if you can repro this then please open a bug with a stack
dump that shows the errant thread and a log for the app master.


-----Original Message-----
From: Chris K Wensel [mailto:chris@wensel.net]
Sent: Monday, September 08, 2014 7:39 PM
To: dev@tez.apache.org
Subject: Re: Tez local mode non-daemon thread

There are no failures, and this isn't a test.

Just running Tez without a cluster in local mode in the same manner as
MapReduce local/standalone mode.

On Sep 8, 2014, at 4:33 PM, Bikas Saha <bikas@hortonworks.com> wrote:

> Ideally, application shutdown should end up stopping this thread on a
> clean shutdown. However if the test fails and stops for some other
> reason then this thread being non-daemon would be a problem.
>
> Yes, it should probably be made daemon. Please open a jira for this.
>
> -----Original Message-----
> From: Chen He [mailto:airbots@gmail.com]
> Sent: Monday, September 08, 2014 3:35 PM
> To: dev@tez.apache.org
> Subject: Re: Tez local mode non-daemon thread
>
> Hi Chris
>
> Are you using Session or not?
>
> Chen
>
>
> On Mon, Sep 8, 2014 at 5:14 PM, Chris K Wensel <chris@wensel.net> wrote:
>
>>
>> Should this thread be a daemon thread?
>>
>>
>> https://github.com/apache/tez/blob/branch-0.5.0/tez-dag/src/main/java
>> /
>> org/apache/tez/dag/app/rm/LocalTaskSchedulerService.java#L157-157
>>
>> I believe this currently prevents an app running in local mode from
>> exiting unless System.exit is called.
>>
>> ckw
>>
>> --
>> Chris K Wensel
>> chris@concurrentinc.com
>> http://concurrentinc.com
>>
>>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or
> entity to which it is addressed and may contain information that is
> confidential, privileged and exempt from disclosure under applicable
> law. If the reader of this message is not the intended recipient, you
> are hereby notified that any printing, copying, dissemination,
> distribution, disclosure or forwarding of this communication is
> strictly prohibited. If you have received this communication in error,
> please contact the sender immediately and delete it from your system.
Thank You.

--
Chris K Wensel
chris@concurrentinc.com
http://concurrentinc.com

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
View raw message