tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tsuyoshi OZAWA <ozawa.tsuyo...@gmail.com>
Subject Re: [VOTE] Release Apache Tez-0.3.0-incubating RC1
Date Wed, 26 Feb 2014 18:53:39 GMT
+1 (non-bindng)

* Compile from source code against hadoop trunk (mvn package
-Dhadoop.version=3.0.0-SNAPSHOT -DskipTests
-Dmaven.javadoc.skip=true).
* Run some examples in pseudo distributed mode.

Thanks, Tsuyoshi

On Wed, Feb 26, 2014 at 9:46 AM, Daniel Dai <daijy@hortonworks.com> wrote:
> +1 (nonbinding), verified Pig runs fine on rc1.
>
> On Wed, Feb 26, 2014 at 8:15 AM, Chen He <airbots@gmail.com> wrote:
>> +1 non-binding
>>
>> similar to RC0, I download the source code, compile and deploy on Fedora 17;
>> successfully run orderedwordcount based on hadoop-2.2;
>>
>> Maybe following exceptions do not affect the running of Tez DAG, I still
>> got them when Tez dag finishing:
>>
>> 2014-02-26 10:07:25,176 INFO [AsyncDispatcher event handler]
>> org.apache.tez.dag.app.rm.container.AMContainerImpl: AMContainer
>> container_1393430
>> 748133_0001_01_000002 transitioned from IDLE to STOP_REQUESTED via event
>> C_NM_STOP_SENT
>> 2014-02-26 10:07:25,177 ERROR [ContainerLauncher Event Handler]
>> org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread
>> Thread[ContainerLau
>> ncher Event Handler,5,main] threw an Exception.
>> java.util.concurrent.RejectedExecutionException: Task
>> org.apache.tez.dag.app.launcher.ContainerLauncherImpl$EventProcessor@2f79f9e2rejected
>> fr
>> om java.util.concurrent.ThreadPoolExecutor@71047cc7[Terminated, pool size =
>> 0, active threads = 0, queued tasks = 0, completed tasks = 1]
>>         at
>> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
>>         at
>> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
>>         at
>> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
>>         at
>> org.apache.tez.dag.app.launcher.ContainerLauncherImpl$1.run(ContainerLauncherImpl.java:310)
>> 2014-02-26 10:07:25,177 INFO [DelayedContainerManager]
>> org.apache.tez.dag.app.rm.TaskScheduler: AllocatedContainerManager Thread
>> interrupted
>> 2014-02-26 10:07:25,179 INFO [DelayedContainerManager]
>> org.apache.tez.dag.app.rm.TaskScheduler: Releasing unused container:
>> container_139343074
>> 8133_0001_01_000002
>> 2014-02-26 10:07:25,188 INFO [IPC Server handler 24 on 40678]
>> org.apache.tez.dag.app.TaskAttemptListenerImpTezDag: Container with id:
>> container
>> _1393430748133_0001_01_000002 is valid, but no longer registered, and will
>> be killed
>> 2014-02-26 10:07:25,210 INFO [AMShutdownThread]
>> org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl: Waiting for
>> application to be successful
>> ly unregistered.
>> 2014-02-26 10:07:25,219 INFO [Socket Reader #1 for port 40678]
>> org.apache.hadoop.ipc.Server: IPC Server listener on 40678: readAndProcess
>> from
>> client 10.74.90.55 threw exception [java.io.IOException: Connection reset
>> by peer]
>> java.io.IOException: Connection reset by peer
>>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>>         at sun.nio.ch.IOUtil.read(IOUtil.java:197)
>>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
>>         at org.apache.hadoop.ipc.Server.channelRead(Server.java:2597)
>>         at org.apache.hadoop.ipc.Server.access$3200(Server.java:122)
>>         at
>> org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1500)
>>         at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:792)
>>         at
>> org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:591)
>>         at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:566)
>> 2014-02-26 10:07:25,312 INFO [AMRM Callback Handler Thread]
>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl:
>> Interrupted while waiting for queue
>> java.lang.InterruptedException
>>         at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
>>         at
>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
>>         at
>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>>         at
>> org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl$CallbackHandlerThread.run(AMRMClientAsyncImpl.java:275)
>> 2014-02-26 10:07:25,312 INFO [AMShutdownThread]
>> org.apache.hadoop.ipc.Server: Stopping server on 40678
>> 2014-02-26 10:07:25,314 INFO [IPC Server listener on 40678]
>> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 40678
>> 2014-02-26 10:07:25,314 INFO [IPC Server Responder]
>> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
>> 2014-02-26 10:07:25,315 INFO [AMShutdownThread]
>> org.apache.hadoop.ipc.Server: Stopping server on 50196
>> 2014-02-26 10:07:25,315 INFO [IPC Server Responder]
>> org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
>> 2014-02-26 10:07:25,315 INFO [IPC Server listener on 50196]
>> org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 50196
>> 2014-02-26 10:07:25,315 INFO [AMShutdownThread]
>> org.apache.tez.dag.app.DAGAppMaster: Exiting DAGAppMaster..GoodBye!
>>
>>
>> Chen
>>
>>
>> On Tue, Feb 25, 2014 at 6:28 PM, Hitesh Shah <hitesh@apache.org> wrote:
>>
>>> Hello folks,
>>>
>>> I have created a tez-0.3.0-incubating release candidate (rc1). This is the
>>> second release for Tez.
>>>
>>> The previous RC was cancelled due to a bug discovered when the RC was
>>> tested against downstream projects.
>>>
>>> GIT source tag:
>>> https://git-wip-us.apache.org/repos/asf/incubator-tez/repo?p=incubator-tez.git;a=log;h=refs/tags/release-0.3.0-incubating-rc1(
commit hash 6987e18f6b3c5358e1eb125bc2d63be39f71e892 )
>>> Staging site:
>>> https://dist.apache.org/repos/dist/dev/incubator/tez/0.3.0-incubating-rc1/( svn
revision 4508 )
>>> Nexus Staging URL:
>>> https://repository.apache.org/content/repositories/orgapachetez-1003
>>>
>>> PGP release keys:
>>> http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA9510905F0B000F0
>>> KEYS file also available at
>>> https://dist.apache.org/repos/dist/release/incubator/tez/KEYS
>>>
>>> One can look into the issues fixed in this release at:
>>> https://issues.apache.org/jira/browse/TEZ/fixforversion/12325655 or look
>>> at the CHANGES.txt in the release tarball.
>>>
>>> Vote will be open for at least 72 hours ( until the required number of
>>> IPMC votes are obtained ).
>>>
>>> [ ] +1 approve
>>> [ ] +0 no opinion
>>> [ ] -1 disapprove (and reason why)
>>>
>>> For folks not familiar with vetting a release, please refer to
>>> http://incubator.apache.org/guides/releasemanagement.html#check-list
>>>
>>> thanks
>>> -- Hitesh
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.



-- 
- Tsuyoshi

Mime
View raw message