tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andre Kelpe <ake...@concurrentinc.com>
Subject Re: ClassNotFoundException with custom InputFormat.
Date Thu, 18 Jun 2015 22:54:06 GMT
On Thu, Jun 18, 2015 at 1:49 PM, Hitesh Shah <hitesh@apache.org> wrote:

> Hi Andre,
> You can use the PATTERN approach for both the AM and the tasks. The only
> issue as Sid pointed out is the manipulation of classpath for the AM vs
> Tasks. Tasks handling is a bit different as there are rules in place with
> respect to container re-use to correctly handle setting up the necessary
> environment/classpath, etc. A new container can always be launched to
> handle a task with different requirements but not really so for the AM.

I think I have it figured out now: I will now use ARCHIVE, but I have to
include the jar-name, which will become a sub-directory, in the classpath
wildcards. I have a local build of cascading that works with fatjars and
hadoop jars. Thanks for all the pointers.

- André

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message