falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Srikanth Sundarrajan <srik...@hotmail.com>
Subject RE: support webhdfs for feed replication
Date Wed, 02 Apr 2014 05:52:13 GMT
Seems like an issue with connection to JT from the oozie server. As such webhdfs is supported
via falcon for replication.
RegardsSrikanth Sundarrajan

> Date: Tue, 1 Apr 2014 13:28:57 -0700
> Subject: support webhdfs for feed replication
> From: sadhu.apps@gmail.com
> To: dev@falcon.incubator.apache.org
> 
> Hi,
> 
> 
> I am new this group and wanted to check with the dev if webhdfs is
> something the current trunk supports for feed replication.   I have tried
> to setup a cluster with webhdfs, however, oozie seems to fail to initialize
> cluster with the following exception.
> 
> 
> 2014-04-01 06:20:02,755  WARN ActionStartXCommand:542 - USER[bigdatad]
> GROUP[-] TOKEN[] APP[FALCON_FEED_REPLICATION_distcp-feed]
> JOB[0000149-140331222820297-oozie-bigd-W] AC
> 
> TION[0000149-140331222820297-oozie-bigd-W@recordsize] Error starting action
> [recordsize]. ErrorType [TRANSIENT], ErrorCode [JA009], Message [JA009:
> Cannot initialize Cluster
> 
> . Please check your configuration for mapreduce.framework.name and the
> correspond server addresses.]
> 
> org.apache.oozie.action.ActionExecutorException: JA009: Cannot initialize
> Cluster. Please check your configuration for mapreduce.framework.name and
> the correspond server add
> 
> resses.
> 
>         at
> org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:412)
> 
>         at
> org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:392)
> 
>         at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:794)
> 
>         at
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:945)
> 
>         at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:215)
> 
>         at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:60)
> 
>         at org.apache.oozie.command.XCommand.call(XCommand.java:280)
> 
>         at
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> 
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 
>         at java.lang.Thread.run(Thread.java:744)
> 
> Caused by: java.io.IOException: Cannot initialize Cluster. Please check
> your configuration for mapreduce.framework.name and the correspond server
> addresses.
> 
>         at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:120)
> 
>         at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:82)
> 
>         at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:75)
> 
>         at org.apache.hadoop.mapred.JobClient.init(JobClient.java:470)
> 
>         at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:449)
> 
>         at
> org.apache.oozie.service.HadoopAccessorService$1.run(HadoopAccessorService.java:371)
> 
>         at
> org.apache.oozie.service.HadoopAccessorService$1.run(HadoopAccessorService.java:369)
> 
>         at java.security.AccessController.doPrivileged(Native Method)
> 
>         at javax.security.auth.Subject.doAs(Subject.java:415)
> 
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
> 
>         at
> org.apache.oozie.service.HadoopAccessorService.createJobClient(HadoopAccessorService.java:369)
> 
>         at
> org.apache.oozie.action.hadoop.JavaActionExecutor.createJobClient(JavaActionExecutor.java:988)
> 
>         at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:743)
> 
>         ... 8 more
> 
> 
> Thanks!
 		 	   		  
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message