falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pallavi Rao <pallavi....@inmobi.com>
Subject Re: Unable to submit cluster definition
Date Fri, 06 Jan 2017 03:11:07 GMT
Aaron,
If you don't plan to use the graph API, you can disable MetadataMappingService
(by commenting out that line) in the startup.properties as a work-around.

On Thu, Jan 5, 2017 at 11:48 PM, Aaron Turner <synfinatic@gmail.com> wrote:

> Ok, I think I see what my problem is.
>
> First, my falcon-prism/conf/runtime.properties had:
>
> prism.falcon.local.endpoint=http://localhost:16444
>
> which pointed back at itself, not:
>
> prism.falcon.local.endpoint=http://localhost:15000
>
> which points at falcon server.  So I fixed that and restarted
> falcon-prism.  Now I get a different error:
>
> POST http://localhost:16444/api/entities/submit/cluster returned a
> response status of 400 Bad Request
> ERROR: Bad Request;local/org.apache.falcon.FalconException::org.
> apache.falcon.FalconException:
> <html>
> <head>
> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
> <title>Error 503 SERVICE_UNAVAILABLE</title>
> </head>
> <body>
> <h2>HTTP ERROR: 503</h2>
> <p>Problem accessing /secure/sync/submit/cluster. Reason:
> <pre>    SERVICE_UNAVAILABLE</pre></p>
> <hr /><i><small>Powered by Jetty://</small></i>
>
> The prism.application.log now says it's trying to talk to falcon-server:
>
> 2017-01-05 10:12:53,952 DEBUG - [352083716@qtp-771418758-0 -
> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> POST//entities/submit/cluster]
> ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo=local&
> (HTTPChannel:96)
> 2017-01-05 10:12:53,953 INFO  - [352083716@qtp-771418758-0 -
> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> POST//entities/submit/cluster]
> ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore
> (SecureHTTPChannel:56)
> 2017-01-05 10:12:54,033 ERROR - [352083716@qtp-771418758-0 -
> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> POST//entities/submit/cluster]
> ~ Request failed: 503 (HTTPChannel:127)
> 2017-01-05 10:12:54,035 ERROR - [352083716@qtp-771418758-0 -
> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner:
> POST//entities/submit/cluster]
> ~ Request failed (HTTPChannel:134)
>
> Trying in my browser to connect to tcp/15000 gives me the same 503
> error.  So I went looking in the falcon.application.log for what the
> problem is:
>
>
> 2017-01-05 10:09:05,551 INFO  - [main:] ~ Initializing graph db
> (MetadataMappingService:143)
> 2017-01-05 10:09:05,610 INFO  - [main:] ~ The HBase version
> 1.2.0-cdh5.8.2 is not explicitly supported by Titan.  Loading Titan's
> compatibility layer for its most recent supported HBase version (1.1)
> (HBaseCompatLoader:57)
>
> <snip>
>
> 2017-01-05 10:09:05,832 WARN  - [main:] ~
> hbase.regionserver.global.memstore.upperLimit is deprecated by
> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55)
> 2017-01-05 10:09:06,084 WARN  - [main:] ~ The short-circuit local
> reads feature cannot be used because libhadoop cannot be loaded.
> (DomainSocketFactory:117)
> 2017-01-05 10:09:06,088 INFO  - [main:] ~ Set a new configuration for
> the first time. (N:110)
> 2017-01-05 10:09:06,119 INFO  - [main:] ~ mapred.task.id is
> deprecated. Instead, use mapreduce.task.attempt.id (deprecation:1174)
> 2017-01-05 10:09:06,120 INFO  - [main:] ~ Scheduling statistics report
> every 2000 millisecs (u:110)
> 2017-01-05 10:09:06,120 INFO  - [main:] ~ Initialized the distributed
> file system (ThrottledDistributedFileSystem:110)
> 2017-01-05 10:09:06,421 INFO  - [main:] ~ hadoop.native.lib is
> deprecated. Instead, use io.native.lib.available (deprecation:1174)
> 2017-01-05 10:09:06,514 WARN  - [main:] ~
> hbase.regionserver.global.memstore.upperLimit is deprecated by
> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55)
> 2017-01-05 10:09:06,521 ERROR - [main:] ~ Failed to initialize service
> org.apache.falcon.metadata.MetadataMappingService
> (ServiceInitializer:49)
> java.lang.RuntimeException: GraphFactory could not instantiate this
> Graph implementation [com.thinkaurelius.titan.core.TitanFactory].
> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50)
> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB(
> MetadataMappingService.java:146)
> at org.apache.falcon.metadata.MetadataMappingService.init(
> MetadataMappingService.java:113)
> at org.apache.falcon.service.ServiceInitializer.initialize(
> ServiceInitializer.java:47)
> at org.apache.falcon.listener.ContextStartupListener.contextInitialized(
> ContextStartupListener.java:56)
> at org.mortbay.jetty.handler.ContextHandler.startContext(
> ContextHandler.java:550)
> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
> at org.mortbay.jetty.webapp.WebAppContext.startContext(
> WebAppContext.java:1282)
> at org.mortbay.jetty.handler.ContextHandler.doStart(
> ContextHandler.java:519)
> at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
> at org.mortbay.component.AbstractLifeCycle.start(
> AbstractLifeCycle.java:50)
> at org.mortbay.jetty.handler.HandlerWrapper.doStart(
> HandlerWrapper.java:130)
> at org.mortbay.jetty.Server.doStart(Server.java:224)
> at org.mortbay.component.AbstractLifeCycle.start(
> AbstractLifeCycle.java:50)
> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58)
> at org.apache.falcon.FalconServer.main(FalconServer.java:118)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45)
> ... 15 more
> Caused by: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.HTableDescriptor.addFamily(
> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/
> HTableDescriptor;
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1.
> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49)
> at com.thinkaurelius.titan.diskstorage.hbase.
> HBaseStoreManager.createTable(HBaseStoreManager.java:728)
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> ensureTableExists(HBaseStoreManager.java:711)
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> getLocalKeyPartition(HBaseStoreManager.java:511)
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> getDeployment(HBaseStoreManager.java:352)
> at com.thinkaurelius.titan.diskstorage.hbase.
> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395)
> at com.thinkaurelius.titan.graphdb.configuration.
> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276)
> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)
> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)
> ... 20 more
> 2017-01-05 10:09:06,524 ERROR - [main:] ~ Failed startup of context
> org.mortbay.jetty.webapp.WebAppContext@6caf7803{/,/usr/
> lib/falcon-server/server/webapp/falcon}
> (log:87)
> java.lang.RuntimeException: org.apache.falcon.FalconException:
> java.lang.RuntimeException: GraphFactory could not instantiate this
> Graph implementation [com.thinkaurelius.titan.core.TitanFactory].
> at org.apache.falcon.listener.ContextStartupListener.contextInitialized(
> ContextStartupListener.java:59)
> at org.mortbay.jetty.handler.ContextHandler.startContext(
> ContextHandler.java:550)
> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136)
> at org.mortbay.jetty.webapp.WebAppContext.startContext(
> WebAppContext.java:1282)
> at org.mortbay.jetty.handler.ContextHandler.doStart(
> ContextHandler.java:519)
> at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
> at org.mortbay.component.AbstractLifeCycle.start(
> AbstractLifeCycle.java:50)
> at org.mortbay.jetty.handler.HandlerWrapper.doStart(
> HandlerWrapper.java:130)
> at org.mortbay.jetty.Server.doStart(Server.java:224)
> at org.mortbay.component.AbstractLifeCycle.start(
> AbstractLifeCycle.java:50)
> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58)
> at org.apache.falcon.FalconServer.main(FalconServer.java:118)
> Caused by: org.apache.falcon.FalconException:
> java.lang.RuntimeException: GraphFactory could not instantiate this
> Graph implementation [com.thinkaurelius.titan.core.TitanFactory].
> at org.apache.falcon.service.ServiceInitializer.initialize(
> ServiceInitializer.java:50)
> at org.apache.falcon.listener.ContextStartupListener.contextInitialized(
> ContextStartupListener.java:56)
> ... 11 more
> Caused by: java.lang.RuntimeException: GraphFactory could not
> instantiate this Graph implementation
> [com.thinkaurelius.titan.core.TitanFactory].
> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50)
> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB(
> MetadataMappingService.java:146)
> at org.apache.falcon.metadata.MetadataMappingService.init(
> MetadataMappingService.java:113)
> at org.apache.falcon.service.ServiceInitializer.initialize(
> ServiceInitializer.java:47)
> ... 12 more
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45)
> ... 15 more
> Caused by: java.lang.NoSuchMethodError:
> org.apache.hadoop.hbase.HTableDescriptor.addFamily(
> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/
> HTableDescriptor;
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1.
> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49)
> at com.thinkaurelius.titan.diskstorage.hbase.
> HBaseStoreManager.createTable(HBaseStoreManager.java:728)
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> ensureTableExists(HBaseStoreManager.java:711)
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> getLocalKeyPartition(HBaseStoreManager.java:511)
> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.
> getDeployment(HBaseStoreManager.java:352)
> at com.thinkaurelius.titan.diskstorage.hbase.
> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395)
> at com.thinkaurelius.titan.graphdb.configuration.
> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276)
> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)
> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)
> ... 20 more
> 2017-01-05 10:09:06,525 INFO  - [main:] ~ Started
> SocketConnector@0.0.0.0:15000 (log:67)
> 2017-01-05 10:14:04,983 INFO  - [Thread-16:] ~ config.location is set,
> using: /usr/lib/falcon-server/conf/runtime.properties
> (ApplicationProperties:120)
> 2017-01-05 10:14:04,983 INFO  - [Thread-16:] ~ Initializing
> org.apache.falcon.util.RuntimeProperties properties with domain falcon
> (ApplicationProperties:156)
> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> feed.retry.policy=exp-backoff (ApplicationProperties:162)
> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> feed.retry.frequency=minutes(5) (ApplicationProperties:162)
> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> workflow.status.retry.count=30 (ApplicationProperties:162)
> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~
> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=*
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.late.allowed=true
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> webservices.default.results.per.page=10 (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> feed.retry.onTimeout=false (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> falcon.jms.notification.enabled=true (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> falcon.retention.keep.instances.beyond.validity=true
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> feed.late.policy=exp-backoff (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ current.colo=local
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ domain=falcon
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> feed.late.frequency=hours(3) (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> falcon.skip.dryrun=false (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.retry.attempts=3
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~
> falcon.service.ProxyUserService.proxyuser.#USER#.groups=*
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,984 INFO  - [Thread-16:] ~ config.location is set,
> using: /usr/lib/falcon-server/conf/runtime.properties
> (ApplicationProperties:120)
> 2017-01-05 10:14:04,985 INFO  - [Thread-16:] ~ Initializing
> org.apache.falcon.util.RuntimeProperties properties with domain falcon
> (ApplicationProperties:156)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> feed.retry.policy=exp-backoff (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> feed.retry.frequency=minutes(5) (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> workflow.status.retry.count=30 (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=*
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.late.allowed=true
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> webservices.default.results.per.page=10 (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> feed.retry.onTimeout=false (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> falcon.jms.notification.enabled=true (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> falcon.retention.keep.instances.beyond.validity=true
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> feed.late.policy=exp-backoff (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ current.colo=local
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ domain=falcon
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> feed.late.frequency=hours(3) (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> falcon.skip.dryrun=false (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.retry.attempts=3
> (ApplicationProperties:162)
> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~
> falcon.service.ProxyUserService.proxyuser.#USER#.groups=*
> (ApplicationProperties:162)
>
> So it appears my problem is that CDH5.8.2 is shipping a more recent
> version of Hbase then Titan supports?  Not sure if there is a work
> around or should I switch to BerkeleyDB?
>

-- 
_____________________________________________________________
The information contained in this communication is intended solely for the 
use of the individual or entity to whom it is addressed and others 
authorized to receive it. It may contain confidential or legally privileged 
information. If you are not the intended recipient you are hereby notified 
that any disclosure, copying, distribution or taking any action in reliance 
on the contents of this information is strictly prohibited and may be 
unlawful. If you have received this communication in error, please notify 
us immediately by responding to this email and then delete it from your 
system. The firm is neither liable for the proper and complete transmission 
of the information contained in this communication nor for any delay in its 
receipt.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message