hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akira Ajisaka <aajis...@gmail.com>
Subject Re: Resourcemanager Failing on OpenJDK11
Date Wed, 03 Oct 2018 03:37:16 GMT
Hi Jeremiah,

I wrote a patch to fix this issue in
https://issues.apache.org/jira/browse/HADOOP-15775

There is also a wiki to document the progress of Java 9, 10, and 11 support.
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+and+Java+9%2C+10%2C+11

Now there is no community consensus regarding the plan of Java 11 support,
however, I'd like to support Java 11 in Apache Hadoop 3.3 release.

Thanks,
Akira
2018年10月3日(水) 4:14 Jeremiah Adams <JAdams@helixeducation.com>:
>
> I am doing some testing of OpenJDK 11 and YARN, Kafka and Samza. I found that I YARN
Resourcemanager will not run on OpenJDK11. I didn’t see any tasking in JIRA regarding Java
11.
>
> What are YARN’s plans regarding OpenJDK11 and the changes to Oracle support and release
cadences? Is there an Epic or Stories regarding Java 11 that I can add this issue to?
>
>
> The issue with Resourcemanager is the WebAppContext failing:
>
>
> Caused by: java.lang.NoClassDefFoundError: javax/activation/DataSource
>
>
> The Activation package was lumped in with J2EE and CORBA for removal. Deprecated in v.
9, marked for removal and removed in v.11. Now gone.
>
>
>
> Output from the logs:
>
>
>
>
> 2018-10-02 07:36:37,410 WARN org.eclipse.jetty.webapp.WebAppContext: Failed startup of
context o.e.j.w.WebAppContext@43d3aba5{/,file:///private/var/folders/9y/92nwpmbd6pjf4m68mkcw29z40000gn/T/jetty-0.0.0.0-8042-node-_-any-10842369110863142525.dir/webapp/,UNAVAILABLE}{/node}
>
> com.google.inject.ProvisionException: Unable to provision, see the following errors:
>
>
> 1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource
>
>  at org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:52)
>
>  at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer$NMWebApp.setup(WebServer.java:153)
>
>  while locating org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver
>
>
> 1 error
>
>        at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1025)
>
>        at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1051)
>
>        at com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory$GuiceInstantiatedComponentProvider.getInstance(GuiceComponentProviderFactory.java:345)
>
>        at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory$ManagedSingleton.<init>(IoCProviderFactory.java:202)
>
>        at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory.wrap(IoCProviderFactory.java:123)
>
>        at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory._getComponentProvider(IoCProviderFactory.java:116)
>
>        at com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:153)
>
>        at com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:278)
>
>        at com.sun.jersey.core.spi.component.ProviderServices.getProviders(ProviderServices.java:151)
>
>        at com.sun.jersey.core.spi.factory.ContextResolverFactory.init(ContextResolverFactory.java:83)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1332)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:180)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:799)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:795)
>
>        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:795)
>
>        at com.sun.jersey.guice.spi.container.servlet.GuiceContainer.initiate(GuiceContainer.java:121)
>
>        at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:339)
>
>        at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:605)
>
>        at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:207)
>
>        at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:394)
>
>        at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:744)
>
>        at com.google.inject.servlet.FilterDefinition.init(FilterDefinition.java:112)
>
>        at com.google.inject.servlet.ManagedFilterPipeline.initPipeline(ManagedFilterPipeline.java:99)
>
>        at com.google.inject.servlet.GuiceFilter.init(GuiceFilter.java:220)
>
>        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
>
>        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
>
>        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:349)
>
>        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1406)
>
>        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1368)
>
>        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778)
>
>        at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262)
>
>        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:522)
>
>        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
>
>        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
>
>        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
>
>        at org.eclipse.jetty.server.Server.start(Server.java:422)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
>
>        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
>
>        at org.eclipse.jetty.server.Server.doStart(Server.java:389)
>
>        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
>
>        at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1134)
>
>        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:439)
>
>        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:428)
>
>        at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:112)
>
>        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
>
>        at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
>
>        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
>
>        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:930)
>
>        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:997)
>
> Caused by: java.lang.NoClassDefFoundError: javax/activation/DataSource
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeBuiltinLeafInfoImpl.<clinit>(RuntimeBuiltinLeafInfoImpl.java:457)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeTypeInfoSetImpl.<init>(RuntimeTypeInfoSetImpl.java:65)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeModelBuilder.createTypeInfoSet(RuntimeModelBuilder.java:133)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeModelBuilder.createTypeInfoSet(RuntimeModelBuilder.java:85)
>
>        at com.sun.xml.bind.v2.model.impl.ModelBuilder.<init>(ModelBuilder.java:156)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeModelBuilder.<init>(RuntimeModelBuilder.java:93)
>
>        at com.sun.xml.bind.v2.runtime.JAXBContextImpl.getTypeInfoSet(JAXBContextImpl.java:473)
>
>        at com.sun.xml.bind.v2.runtime.JAXBContextImpl.<init>(JAXBContextImpl.java:319)
>
>        at com.sun.xml.bind.v2.runtime.JAXBContextImpl$JAXBContextBuilder.build(JAXBContextImpl.java:1170)
>
>        at com.sun.xml.bind.v2.ContextFactory.createContext(ContextFactory.java:145)
>
>        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
>        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>        at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>
>        at javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:262)
>
>        at javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:249)
>
>        at javax.xml.bind.ContextFinder.find(ContextFinder.java:456)
>
>        at javax.xml.bind.JAXBContext.newInstance(JAXBContext.java:656)
>
>        at com.sun.jersey.api.json.JSONJAXBContext.<init>(JSONJAXBContext.java:255)
>
>        at org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:57)
>
>        at org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver$$FastClassByGuice$$21622eea.newInstance(<generated>)
>
>        at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
>
>        at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:61)
>
>        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)
>
>        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
>
>        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
>
>        at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
>
>        at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103)
>
>        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
>
>        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145)
>
>        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
>
>        at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1016)
>
>        at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
>
>        at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1012)
>
>        ... 52 more
>
> Caused by: java.lang.ClassNotFoundException: javax.activation.DataSource
>
>        at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:582)
>
>        at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
>
>        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
>
>        ... 86 more
>
> 2018-10-02 07:36:37,429 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@d535a3d{HTTP/1.1,[http/1.1]}{0.0.0.0:8042}
>
> ?
>
>
>
> Jeremiah Adams
> Software Engineer
> www.helixeducation.com<http://www.helixeducation.com/>
> Blog<http://www.helixeducation.com/blog/> | Twitter<https://twitter.com/HelixEducation>
| Facebook<https://www.facebook.com/HelixEducation> | LinkedIn<http://www.linkedin.com/company/3609946>

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message