hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremiah Adams <JAd...@helixeducation.com>
Subject Re: Resourcemanager Failing on OpenJDK11
Date Wed, 10 Oct 2018 13:26:50 GMT
Akira,

Java 8 is going to cost us all a lot of money come January.  Java 9 and Java 10 are a waste
of time to support. 9 and 10 will no longer receive security patches. The LTS is 11 and where
we should all move unless one has deep pockets.

What is the process for getting community support for Java11? 

Is it enough to simply start completing the tasks on the Hadoop and Java 9, 10 and 11 Wiki?


Jeremiah Adams
Software Engineer
www.helixeducation.com
Blog | Twitter | Facebook | LinkedIn

________________________________________
From: Akira Ajisaka <aajisaka@gmail.com>
Sent: Tuesday, October 2, 2018 9:37 PM
To: Jeremiah Adams
Cc: yarn-dev@hadoop.apache.org
Subject: Re: Resourcemanager Failing on OpenJDK11

Hi Jeremiah,

I wrote a patch to fix this issue in
https://url.emailprotection.link/?aXbNFujPDP4Cfs-6OQ7jlf8T9J_NulRd7SGvkTYwMFSCcpT8rfYP_77HQteuHN0GqNu5ThkVsxWK-Ca0mFfv2cw~~

There is also a wiki to document the progress of Java 9, 10, and 11 support.
https://url.emailprotection.link/?aqtDT9nGZlDfQ6CDagckDXG_qA-bYuc0oOhrPxAJMZ8UvE7Xxij3gkTp-tag4iCp0lulSdnHJIAUtI4wnRr7z_jKarDj5icmYom3DOfadSyYa3mOomaEzNFas3PeOfvND

Now there is no community consensus regarding the plan of Java 11 support,
however, I'd like to support Java 11 in Apache Hadoop 3.3 release.

Thanks,
Akira
2018年10月3日(水) 4:14 Jeremiah Adams <JAdams@helixeducation.com>:
>
> I am doing some testing of OpenJDK 11 and YARN, Kafka and Samza. I found that I YARN
Resourcemanager will not run on OpenJDK11. I didn’t see any tasking in JIRA regarding Java
11.
>
> What are YARN’s plans regarding OpenJDK11 and the changes to Oracle support and release
cadences? Is there an Epic or Stories regarding Java 11 that I can add this issue to?
>
>
> The issue with Resourcemanager is the WebAppContext failing:
>
>
> Caused by: java.lang.NoClassDefFoundError: javax/activation/DataSource
>
>
> The Activation package was lumped in with J2EE and CORBA for removal. Deprecated in v.
9, marked for removal and removed in v.11. Now gone.
>
>
>
> Output from the logs:
>
>
>
>
> 2018-10-02 07:36:37,410 WARN org.eclipse.jetty.webapp.WebAppContext: Failed startup of
context o.e.j.w.WebAppContext@43d3aba5{/,file:///private/var/folders/9y/92nwpmbd6pjf4m68mkcw29z40000gn/T/jetty-0.0.0.0-8042-node-_-any-10842369110863142525.dir/webapp/,UNAVAILABLE}{/node}
>
> com.google.inject.ProvisionException: Unable to provision, see the following errors:
>
>
> 1) Error injecting constructor, java.lang.NoClassDefFoundError: javax/activation/DataSource
>
>  at org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:52)
>
>  at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer$NMWebApp.setup(WebServer.java:153)
>
>  while locating org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver
>
>
> 1 error
>
>        at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1025)
>
>        at com.google.inject.internal.InjectorImpl.getInstance(InjectorImpl.java:1051)
>
>        at com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory$GuiceInstantiatedComponentProvider.getInstance(GuiceComponentProviderFactory.java:345)
>
>        at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory$ManagedSingleton.<init>(IoCProviderFactory.java:202)
>
>        at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory.wrap(IoCProviderFactory.java:123)
>
>        at com.sun.jersey.core.spi.component.ioc.IoCProviderFactory._getComponentProvider(IoCProviderFactory.java:116)
>
>        at com.sun.jersey.core.spi.component.ProviderFactory.getComponentProvider(ProviderFactory.java:153)
>
>        at com.sun.jersey.core.spi.component.ProviderServices.getComponent(ProviderServices.java:278)
>
>        at com.sun.jersey.core.spi.component.ProviderServices.getProviders(ProviderServices.java:151)
>
>        at com.sun.jersey.core.spi.factory.ContextResolverFactory.init(ContextResolverFactory.java:83)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1332)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:180)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:799)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:795)
>
>        at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
>
>        at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:795)
>
>        at com.sun.jersey.guice.spi.container.servlet.GuiceContainer.initiate(GuiceContainer.java:121)
>
>        at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:339)
>
>        at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:605)
>
>        at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:207)
>
>        at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:394)
>
>        at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:744)
>
>        at com.google.inject.servlet.FilterDefinition.init(FilterDefinition.java:112)
>
>        at com.google.inject.servlet.ManagedFilterPipeline.initPipeline(ManagedFilterPipeline.java:99)
>
>        at com.google.inject.servlet.GuiceFilter.init(GuiceFilter.java:220)
>
>        at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
>
>        at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
>
>        at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:349)
>
>        at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1406)
>
>        at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1368)
>
>        at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778)
>
>        at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262)
>
>        at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:522)
>
>        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
>
>        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
>
>        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
>
>        at org.eclipse.jetty.server.Server.start(Server.java:422)
>
>        at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
>
>        at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
>
>        at org.eclipse.jetty.server.Server.doStart(Server.java:389)
>
>        at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
>
>        at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1134)
>
>        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:439)
>
>        at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:428)
>
>        at org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer.serviceStart(WebServer.java:112)
>
>        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
>
>        at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:121)
>
>        at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
>
>        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:930)
>
>        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:997)
>
> Caused by: java.lang.NoClassDefFoundError: javax/activation/DataSource
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeBuiltinLeafInfoImpl.<clinit>(RuntimeBuiltinLeafInfoImpl.java:457)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeTypeInfoSetImpl.<init>(RuntimeTypeInfoSetImpl.java:65)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeModelBuilder.createTypeInfoSet(RuntimeModelBuilder.java:133)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeModelBuilder.createTypeInfoSet(RuntimeModelBuilder.java:85)
>
>        at com.sun.xml.bind.v2.model.impl.ModelBuilder.<init>(ModelBuilder.java:156)
>
>        at com.sun.xml.bind.v2.model.impl.RuntimeModelBuilder.<init>(RuntimeModelBuilder.java:93)
>
>        at com.sun.xml.bind.v2.runtime.JAXBContextImpl.getTypeInfoSet(JAXBContextImpl.java:473)
>
>        at com.sun.xml.bind.v2.runtime.JAXBContextImpl.<init>(JAXBContextImpl.java:319)
>
>        at com.sun.xml.bind.v2.runtime.JAXBContextImpl$JAXBContextBuilder.build(JAXBContextImpl.java:1170)
>
>        at com.sun.xml.bind.v2.ContextFactory.createContext(ContextFactory.java:145)
>
>        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
>        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>        at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>
>        at javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:262)
>
>        at javax.xml.bind.ContextFinder.newInstance(ContextFinder.java:249)
>
>        at javax.xml.bind.ContextFinder.find(ContextFinder.java:456)
>
>        at javax.xml.bind.JAXBContext.newInstance(JAXBContext.java:656)
>
>        at com.sun.jersey.api.json.JSONJAXBContext.<init>(JSONJAXBContext.java:255)
>
>        at org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver.<init>(JAXBContextResolver.java:57)
>
>        at org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver$$FastClassByGuice$$21622eea.newInstance(<generated>)
>
>        at com.google.inject.internal.cglib.reflect.$FastConstructor.newInstance(FastConstructor.java:40)
>
>        at com.google.inject.internal.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:61)
>
>        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)
>
>        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85)
>
>        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267)
>
>        at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46)
>
>        at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103)
>
>        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)
>
>        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145)
>
>        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41)
>
>        at com.google.inject.internal.InjectorImpl$2$1.call(InjectorImpl.java:1016)
>
>        at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092)
>
>        at com.google.inject.internal.InjectorImpl$2.get(InjectorImpl.java:1012)
>
>        ... 52 more
>
> Caused by: java.lang.ClassNotFoundException: javax.activation.DataSource
>
>        at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:582)
>
>        at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
>
>        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:521)
>
>        ... 86 more
>
> 2018-10-02 07:36:37,429 INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@d535a3d{HTTP/1.1,[http/1.1]}{0.0.0.0:8042}
>
> ?
>
>
>
> Jeremiah Adams
> Software Engineer
> https://url.emailprotection.link/?ahfhEufaAWbezBrUFPG98ZJcterGfIerU3ZwsA3Gv_C0~<https://url.emailprotection.link/?a49H2rNGIIBtQOw6md8OcHp-qKE3Xn2gNiZ3dlqAeSDA~>
> Blog<https://url.emailprotection.link/?a49H2rNGIIBtQOw6md8OcHgFEZu-KYuiu8doY66NWwmmyWxz7kC-27Yfnbdgd2wyh5gjXUa6LMT_NRXsj1g1VVg~~>
| Twitter<https://url.emailprotection.link/?a0Q7ct5_6cOdbJ86kpWB0zx6RbtgugTVC7lU_W7za50jLdZQGpLgVlR1V06zckSaM5oOKb6QBo46Qp9xt0Tt7Aw~~>
| Facebook<https://url.emailprotection.link/?aAmyAO_nS_C1aDgBLeKyGTu0tksTt1_mn2PcS8KJXNJPM04iRHKgX96qGgENV-dMSER5wl8zDVRr3RsS0OmcF9A~~>
| LinkedIn<https://url.emailprotection.link/?aanlcNI-cN74Gdz-TD332xAl6lHu7TRNICWoHUFjYf-KlBjrCGHoYR65b3rl-OyW10nWFv6hwYvUSoVHL4b3vGA~~>

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org


Mime
View raw message