hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (Jira)" <j...@apache.org>
Subject [jira] [Work logged] (HADOOP-17621) hadoop-auth to remove jetty-server dependency
Date Mon, 05 Apr 2021 03:55:00 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-17621?focusedWorklogId=576692&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-576692
]

ASF GitHub Bot logged work on HADOOP-17621:
-------------------------------------------

                Author: ASF GitHub Bot
            Created on: 05/Apr/21 03:54
            Start Date: 05/Apr/21 03:54
    Worklog Time Spent: 10m 
      Work Description: hadoop-yetus commented on pull request #2865:
URL: https://github.com/apache/hadoop/pull/2865#issuecomment-813166662


   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |  13m 29s |  |  Docker mode activated.  |
   |||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files found.  |
   | +0 :ok: |  codespell  |   0m  0s |  |  codespell was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain any @author
tags.  |
   | -1 :x: |  test4tests  |   0m  0s |  |  The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also please list
what manual steps were performed to verify this patch.  |
   |||| _ trunk Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |  32m 56s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  20m 50s |  |  trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
 |
   | +1 :green_heart: |  compile  |  18m 10s |  |  trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
 |
   | +1 :green_heart: |  checkstyle  |   0m 38s |  |  trunk passed  |
   | +1 :green_heart: |  mvnsite  |   0m 44s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   0m 41s |  |  trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
 |
   | +1 :green_heart: |  javadoc  |   0m 39s |  |  trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
 |
   | +1 :green_heart: |  spotbugs  |   0m 57s |  |  trunk passed  |
   | +1 :green_heart: |  shadedclient  |  14m 10s |  |  branch has no errors when building
and testing our client artifacts.  |
   |||| _ Patch Compile Tests _ |
   | +1 :green_heart: |  mvninstall  |   0m 22s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  20m  9s |  |  the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
 |
   | -1 :x: |  javac  |  20m  9s | [/results-compile-javac-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2865/1/artifact/out/results-compile-javac-root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04.txt)
|  root-jdkUbuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
generated 1 new + 2030 unchanged - 0 fixed = 2031 total (was 2030)  |
   | +1 :green_heart: |  compile  |  18m  4s |  |  the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
 |
   | -1 :x: |  javac  |  18m  4s | [/results-compile-javac-root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2865/1/artifact/out/results-compile-javac-root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08.txt)
|  root-jdkPrivateBuild-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
generated 1 new + 1926 unchanged - 0 fixed = 1927 total (was 1926)  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks issues.  |
   | +1 :green_heart: |  checkstyle  |   0m 37s |  |  the patch passed  |
   | +1 :green_heart: |  mvnsite  |   0m 43s |  |  the patch passed  |
   | +1 :green_heart: |  xml  |   0m  1s |  |  The patch has no ill-formed XML file.  |
   | +1 :green_heart: |  javadoc  |   0m 39s |  |  the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
 |
   | +1 :green_heart: |  javadoc  |   0m 38s |  |  the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
 |
   | +1 :green_heart: |  spotbugs  |   1m  4s |  |  the patch passed  |
   | +1 :green_heart: |  shadedclient  |  14m 15s |  |  patch has no errors when building
and testing our client artifacts.  |
   |||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   3m 21s |  |  hadoop-auth in the patch passed.  |
   | +1 :green_heart: |  asflicense  |   0m 54s |  |  The patch does not generate ASF License
warnings.  |
   |  |   | 167m 18s |  |  |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2865/1/artifact/out/Dockerfile
|
   | GITHUB PR | https://github.com/apache/hadoop/pull/2865 |
   | Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient
codespell xml spotbugs checkstyle |
   | uname | Linux 84a0444cffef 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019
x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / 251623504a4655abe60306fcdfec4317dae9b57c |
   | Default Java | Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 |
   | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
/usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08 |
   |  Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2865/1/testReport/
|
   | Max. process+thread count | 722 (vs. ulimit of 5500) |
   | modules | C: hadoop-common-project/hadoop-auth U: hadoop-common-project/hadoop-auth |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2865/1/console
|
   | versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
   | Powered by | Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 576692)
    Time Spent: 0.5h  (was: 20m)

> hadoop-auth to remove jetty-server dependency
> ---------------------------------------------
>
>                 Key: HADOOP-17621
>                 URL: https://issues.apache.org/jira/browse/HADOOP-17621
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: auth
>    Affects Versions: 3.3.1, 3.4.0
>            Reporter: Wei-Chiu Chuang
>            Assignee: Wei-Chiu Chuang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> HADOOP-17371 bumped Jetty version to 9.4.35. As part of that change, we included jetty-server
in order to use a Jetty specific API to deal with a behavior change introduced by the version
bump.
> However, that broke applications like Solr [1]. Although the exact root cause isn't clear,
it is suspected that Jetty forbids loading Jetty-server classes in the web applications. More
details is in [https://portail.capsana.ca/doc/9.4.5.v20170502/jetty-classloading.html]
> This JIRA aims to use J2EE compatible API to achieve the same behavior without introducing
jetty-server.
> [1]
> {noformat}
> 2021-03-25 00:36:05.705 WARN  (qtp2144665602-17) [   ] o.e.j.s.HttpChannel /solr/admin/metrics
=> java.lang.NoClassDefFoundError: org/eclipse/
> jetty/server/Response
>         at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:632)
> java.lang.NoClassDefFoundError: org/eclipse/jetty/server/Response
>         at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:632)
~[hadoop-auth-3.1.1.7
> .2.9.0-153.jar:?]
>         at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:103)
~[solr-core-8.4.1.7.2.9.0-153.jar:8.4.1.7.2.9.0-153 f
> 9f290366013b29e885bdb9e62ad582c5fa4f29c - jenkins - 2021-03-24 18:58:11]
>         at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:250)
~[solr-core-8.4.1.7.2.9.0-153.jar:8.4.1.7.2.9.0
> -153 f9f290366013b29e885bdb9e62ad582c5fa4f29c - jenkins - 2021-03-24 18:58:11]
>         at org.apache.solr.security.AuthenticationPlugin.authenticate(AuthenticationPlugin.java:88)
~[solr-core-8.4.1.7.2.9.0-153.jar:8.4.1.7.
> 2.9.0-153 f9f290366013b29e885bdb9e62ad582c5fa4f29c - jenkins - 2021-03-24 18:58:11]
>         at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:499)
~[solr-core-8.4.1.7.2.9.0-153.jar:8.4.1
> .7.2.9.0-153 f9f290366013b29e885bdb9e62ad582c5fa4f29c - jenkins - 2021-03-24 18:58:11]
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:400)
~[solr-core-8.4.1.7.2.9.0-153.jar:8.4.1.7.2.9.0-15
> 3 f9f290366013b29e885bdb9e62ad582c5fa4f29c - jenkins - 2021-03-24 18:58:11]
>         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:346)
~[solr-core-8.4.1.7.2.9.0-153.jar:8.4.1.7.2.9.0-15
> 3 f9f290366013b29e885bdb9e62ad582c5fa4f29c - jenkins - 2021-03-24 18:58:11]
>         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1630)
~[jetty-servlet-9.4.31.v20200723.jar:9.4.31
> .v20200723]
>         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:567)
~[jetty-servlet-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602)
~[jetty-security-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v2020072
> 3]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200
> 723]
>         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v2020
> 0723]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200
> 723]
>         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1377)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v2020
> 0723]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v202007
> 23]
>         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:507)
~[jetty-servlet-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1292)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:191)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
~[jetty-rewrite-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.Server.handle(Server.java:501) ~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) ~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) ~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
~[jetty-server-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) ~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.ssl.SslConnection$DecryptedEndPoint.onFillable(SslConnection.java:540)
~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:395)
~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.ssl.SslConnection$2.succeeded(SslConnection.java:161)
~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) ~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) ~[jetty-io-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
~[jetty-util-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
~[jetty-util-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
~[jetty-util-9.4.31.v20200723.jar:9.4.31.
> v20200723]
>         at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:135)
~[jetty-util-9.4.31.v20200723.jar:9.4.31.v20
>         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
[jetty-util-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
[jetty-util-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232]
> Caused by: java.lang.ClassNotFoundException: org.eclipse.jetty.server.Response
>         at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565)
~[jetty-webapp-9.4.31.v20200723.jar:9.4.31.v20200723]
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_232]
>         ... 46 more
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message