flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-6836) Failing YARNSessionCapacitySchedulerITCase.testTaskManagerFailure
Date Thu, 15 Jun 2017 09:44:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050238#comment-16050238
] 

ASF GitHub Bot commented on FLINK-6836:
---------------------------------------

Github user tillrohrmann commented on the issue:

    https://github.com/apache/flink/pull/4120
  
    I first thought I had to downgrade, because of the aforementioned problem. However, Hadoop
2.8.0 needs at least httpclient `4.5.2`. Luckily, they fixed the problem with the `URLEncodedUtils#parse`
method in `4.5.3`. Therefore I bumped the version again.
    
    Concerning moving the dependency management to `flink-shaded-hadoop`: I think this is
unfortunately not possible since due the immutable reactor builds from maven, `flink-yarn-tests`
pulls all dependencies from `flink-shaded-hadoop` and `flink-shaded-yarn-tests`. This also
means that depending on the classpath order, we either use the shaded Yarn mini-cluster or
not. In the latter case we have to make sure that we are using `httpclient` `4.5.3` which
is only the case if we define the dependency management in the parent pom.
    
    As a side remark, given this situation with maven, I'm not sure whether we actually need
the `flink-shaded-yarn-tests` module.
    
    A proper solution would be fixing the problem with the immutable builds. For example,
everything works properly if we first install the shaded jars and then build the flink-yarn-tests.
Then maven will properly resolve all dependencies. In this case, I think it should be possible
to move the dependency management into `flink-shaded-hadoop`.


> Failing YARNSessionCapacitySchedulerITCase.testTaskManagerFailure
> -----------------------------------------------------------------
>
>                 Key: FLINK-6836
>                 URL: https://issues.apache.org/jira/browse/FLINK-6836
>             Project: Flink
>          Issue Type: Bug
>          Components: Tests, YARN
>    Affects Versions: 1.4.0
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>            Priority: Critical
>              Labels: test-stability
>
> The master is currently unstable. The {{YARNSessionCapacitySchedulerITCase.testTaskManagerFailure}}
fails with Hadoop version {{2.6.5}}, {{2.7.3}} and {{2.8.0}}.
> See this build [1] for example.
> [1] https://travis-ci.org/apache/flink/builds/238720589



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message