flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3929) Support for Kerberos Authentication with Keytab Credential
Date Mon, 22 Aug 2016 22:13:22 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431703#comment-15431703
] 

ASF GitHub Bot commented on FLINK-3929:
---------------------------------------

Github user vijikarthi commented on the issue:

    https://github.com/apache/flink/pull/2275
  
    > YARNSessionFIFOSecuredITCase gives me the following:
        17:49:58,097 INFO SecurityLogger.org.apache.hadoop.ipc.Server - Auth successful for
appattempt_1471880990715_0001_000001 (auth:SIMPLE)
     It is not using Kerberos it seems. We should check that security is really enabled and
fail the test if not.
    
    How did you run the Yarn IT test? I am seeing some compile issues when I try to run the
below command?
    
    ```
    > mvn verify -pl flink-yarn-tests -Pinclude-yarn-tests
    [INFO] Scanning for projects...
    [INFO]                                                                         
    [INFO] ------------------------------------------------------------------------
    [INFO] Building flink-yarn-tests 1.2-SNAPSHOT
    [INFO] ------------------------------------------------------------------------
    [INFO] 
    [INFO] --- maven-checkstyle-plugin:2.16:check (validate) @ flink-yarn-tests_2.10 ---
    [INFO] 
    [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ flink-yarn-tests_2.10
---
    [INFO] 
    [INFO] --- build-helper-maven-plugin:1.7:add-source (add-source) @ flink-yarn-tests_2.10
---
    [INFO] Source directory: /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/main/scala
added.
    [INFO] 
    [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ flink-yarn-tests_2.10
---
    [INFO] 
    [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ flink-yarn-tests_2.10
---
    [INFO] Using 'UTF-8' encoding to copy filtered resources.
    [INFO] skip non existing resourceDirectory /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/main/resources
    [INFO] Copying 3 resources
    [INFO] 
    [INFO] --- scala-maven-plugin:3.1.4:compile (scala-compile-first) @ flink-yarn-tests_2.10
---
    [INFO] No sources to compile
    [INFO] 
    [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ flink-yarn-tests_2.10
---
    [INFO] No sources to compile
    [INFO] 
    [INFO] --- build-helper-maven-plugin:1.7:add-test-source (add-test-source) @ flink-yarn-tests_2.10
---
    [INFO] Test Source directory: /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/scala
added.
    [INFO] 
    [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ flink-yarn-tests_2.10
---
    [INFO] Using 'UTF-8' encoding to copy filtered resources.
    [INFO] Copying 1 resource
    [INFO] Copying 3 resources
    [INFO] 
    [INFO] --- scala-maven-plugin:3.1.4:testCompile (scala-test-compile) @ flink-yarn-tests_2.10
---
    [INFO] Nothing to compile - all classes are up to date
    [INFO] 
    [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ flink-yarn-tests_2.10
---
    [INFO] Changes detected - recompiling the module!
    [INFO] Compiling 12 source files to /workspace/git-projects/junk/apache-flink/flink-yarn-tests/target/test-classes
    [INFO] -------------------------------------------------------------
    [WARNING] COMPILATION WARNING : 
    [INFO] -------------------------------------------------------------
    [WARNING] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/UtilsTest.java:[81,47]
YARN_HEAP_CUTOFF_RATIO in org.apache.flink.configuration.ConfigConstants has been deprecated
    [WARNING] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/UtilsTest.java:[82,48]
YARN_HEAP_CUTOFF_MIN in org.apache.flink.configuration.ConfigConstants has been deprecated
    [INFO] 2 warnings 
    [INFO] -------------------------------------------------------------
    [INFO] -------------------------------------------------------------
    [ERROR] COMPILATION ERROR : 
    [INFO] -------------------------------------------------------------
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[21,41]
cannot find symbol
      symbol:   class SecurityContext
      location: package org.apache.flink.runtime.security
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[22,34]
cannot find symbol
      symbol:   class SecureTestEnvironment
      location: package org.apache.flink.test.util
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[23,34]
cannot find symbol
      symbol:   class TestingSecurityContext
      location: package org.apache.flink.test.util
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[408,68]
cannot find symbol
      symbol:   variable SECURITY_KEYTAB_KEY
      location: class org.apache.flink.configuration.ConfigConstants
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[409,68]
cannot find symbol
      symbol:   variable SECURITY_PRINCIPAL_KEY
      location: class org.apache.flink.configuration.ConfigConstants
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[46,17]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[48,68]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[49,33]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,32]
package SecurityContext does not exist
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,80]
package SecurityContext does not exist
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,36]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,75]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,61]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,25]
cannot find symbol
      symbol:   variable TestingSecurityContext
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[60,56]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[61,33]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[67,17]
cannot find symbol
      symbol:   variable SecureTestEnvironment
      location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [INFO] 17 errors 
    [INFO] -------------------------------------------------------------
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 4.428 s
    [INFO] Finished at: 2016-08-22T14:36:41-07:00
    [INFO] Final Memory: 86M/1735M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile
(default-testCompile) on project flink-yarn-tests_2.10: Compilation failure: Compilation failure:
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[21,41]
cannot find symbol
    [ERROR] symbol:   class SecurityContext
    [ERROR] location: package org.apache.flink.runtime.security
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[22,34]
cannot find symbol
    [ERROR] symbol:   class SecureTestEnvironment
    [ERROR] location: package org.apache.flink.test.util
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[23,34]
cannot find symbol
    [ERROR] symbol:   class TestingSecurityContext
    [ERROR] location: package org.apache.flink.test.util
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[408,68]
cannot find symbol
    [ERROR] symbol:   variable SECURITY_KEYTAB_KEY
    [ERROR] location: class org.apache.flink.configuration.ConfigConstants
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java:[409,68]
cannot find symbol
    [ERROR] symbol:   variable SECURITY_PRINCIPAL_KEY
    [ERROR] location: class org.apache.flink.configuration.ConfigConstants
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[46,17]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[48,68]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[49,33]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,32]
package SecurityContext does not exist
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[51,80]
package SecurityContext does not exist
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,36]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[52,75]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,61]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[55,25]
cannot find symbol
    [ERROR] symbol:   variable TestingSecurityContext
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[60,56]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[61,33]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] /workspace/git-projects/junk/apache-flink/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YARNSessionFIFOSecuredITCase.java:[67,17]
cannot find symbol
    [ERROR] symbol:   variable SecureTestEnvironment
    [ERROR] location: class org.apache.flink.yarn.YARNSessionFIFOSecuredITCase
    [ERROR] -> [Help 1]
    [ERROR] 
    [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR] 
    [ERROR] For more information about the errors and possible solutions, please read the
following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException



> Support for Kerberos Authentication with Keytab Credential
> ----------------------------------------------------------
>
>                 Key: FLINK-3929
>                 URL: https://issues.apache.org/jira/browse/FLINK-3929
>             Project: Flink
>          Issue Type: New Feature
>            Reporter: Eron Wright 
>            Assignee: Vijay Srinivasaraghavan
>              Labels: kerberos, security
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> _This issue is part of a series of improvements detailed in the [Secure Data Access|https://docs.google.com/document/d/1-GQB6uVOyoaXGwtqwqLV8BHDxWiMO2WnVzBoJ8oPaAs/edit?usp=sharing]
design doc._
> Add support for a keytab credential to be associated with the Flink cluster, to facilitate:
> - Kerberos-authenticated data access for connectors
> - Kerberos-authenticated ZooKeeper access
> Support both the standalone and YARN deployment modes.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message