beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-1203) Exception when running apex runner in non embedded mode
Date Thu, 22 Dec 2016 02:12:58 GMT


ASF GitHub Bot commented on BEAM-1203:

GitHub user PramodSSImmaneni opened a pull request:

    [BEAM-1203] Fixed exception with app launch using apex runner in YARN mode

    @tweise please review it

You can merge this pull request into a Git repository by running:

    $ git pull BEAM-1203

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1684
commit 50b192dcd80f52621ea252f60d62e91626a89596
Author: Pramod Immaneni <>
Date:   2016-12-22T01:56:55Z

    BEAM-1203 Fixed exception when creating zip entries during Apex YARN launch


> Exception when running apex runner in non embedded mode
> -------------------------------------------------------
>                 Key: BEAM-1203
>                 URL:
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-apex
>    Affects Versions: 0.5.0-incubating
>            Reporter: Pramod Immaneni
> Tried to run the word count example application using apex runner on yarn with the command
below (the command refers to local files so app when running will not be able to access these
files but that is a different issue). There is an exception and the application does not get
> mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/home/pramod/Development/test/kinglear.txt
--output=/home/pramod/Development/test/wordcounts.txt --runner=ApexRunner --embeddedExecution=false"
> java.nio.file.FileAlreadyExistsException: META-INF/
> 	at com.sun.nio.zipfs.ZipFileSystem.createDirectory(
> 	at com.sun.nio.zipfs.ZipPath.createDirectory(
> 	at com.sun.nio.zipfs.ZipFileSystemProvider.createDirectory(
> 	at java.nio.file.Files.createDirectory(
> 	at org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(
> 	at org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(
> 	at java.nio.file.FileTreeWalker.walk(
> 	at java.nio.file.FileTreeWalker.walk(
> 	at java.nio.file.FileTreeWalker.walk(
> 	at java.nio.file.Files.walkFileTree(
> 	at java.nio.file.Files.walkFileTree(
> 	at org.apache.beam.runners.apex.ApexYarnLauncher.createJar(
> 	at org.apache.beam.runners.apex.ApexYarnLauncher.launchApp(
> 	at
> 	at
> 	at
> 	at org.apache.beam.examples.WordCount.main(
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> 	at java.lang.reflect.Method.invoke(
> 	at org.codehaus.mojo.exec.ExecJavaMojo$
> 	at

This message was sent by Atlassian JIRA

View raw message