spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@hortonworks.com>
Subject Re: Spark Yarn Cluster with Reference File
Date Fri, 23 Sep 2016 08:55:50 GMT

On 23 Sep 2016, at 08:33, ABHISHEK <abhietc@gmail.com<mailto:abhietc@gmail.com>>
wrote:

        at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: hdfs:/abc.com:8020/user/abhietc/abc.drl<http://abc.com:8020/user/abhietc/abc.drl>
(No such file or directory)
        at java.io.FileInputStream.open(Native Method)
        at java.io.FileInputStream.<init>(FileInputStream.java:146)
        at org.drools.core.io.impl.FileSystemResource.getInputStream(FileSystemResource.java:123)
        at org.drools.compiler.kie.builder.impl.KieFileSystemImpl.write(KieFileSystemImpl.java:58)


Looks like this .KieFileSystemImpl class only works with local files, so when it gets an HDFS
path in it tries to open it and gets confused.

you may need to write to a local FS temp file then copy it into HDFS

Mime
View raw message