nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sally <sally.tkhilaishv...@gmail.com>
Subject Nifi:can't import getFileSystem in customProcessor?
Date Fri, 03 Nov 2017 06:40:46 GMT
I want to use getFileSytem() for pulling in any file that is newer than the
timestamp that we have but I can't import it (I mean getFileSytem()) I have
this code:

final FileSystem hdfs = getFileSystem();
final boolean recursive = context.getProperty(RECURSE_SUBDIRS).asBoolean();
 
final Set<FileStatus> statuses;
try {
    final Path rootPath = new Path(directory);
    statuses = getStatuses(rootPath, recursive, hdfs,
            createPathFilter(context));
    getLogger().debug("Found a total of {} files in HDFS", new Object[]
            {statuses.size()});
} catch (final IOException | IllegalArgumentException e) {
    getLogger().error("Failed to perform listing of HDFS due to {}", new
            Object[]{e});
    return;
}
and here is my pom file dependencies:

<parent>
    <groupId>org.apache.nifi</groupId>
    <artifactId>nifi-hadoop-bundle</artifactId>
    <version>1.5.0-SNAPSHOT</version>
</parent>
 
<artifactId>nifi-Reader-processors</artifactId>
<packaging>nar</packaging>
 
<dependencies>
    <dependency>
        <groupId>org.apache.nifi</groupId>
        <artifactId>nifi-api</artifactId>
    </dependency>
    <dependency>
        <groupId>org.apache.nifi</groupId>
        <artifactId>nifi-utils</artifactId>
    </dependency>
    <dependency>
        <groupId>org.apache.nifi</groupId>
        <artifactId>nifi-mock</artifactId>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.slf4j</groupId>
        <artifactId>slf4j-simple</artifactId>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <scope>test</scope>
    </dependency>
 
    
    <dependency>
        <groupId>log4j</groupId>
        <artifactId>log4j</artifactId>
        <version>1.2.17</version>
    </dependency>
 
    <dependency>
        <groupId>org.apache.hadoop</groupId>
        <artifactId>hadoop-common</artifactId>
        <version>3.0.0-beta1</version>
    </dependency>
    <dependency>
        <groupId>org.apache.nifi</groupId>
        <artifactId>nifi-standard-services-api-nar</artifactId>
        <version>1.3.0</version>
        <type>nar</type>
    </dependency>
    <dependency>
        <groupId>org.apache.nifi</groupId>
        <artifactId>nifi-properties</artifactId>
    </dependency>
    <dependency>
        <groupId>org.apache.nifi</groupId>
        <artifactId>nifi-distributed-cache-client-service-api</artifactId>
    </dependency>
 
 
    <dependency>
            <groupId>org.apache.nifi</groupId>
            <artifactId>nifi-standard-nar</artifactId>
            <type>nar</type>
        </dependency>
 
 



--
Sent from: http://apache-nifi-users-list.2361937.n4.nabble.com/

Mime
View raw message