flume-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhenzhao wang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLUME-3268) Introduce micro batch processing to HDFSEventSink
Date Mon, 13 Aug 2018 19:44:00 GMT
zhenzhao wang created FLUME-3268:
------------------------------------

             Summary: Introduce micro batch processing to HDFSEventSink
                 Key: FLUME-3268
                 URL: https://issues.apache.org/jira/browse/FLUME-3268
             Project: Flume
          Issue Type: New Feature
            Reporter: zhenzhao wang


In our test with HDFSEvent sink, we found that we could increase the draining speed of HDFSSink
up to 4x by introducing micro batch processing. With the micro batch processing feature, we
will batch the events written to HDFS instead of one by one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@flume.apache.org
For additional commands, e-mail: issues-help@flume.apache.org


Mime
View raw message