chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From AD <>
Subject piping data into Cassandra
Date Wed, 26 Oct 2011 01:34:16 GMT

 I currently push apache logs into Chukwa.  I am trying to figure out how to
get all those logs into Cassandra and run mapreduce there.  Is the best
place to do this in Demux (right my own version of TSProcessor?)

 Also the data flow seems to miss a step.  The page says in 3.3

   - demux moves complete files to: dataSinkArchives/[yyyyMMdd]/*/*.done
 - the next step is to move files from

  How do they get from dataSinkArchives to postProcess?  does this run
inside of DemuxManager or a separate process (bin/chukwa demux) ?


View raw message