spot-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vartika Singh <vsi...@cloudera.com>
Subject [DISCUSS] New development branch for ingestion component
Date Wed, 01 Nov 2017 03:31:32 GMT
Hello all,

The following document has been out for discussion for a while:

https://docs.google.com/document/d/1yYaD50gp2HN9RHYaUG8ASDfh3f__
GyB1Msu2LUofIU4/edit#heading=h.ptz51qlqt0t

I would like to start a new branch for ingestion component. A

Again, the idea of ingestion component is the following:

   1. Extendible to any source.
   2. NRT latency between ingestion and output to the HDFS/persistent store.
   3. Maintain the integrity of the ODM module in order to facilitate
   seamless integration with applications.


Thoughts?

Vartika Singh

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message