crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Micah Whitacre (JIRA)" <>
Subject [jira] [Created] (CRUNCH-606) Create a KafkaSource
Date Fri, 22 Apr 2016 21:20:13 GMT
Micah Whitacre created CRUNCH-606:

             Summary: Create a KafkaSource
                 Key: CRUNCH-606
             Project: Crunch
          Issue Type: New Feature
          Components: IO
            Reporter: Micah Whitacre
            Assignee: Micah Whitacre

Pulling data out of Kafka is a common use case and some of the ways to do it Kafka Connect,
Camus, Gobblin do not integrate nicely with existing processing pipelines like Crunch.  With
Kafka 0.9, the consuming API is a lot easier so we should build a Source implementation that
can read from Kafka.

This message was sent by Atlassian JIRA

View raw message