crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christian Tzolov <>
Subject Crunch integration with ElasticSearch
Date Mon, 08 Apr 2013 03:32:15 GMT
I've been working on Crunch - ElasticSearch (
 integration over the weekend :)

Here is my first prototype: and a sample

It implements ES Source and Target on top of the ES-Hadoop's ( ESInputFormat and

Not sure though what is the best/right way to build Source/Targets for new
Input/Output Formats? Any suggestions, references?

The write to ES is tricky and at the moment looks more like a hack (see the


(P.S The prototype doesn't support AvroTypeFamily yet but I've been looking
at jackson-dataformat-avro kind of solution (ES-Hadoop relies on Jackson
for the JSON serialisation)

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message