crunch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Evan McClain <>
Subject Custom ReadableSource implementations that reuse a PType?
Date Thu, 14 Jan 2016 17:08:03 GMT
Hi list,

I am trying to implement a custom ReadableSource by extending
FileSourceImpl, but it doesn't look like my source is actually being
used since I am reusing AvroTypes (basically just trying to pass
through some avro getMeta() values).

It looks like cache() -> materialize() -> ptype.getDefaultFileSource()
is being used to perform the actual read (even though
is being passed my custom Source).

Is there any way to do this without also implementing a custom PType?

Evan McClain

View raw message