spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <>
Subject Re: How to modify Hadoop APIs used by Spark?
Date Mon, 21 Sep 2015 20:23:23 GMT
Can you clarify what you want to do:
If you modify existing hadoop InputFormat, etc, it would be a matter of
rebuilding hadoop and build Spark using the custom built hadoop as

Do you introduce new InputFormat ?


On Mon, Sep 21, 2015 at 1:20 PM, Dogtail Ray <> wrote:

> Hi all,
> I find that Spark uses some Hadoop APIs such as InputFormat, InputSplit,
> etc., and I want to modify these Hadoop APIs. Do you know how can I
> integrate my modified Hadoop code into Spark? Great thanks!

View raw message