spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nan Zhu <>
Subject Discussion on SPARK-1139
Date Wed, 26 Feb 2014 13:23:29 GMT
Hi, all  

I just created a JIRA . The issue discusses

the new Hadoop API based Spark APIs are actually a mixture of old and new Hadoop API.

Spark APIs are still using JobConf (or Configuration) as one of the parameters, but actually
Configuration has been replace by mapreduce.Job in the new Hadoop API

for example :

& (p10)

Personally I think it’s better to fix this design, but it will introduce some compatibility

Just bring it here for your advices


Nan Zhu

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message