spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Spark RuntimeException hadoop output format
Date Fri, 14 Aug 2015 13:15:05 GMT
Which Spark release are you using ?

Can you show us snippet of your code ?

Have you checked namenode log ?

Thanks



> On Aug 13, 2015, at 10:21 PM, Mohit Anchlia <mohitanchlia@gmail.com> wrote:
> 
> I was able to get this working by using an alternative method however I only see 0 bytes
files in hadoop. I've verified that the output does exist in the logs however it's missing
from hdfs.
> 
>> On Thu, Aug 13, 2015 at 10:49 AM, Mohit Anchlia <mohitanchlia@gmail.com> wrote:
>> I have this call trying to save to hdfs 2.6
>> wordCounts.saveAsNewAPIHadoopFiles("prefix", "txt");
>> 
>> but I am getting the following:
>> 
>> java.lang.RuntimeException: class scala.runtime.Nothing$ not org.apache.hadoop.mapreduce.OutputFormat
> 

Mime
View raw message