spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shixiong Zhu <zsxw...@gmail.com>
Subject Re: spark streaming map use external variable occur a problem
Date Fri, 14 Aug 2015 10:07:08 GMT
Looks you compiled the codes with one Scala version but ran your app using
a different incompatible version.

BTW, you should not use PrintWriter like this to save your results. There
may be multiple tasks running at the same host, and your job will fail
because you are trying to write to the same file. Could you convert your
data to String using "map" and use "saveAsTextFile" or other "save" methods?

Best Regards,
Shixiong Zhu

2015-08-14 11:02 GMT+08:00 kale <805654685@qq.com>:

>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>

Mime
View raw message