spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yin Huai <huaiyin....@gmail.com>
Subject Re: How to deal with BigInt in my case class for RDD => SchemaRDD convertion
Date Fri, 21 Nov 2014 15:30:37 GMT
Hello Jianshi,

The reason of that error is that we do not have a Spark SQL data type for
Scala BigInt. You can use Decimal for your case.

Thanks,

Yin

On Fri, Nov 21, 2014 at 5:11 AM, Jianshi Huang <jianshi.huang@gmail.com>
wrote:

> Hi,
>
> I got an error during rdd.registerTempTable(...) saying scala.MatchError:
> scala.BigInt
>
> Looks like BigInt cannot be used in SchemaRDD, is that correct?
>
> So what would you recommend to deal with it?
>
> Thanks,
> --
> Jianshi Huang
>
> LinkedIn: jianshi
> Twitter: @jshuang
> Github & Blog: http://huangjs.github.com/
>

Mime
View raw message