spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From constantin <constantin.dreh...@yahoo.com.INVALID>
Subject Re: Spark 3.0 ArrayIndexOutOfBoundsException at RDDOperationScope.toJson
Date Wed, 21 Oct 2020 12:59:11 GMT
I also had a java.lang.ArrayIndexOutOfBoundsException: 28499, very similar,
after migrating to Spark 3.0.1 from 2.4.3, when performing a count,
countApprox or rdd operation on Spark datasets.

For me, this solution worked:

https://programmersought.com/article/35311239379/

Basically I added this dependency:

   <dependency>
        <groupId>com.thoughtworks.paranamer</groupId>
        <artifactId>paranamer</artifactId>
        <version>2.8</version>
    </dependency>



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message