spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Femi Anthony <femib...@gmail.com>
Subject Re: error , saving dataframe , LEGACY_PASS_PARTITION_BY_AS_OPTIONS
Date Wed, 13 Nov 2019 15:05:36 GMT
Can you post the line of code that’s resulting in that error along with the stack trace ?

Sent from my iPhone

> On Nov 13, 2019, at 9:53 AM, asma zgolli <zgolliasma@gmail.com> wrote:
> 
> 
> Hello , 
> 
> I'm using spark 2.4.4 and i keep receiving this error message. Can you please help me
identify the problem?
> 
> thank you , 
> yours sincerely
> Asma ZGOLLI
> 
> PhD student in data engineering - computer science
> PJ:
> 
> 
> "main" java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf$.LEGACY_PASS_PARTITION_BY_AS_OPTIONS()Lorg/apache/spark/internal/config/ConfigEntry;
> 	at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:277)
> 
> 
> 
> 
> 

Mime
View raw message