Hello , 


I'm using spark 2.4.4 and i keep receiving this error message. Can you please help me identify the problem?


thank you , 

yours sincerely

Asma ZGOLLI

PhD student in data engineering - computer science

PJ:



"main" java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf$.LEGACY_PASS_PARTITION_BY_AS_OPTIONS()Lorg/apache/spark/internal/config/ConfigEntry;

at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:277)