spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rishi Shah <>
Subject [pyspark 2.4.0] write with partitionBy fails due to file already exits
Date Mon, 01 Jul 2019 11:17:58 GMT
Hi All,

I have a simple partition write like below:

df ='read-location')

this fails after an hr with "file already exists (in .staging directory)"
error. Not sure what am I doing wrong here..


Rishi Shah

View raw message