spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jörn Franke <jornfra...@gmail.com>
Subject Re: writing into oracle database is very slow
Date Thu, 18 Apr 2019 15:34:03 GMT
What is the size of the data? How much time does it need on HDFS and how much on Oracle? How
many partitions do you have on Oracle side?

> Am 06.04.2019 um 16:59 schrieb Lian Jiang <jiangok2006@gmail.com>:
> 
> Hi,
> 
> My spark job writes into oracle db using:
> df.coalesce(10).write.format("jdbc").option("url", url)
>   .option("driver", driver).option("user", user)
>   .option("batchsize", 2000)
>   .option("password", password).option("dbtable", tableName).mode("append").save()
> It is much slow than writting into HDFS. The data to write is small.
> Is this expected? Thanks for any clue.
> 

Mime
View raw message