spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yana <>
Subject Re: Save an RDD to a SQL Database
Date Wed, 06 Aug 2014 15:24:10 GMT
Hi Vida,

I am writing to a DB -- or trying to :).

I believe the best practice for this (you can search the mailing list
archives) is to do a combination of mapPartitions and use a grouped
Look at this thread, esp. the comment from A. Boisvert and Matei's comment
above it:!topic/spark-users/LUb7ZysYp2k

Basically the short story is that you want to open as few connections as
possible but write more than 1 insert at a time.

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message