spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vida Ha <>
Subject Save an RDD to a SQL Database
Date Wed, 06 Aug 2014 03:29:34 GMT

I would like to save an RDD to a SQL database.  It seems like this would be
a common enough use case.  Are there any built in libraries to do it?

Otherwise, I'm just planning on mapping my RDD, and having that call a
method to write to the database.   Given that a lot of records are going to
be written, the code would need to be smart and do a batch insert after
enough records have collected.  Does that sound like a reasonable approach?


View raw message