spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Subhash Sriram <subhash.sri...@gmail.com>
Subject Spark JDBC bulk insert
Date Thu, 01 Feb 2018 16:49:13 GMT
Hey everyone,

I have a use case where I will be processing data in Spark and then writing
it back to MS SQL Server.

Is it possible to use bulk insert functionality and/or batch the writes
back to SQL?

I am using the DataFrame API to write the rows:

sqlContext.write.jdbc(...)

Thanks in advance for any ideas or assistance!
Subhash

Mime
View raw message