spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <>
Subject Spark support for update/delete operations on Hive ORC transactional tables
Date Thu, 02 Jun 2016 08:54:14 GMT

Spark does not support transactions because as I understand there is a
piece in the execution side that needs to send heartbeats to Hive metastore
saying a transaction is still alive". That has not been implemented in
Spark yet to my knowledge."

Any idea on the timelines when we are going to have support for
transactions in Spark for Hive ORC tables. This will really be useful.


Dr Mich Talebzadeh

LinkedIn *

View raw message