spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sivaprasanna <>
Subject Is there a merge API available for writing DataFrame
Date Fri, 15 Nov 2019 08:47:31 GMT

As the title implies, do we have a way of merging a DataFrame into a sink
(either Table or a distribute filesystem)? I'm sure we cannot have a full
fledged equivalent of Hive's MERGE INTO but maybe we can have a way of
writing (updating) only those rows present in the DF, with the rest of the
rows/data in the sink untouched.


View raw message