spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Richard <fifistorm...@gmail.com>
Subject Spark SaveMode
Date Sat, 20 Jul 2019 04:34:43 GMT
Any reason why Spark's SaveMode doesn't have mode that ignore any Primary
Key/Unique constraint violations?

Let's say I'm using spark to migrate some data from Cassandra to Oracle, I
want the insert operation to be "ignore if exist primary keys" instead of
failing the whole batch.

Thanks,
Richard

Mime
View raw message