spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vishal Bagga (JIRA)" <>
Subject [jira] [Commented] (SPARK-8386) DataFrame and JDBC regression
Date Tue, 01 Sep 2015 04:05:45 GMT


Vishal Bagga commented on SPARK-8386:

I just ran into the same issue today. This should addressed and looks like a sever limitation.

> DataFrame and JDBC regression
> -----------------------------
>                 Key: SPARK-8386
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.4.0
>         Environment: RHEL 7.1
>            Reporter: Peter Haumer
>            Priority: Critical
> I have an ETL app that appends to a JDBC table new results found at each run.  In 1.3.1
I did this:
> testResultsDF.insertIntoJDBC(CONNECTION_URL, TABLE_NAME, false);
> When I do this now in 1.4 it complains that the "object" 'TABLE_NAME' already exists.
I get this even if I switch the overwrite to true.  I also tried this now:
> testResultsDF.write().mode(SaveMode.Append).jdbc(CONNECTION_URL, TABLE_NAME, connectionProperties);
> getting the same error. It works running the first time creating the new table and adding
data successfully. But, running it a second time it (the jdbc driver) will tell me that the
table already exists. Even SaveMode.Overwrite will give me the same error. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message