spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <Saif.A.Ell...@wellsfargo.com>
Subject Cant perform full outer join
Date Tue, 29 Sep 2015 13:56:50 GMT
Hi all,

So I Have two dataframes, with two columns: DATE and VALUE.

Performing this:
data = data.join(cur_data, data("DATE") === cur_data("DATE"), "outer")

returns
Exception in thread "main" org.apache.spark.sql.AnalysisException: Reference 'DATE' is ambiguous,
could be: DATE#0, DATE#3.;

But if I change one of the column names, I will get two columns and won't really merge "DATE"
column as I wish. Any ideas without going to non trivial procedures?

Thanks,
Saif


Mime
View raw message