spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ABHISHEK KUMAR GUPTA (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-29573) Spark should work as PostgreSQL when using + Operator
Date Tue, 29 Oct 2019 04:55:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-29573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ABHISHEK KUMAR GUPTA updated SPARK-29573:
-----------------------------------------
    Description: 
Spark and PostgreSQL result is different when concatenating as below :

{code}
Spark : Giving NULL result 
0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
+-----+---------+
| id | name |
+-----+---------+
| 20 | test |
| 10 | number |
+-----+---------+
2 rows selected (3.683 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address from emp12;
+-----+----------+
| ID | address |
+-----+----------+
| 20 | NULL |
| 10 | NULL |
+-----+----------+
2 rows selected (0.649 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address from emp12;
+-----+----------+
| ID | address |
+-----+----------+
| 20 | NULL |
| 10 | NULL |
+-----+----------+
2 rows selected (0.406 seconds)
0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as address from
emp12;
+-----+----------+
| ID | address |
+-----+----------+
| 20 | NULL |
| 10 | NULL |
+-----+----------+
PostgreSQL: Saying throwing Error saying not supported
create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+','+name as address from emp12;

output: invalid input syntax for integer: ","

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+name as address from emp12;

Output: 42883: operator does not exist: integer + character varying
{code}




 

  was:
Spark and PostgreSQL result is different when concatenating as below :

Spark : Giving NULL result 

{code}
0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
+-----+---------+
| id | name |
+-----+---------+
| 20 | test |
| 10 | number |
+-----+---------+
2 rows selected (3.683 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address from emp12;
+-----+----------+
| ID | address |
+-----+----------+
| 20 | NULL |
| 10 | NULL |
+-----+----------+
2 rows selected (0.649 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address from emp12;
+-----+----------+
| ID | address |
+-----+----------+
| 20 | NULL |
| 10 | NULL |
+-----+----------+
2 rows selected (0.406 seconds)

0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as address from
emp12;
+-----+----------+
| ID | address |
+-----+----------+
| 20 | NULL |
| 10 | NULL |
+-----+----------+
{code}

 

PostgreSQL: Saying throwing Error saying not supported

{code}
create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+','+name as address from emp12;

output: invalid input syntax for integer: ","

create table emp12(id int,name varchar(255));
insert into emp12 values(10,'number');
insert into emp12 values(20,'test');
select id as ID, id+name as address from emp12;

Output: 42883: operator does not exist: integer + character varying
{code}

 

It should throw Error in Spark if it is not supported.

 


> Spark should work as PostgreSQL when using + Operator
> -----------------------------------------------------
>
>                 Key: SPARK-29573
>                 URL: https://issues.apache.org/jira/browse/SPARK-29573
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: ABHISHEK KUMAR GUPTA
>            Priority: Major
>
> Spark and PostgreSQL result is different when concatenating as below :
> {code}
> Spark : Giving NULL result 
> 0: jdbc:hive2://10.18.19.208:23040/default> select * from emp12;
> +-----+---------+
> | id | name |
> +-----+---------+
> | 20 | test |
> | 10 | number |
> +-----+---------+
> 2 rows selected (3.683 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address from
emp12;
> +-----+----------+
> | ID | address |
> +-----+----------+
> | 20 | NULL |
> | 10 | NULL |
> +-----+----------+
> 2 rows selected (0.649 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+name as address from
emp12;
> +-----+----------+
> | ID | address |
> +-----+----------+
> | 20 | NULL |
> | 10 | NULL |
> +-----+----------+
> 2 rows selected (0.406 seconds)
> 0: jdbc:hive2://10.18.19.208:23040/default> select id as ID, id+','+name as address
from emp12;
> +-----+----------+
> | ID | address |
> +-----+----------+
> | 20 | NULL |
> | 10 | NULL |
> +-----+----------+
> PostgreSQL: Saying throwing Error saying not supported
> create table emp12(id int,name varchar(255));
> insert into emp12 values(10,'number');
> insert into emp12 values(20,'test');
> select id as ID, id+','+name as address from emp12;
> output: invalid input syntax for integer: ","
> create table emp12(id int,name varchar(255));
> insert into emp12 values(10,'number');
> insert into emp12 values(20,'test');
> select id as ID, id+name as address from emp12;
> Output: 42883: operator does not exist: integer + character varying
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message