spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kent Yao (Jira)" <>
Subject [jira] [Created] (SPARK-30147) Trim the string when cast string type to booleans
Date Fri, 06 Dec 2019 08:10:00 GMT
Kent Yao created SPARK-30147:

             Summary: Trim the string when cast string type to booleans
                 Key: SPARK-30147
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Kent Yao

Now, we trim the string when casting string value to those `canCast` types values, e.g. int,
double, decimal, interval, date, timestamps, except for boolean. 
This behavior makes type cast and coercion inconsistency in Spark.
Not fit ANSI SQL standard either.
If TD is boolean, then
a) If SD is character string, then SV is replaced by
    TRIM ( BOTH ' ' FROM VE )
    i) If the rules for literal in Subclause 5.3, “literal”, can be applied to SV to determine
a valid
value of the data type TD, then let TV be that value.
   ii) Otherwise, an exception condition is raised: data exception — invalid character value
for cast.
b) If SD is boolean, then TV is SV

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message