spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Davies Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-18097) Can't drop a table from Hive if the schema is corrupt
Date Tue, 25 Oct 2016 16:26:58 GMT
Davies Liu created SPARK-18097:
----------------------------------

             Summary: Can't drop a table from Hive if the schema is corrupt
                 Key: SPARK-18097
                 URL: https://issues.apache.org/jira/browse/SPARK-18097
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.1
            Reporter: Davies Liu


When the schema of Hive table is broken, we can't drop the table using Spark SQL, for example
{code}
Error in SQL statement: QueryExecutionException: FAILED: IllegalArgumentException Error: >
expected at the position 4443 of 'struct<AVG_OPTION_CODE:struct<similarity:double,source:string>,AVG_OPTION_DETAIL:struct<similarity:double,source:string>,EXT_COLOR_CODE:struct<similarity:double,source:string>,EXT_COLOR_NAME:struct<similarity:double,source:string>,INT_COLOR_CODE:struct<similarity:double,source:string>,INT_COLOR_NAME:struct<similarity:double,source:string>,OEM_CODE:struct<similarity:double,source:string>,TRIM:struct<similarity:double,source:string>>:struct<DMI_CPO:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,DMI_EDDIRECT:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,DMI_THIRDPARTY:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,DOMINION:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,EBIZAUTOS:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,INT_COLOR_NAME:struct<similarity:double,solrValue:string,vdivValue:string>,OEM_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,TRIM:struct<similarity:double,solrValue:string,vdivValue:string>>>,VAST_HOSTED:struct<scores:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>,similarities:struct<AVG_OPTION_CODE:struct<similarity:double,solrValue:string,vdivValue:string>,AVG_OPTION_DETAIL:struct<similarity:double,solrValue:string,vdivValue:string>,EXT_COLOR_CO:string:struct<EXT_COLOR:double,INT_COLOR:double,OPTION:double,STYLE:double,TOTAL:double,TOTAL_COLOR:double>'
but ':' is found.
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message