spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Li (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-15515) Error Handling in Running SQL Directly On Files
Date Tue, 24 May 2016 22:16:12 GMT

     [ https://issues.apache.org/jira/browse/SPARK-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiao Li updated SPARK-15515:
----------------------------
    Description: 
For ORC source format, we are reporting the strange error message when we did not enable Hive
support: 
{noformat}
Table or view not found: `org.apache.spark.sql.hive.orc`.`file_path`
{noformat}
The example query is like
{noformat}
      sql(s"select id from `org.apache.spark.sql.hive.orc`.`file_path`")
{noformat}
Instead, we should issue the error message like:
{noformat}
"The ORC data source must be used with Hive support enabled"
{noformat}

For the Avro format, we still report the error message like:
{noformat}
Table or view not found: `com.databricks.spark.avro`.`file_path`
{noformat}

The example query is like
{noformat}
      sql(s"select id from `avro`.`file_path`")
      sql(s"select id from `com.databricks.spark.avro`.`file_path`")
{noformat}

The desired message should be like:
{noformat}
Failed to find data source: avro. Please use Spark package http://spark-packages.org/package/databricks/spark-avro"
{noformat}


  was:
For ORC source format, we are reporting the strange error message when we did not enable Hive
support: 
{noformat}
Table or view not found: `org.apache.spark.sql.hive.orc`.`file_path`
{noformat}
The example query is like
{noformat}
      sql(s"select id from `org.apache.spark.sql.hive.orc`.`file_path`")
{noformat}
Instead, we should issue the error message like:
{noformat}
"The ORC data source must be used with Hive support enabled"
{noformat}

For the Avro format, we still report the error message like:
      sql(s"select id from `com.databricks.spark.avro`.`file_path`")

{noformat}
Table or view not found: `com.databricks.spark.avro`.`file_path`
{noformat}

The example query is like
{noformat}
      sql(s"select id from `avro`.`file_path`")
      sql(s"select id from `com.databricks.spark.avro`.`file_path`")
{noformat}

The desired message should be like:
{noformat}
Failed to find data source: avro. Please use Spark package http://spark-packages.org/package/databricks/spark-avro"
{noformat}



> Error Handling in Running SQL Directly On Files
> -----------------------------------------------
>
>                 Key: SPARK-15515
>                 URL: https://issues.apache.org/jira/browse/SPARK-15515
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.0
>            Reporter: Xiao Li
>
> For ORC source format, we are reporting the strange error message when we did not enable
Hive support: 
> {noformat}
> Table or view not found: `org.apache.spark.sql.hive.orc`.`file_path`
> {noformat}
> The example query is like
> {noformat}
>       sql(s"select id from `org.apache.spark.sql.hive.orc`.`file_path`")
> {noformat}
> Instead, we should issue the error message like:
> {noformat}
> "The ORC data source must be used with Hive support enabled"
> {noformat}
> For the Avro format, we still report the error message like:
> {noformat}
> Table or view not found: `com.databricks.spark.avro`.`file_path`
> {noformat}
> The example query is like
> {noformat}
>       sql(s"select id from `avro`.`file_path`")
>       sql(s"select id from `com.databricks.spark.avro`.`file_path`")
> {noformat}
> The desired message should be like:
> {noformat}
> Failed to find data source: avro. Please use Spark package http://spark-packages.org/package/databricks/spark-avro"
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message