spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashok Kumar <>
Subject New to Spark
Date Tue, 01 Dec 2015 10:54:55 GMT

I am new to Spark.
I am trying to use spark-sql with SPARK CREATED and HIVE CREATED tables.
I have successfully made Hive metastore to be used by Spark.
In spark-sql I can see the DDL for Hive tables. However, when I do select count(1) from HIVE_TABLE
it always returns zero rows.
If I create a table in spark as create table SPARK_TABLE as select * from HIVE_TABLE, the
table schema is created but no data.
I can then use Hive to do INSET SELECT from HIVE_TABLE into SPARK_TABLE. That works.
I can then use spark-sql to query the table.
My questions:
   - Is this correct that spark-sql only sees data in spark created tables but not any data
in Hive tables?
   - How can I make Spark read data from existing Hive tables.


View raw message