spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Afshartous, Nick" <nafshart...@turbine.com>
Subject Using Spark SQL / Hive on AWS EMR
Date Thu, 03 Mar 2016 13:20:00 GMT

Hi,


On AWS EMR 4.2 / Spark 1.5.2, I tried the example here


  https://spark.apache.org/docs/1.5.0/sql-programming-guide.html#hive-tables


to load data from a file into a Hive table.


  scala> val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)

  scala> sqlContext.sql("CREATE TABLE IF NOT EXISTS src (key INT, value STRING)")

scala> sqlContext.sql("LOAD DATA LOCAL INPATH 'data.txt' INTO TABLE src")



The resultant error is below.  Just wondering if I'm missing any steps in getting Hive setup
on the AWS EMR Spark setup.


Thanks,

--

    Nick



16/03/02 14:14:04 INFO Hive: Renaming src: file:/home/hadoop/data.txt, dest: hdfs://ip-10-247-128-59.ec2.internal:8020/user/hive/warehouse/src/data_copy_2.txt,
Status:true
16/03/02 14:14:04 WARN RetryingMetaStoreClient: MetaStoreClient lost connection. Attempting
to reconnect.
org.apache.thrift.TApplicationException: Invalid method name: 'alter_table_with_cascade'

Mime
View raw message