spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Afshartous, Nick" <>
Subject Using Spark SQL / Hive on AWS EMR
Date Thu, 03 Mar 2016 13:20:00 GMT


On AWS EMR 4.2 / Spark 1.5.2, I tried the example here

to load data from a file into a Hive table.

  scala> val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)

  scala> sqlContext.sql("CREATE TABLE IF NOT EXISTS src (key INT, value STRING)")

scala> sqlContext.sql("LOAD DATA LOCAL INPATH 'data.txt' INTO TABLE src")

The resultant error is below.  Just wondering if I'm missing any steps in getting Hive setup
on the AWS EMR Spark setup.




16/03/02 14:14:04 INFO Hive: Renaming src: file:/home/hadoop/data.txt, dest: hdfs://ip-10-247-128-59.ec2.internal:8020/user/hive/warehouse/src/data_copy_2.txt,
16/03/02 14:14:04 WARN RetryingMetaStoreClient: MetaStoreClient lost connection. Attempting
to reconnect.
org.apache.thrift.TApplicationException: Invalid method name: 'alter_table_with_cascade'

View raw message