spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Blue <>
Subject Re: Apache Hive with Spark Configuration
Date Tue, 03 Jan 2017 20:32:37 GMT

Spark is currently using Hive 1.2.1 to interact with the Metastore. Using
that version for Hive is going to be the most reliable, but the metastore
API doesn't change very often and we've found (from having different
versions as well) that older versions are mostly compatible. Some things
fail occasionally, but we haven't had too many problems running different
versions with the same metastore in practice.


On Wed, Dec 28, 2016 at 4:22 AM, Chetan Khatri <>

> Hello Users / Developers,
> I am using Hive 2.0.1 with MySql as a Metastore, can you tell me which
> version is more compatible with Spark 2.0.2 ?
> THanks

Ryan Blue
Software Engineer

View raw message