spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jaya Shankar Vadisela <jvadis...@innominds.com>
Subject Hive Queries are running very slowly in Spark 2.0
Date Thu, 10 Nov 2016 06:02:53 GMT
Hi ALL

I have below simple HIVE Query, we have a use-case where we will run multiple HIVE queries
in parallel, in our case it is 16 (num of cores in our machine, using scala PAR array). In
Spark 1.6 it is executing in 10 secs but in Spark 2.0 same queries are taking 5 mins.

"select * from emp as e join dept as d on o.dept_id = t.dept_id where o.dept_id = 100”

Can someone help me what could be wrong.

regards, Jay
Mime
View raw message