spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meetu Maltiar <meetu.malt...@gmail.com>
Subject Handling Hive Table With large number of rows
Date Mon, 08 Feb 2016 05:48:30 GMT
Hi,

I am working on an application that reads a single Hive Table and do some manipulations on
each row of it. Finally construct an XML.
Hive table will be a large data set, no chance to fit it in memory. I intend to use SparkSQL
1.2.1 (due to project limitations).
Any pointers to me on handling this large data-set will be helpful (Fetch Sizeā€¦.).

Thanks in advance.

Kind Regards,
Meetu Maltiar
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message