spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meetu Maltiar <>
Subject Handling Hive Table With large number of rows
Date Mon, 08 Feb 2016 05:48:30 GMT

I am working on an application that reads a single Hive Table and do some manipulations on
each row of it. Finally construct an XML.
Hive table will be a large data set, no chance to fit it in memory. I intend to use SparkSQL
1.2.1 (due to project limitations).
Any pointers to me on handling this large data-set will be helpful (Fetch Sizeā€¦.).

Thanks in advance.

Kind Regards,
Meetu Maltiar
To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message