spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Soheil Pourbafrani <>
Subject How thriftserver load data
Date Wed, 16 Jan 2019 08:15:28 GMT
Hi, I want to write an application that load data from HDFS into tables and
create a ThriftServer and submit it to the YARN cluster.

The question is how Spark actually load data. Does Spark load data in the
memory since the application started or it waits for query and just loads
data according to the query needs?

View raw message