spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ulanov, Alexander" <>
Subject Logging from the Spark shell
Date Wed, 05 Nov 2014 20:57:27 GMT
Dear Spark users,

I would like to run a long experiment using spark-shell. How can I log my intermediate results
(numbers, strings) into some file on a master node? What are the best practices? It is NOT
performance metrics of Spark that I want to log every X seconds. Instead, I would like to
log some data that I receive after each iteration of my algorithm.

Thanks, Alexander

View raw message