spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Lewis <lordjoe2...@gmail.com>
Subject How can my java code executing on a slave find the task id?
Date Wed, 12 Nov 2014 21:19:49 GMT
 I am trying to determine how effective partitioning is at parallelizing my
tasks. So far I suspect it that all work is done in one task. My plan is to
create a number of accumulators - one for each task and have functions
increment the accumulator for the appropriate task (or slave) the values
could then tell me how balanced the computation is but I am not sure how to
access information about the slave. Any bright ideas?

Mime
View raw message