spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From manasdebashiskar <>
Subject Re: mapwithstate Hangs with Error cleaning broadcast
Date Wed, 02 Nov 2016 21:59:45 GMT
 In my case, my StateSpec had a small partition size. I increased the
numPartitions and the problem went away. (Details of why the problem was
happening in the first place is elided.)

 StateSpec takes a "numPartitions" which can be set to high enough number.

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe e-mail:

View raw message