spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lemieud <>
Subject Re: Spark Streaming using Flume body size limitation
Date Fri, 23 May 2014 13:52:38 GMT

I think I found the problem.
In SparkFlumeEvent the readExternal method use which read
the first 1020 bytes, but no more. The code should make sure to read
The following change will fix the problem:

I attached a patch.

If somebody can point me in the right direction, I'll gladly do the required
legwork to submit the patch upstream.

Have a nice day.


View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message