spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "" <>
Subject spark streaming write orc suddenly slow?
Date Tue, 28 Mar 2017 02:05:01 GMT
Hi All:
when I use sparking streaming to consume kafka data to stroe in HDFS with orc files format.
it's fast in the beginning,but it's slow in several hours later.
spark version: 2.1.0
kafka version
spark-streaming-kafka jar's version: spark-streaming-kafka-0-8-2.11
View raw message