spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 李书明 <alemmont...@126.com>
Subject [Spark Streaming] One Batch hangs always and others process correctly
Date Mon, 28 Aug 2017 07:27:41 GMT


    Hi, everybody. I met a problem:  one batch in spark streaming hangs allover, and other
batchs run normally.
    
    Environment:


    spark-version: 2.0.0
    mode: yarn-cluster
    spark.executor.cores: 8
    spark.executor.memory: 12g
    spark.driver.memory: 3g


    I also check the driver/executors logs, don't find any usefull exceptions, and also do
not find any useful solutions in website, can somebody expain to me why this batch hangs ,
or why not fails?













Mime
View raw message