spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 李书明 <>
Subject [Spark Streaming] One Batch hangs always and others process correctly
Date Mon, 28 Aug 2017 07:27:41 GMT

    Hi, everybody. I met a problem:  one batch in spark streaming hangs allover, and other
batchs run normally.

    spark-version: 2.0.0
    mode: yarn-cluster
    spark.executor.cores: 8
    spark.executor.memory: 12g
    spark.driver.memory: 3g

    I also check the driver/executors logs, don't find any usefull exceptions, and also do
not find any useful solutions in website, can somebody expain to me why this batch hangs ,
or why not fails?

View raw message