spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ruijing Li <liruijin...@gmail.com>
Subject Spark hangs while reading from jdbc - does nothing
Date Fri, 10 Apr 2020 16:37:05 GMT
Hi all,

I am on spark 2.4.4 and using scala 2.11.12, and running cluster mode on
mesos. I am ingesting from an oracle database using spark.read.jdbc. I am
seeing a strange issue where spark just hangs and does nothing, not
starting any new tasks. Normally this job finishes in 30 stages but
sometimes it stops at 29 completed stages and doesn’t start the last stage.
The spark job is idling and there is no pending or active task. What could
be the problem? Thanks.
-- 
Cheers,
Ruijing Li

Mime
View raw message