spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From praveshjain1991 <praveshjain1...@gmail.com>
Subject Re: Spark Streaming not processing file with particular number of entries
Date Fri, 13 Jun 2014 21:30:38 GMT
If you look at the file 400k.output, you'll see the string

    file:/newdisk1/praveshj/pravesh/data/input/testing4lk.txt 

This file contains 0.4 mn records. So the file is being picked up but the
app goes on to hang later on.
Also you mentioned the term "Standalone cluster" in your previous reply
which i would like to clarify - I am running spark in clustered mode (over a
3 node cluster).

--

Thanks



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7602.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message