spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "萝卜丝炒饭" <1427357...@qq.com>
Subject Filestream can not recognize the copied file
Date Thu, 23 Feb 2017 09:07:33 GMT
Hi all,
I tested filestream today, my code looks like:

val  fs = ssc.textFileStream(*)
erroelines = fs.filter( _.contains("erroe"))
erroelines.print
ssc.start()


when I edit a file and save it to the dir, it works well.
If i copy a file to the dir, it does work.

my issues are:
1, is it OK please? I means whether the code was designed to work as this.
2,which class  monitor the dir pls?
Mime
View raw message