spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Esa Heikkinen <>
Subject Spark CEP with files and no streams ?
Date Wed, 07 Feb 2018 08:52:06 GMT

I am trying to use CEP of Spark for log files (as batch job), but not for streams (as realtime).
Is that possible ? If yes, do you know examples Scala codes about that ?

Or should I convert the log files (with time stamps) into streams ?
But how to handle time stamps in Spark ?

If I can not use Spark at all for this purpose, do you have any recommendations of other tools

I would want CEP type analysis for log files.

View raw message