spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniela S" <>
Subject Spark Streaming prediction
Date Mon, 02 Jan 2017 16:03:07 GMT
<html><head></head><body><div style="font-family: Verdana;font-size:


<div>I am trying to solve the following problem with Spark Streaming.</div>

<div>I receive timestamped events&nbsp;from Kafka. Each event refers to a device
and contains values for every minute of the next 2 to 3 hours. What I would like to do is
to predict the minute values for the next 24 hours. So I would like to use the known values
and to predict the other values to achieve the 24 hours prediction. My thought was to use
arrays with a length of 1440 (1440 minutes = 24 hours). One for the known values and one for
the predicted values for each device. Then I would like to show the next 24 hours on a dashboard.
The dashboard should be updated automatically in realtime.&nbsp;</div>


<div>My questions:</div>

<div>is this a possible solution?</div>

<div>how is it possible to combine known future values and predicted values?</div>

<div>how should I treat the timestamp as the length of 1440 does not correspond to a

<div>how is it possible to update the dashboard automatically in realtime?</div>


<div>Thank you in advance!</div>


<div>Best regards,</div>


To unsubscribe e-mail:

View raw message