storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shawn.du" <shawn...@neulion.com.cn>
Subject Re: implmement state management with Apache Ignite
Date Thu, 16 Feb 2017 02:00:18 GMT
<html>
<head>
    <meta http-equiv='Content-Type' content='text/html; charset=UTF-8'>
</head>
<body>
<style>
    font{
        line-height: 1.5;
    }
</style>
<div style = 'font-family:"微软雅黑"; font-size: 16px; color:#000000; line-height:1.5;'>
    <div>
Hi,</div><div><br></div><div>After study, We will implement
IgniteKeyValueState and IgniteStateProvider.&nbsp;</div><div>I am a ignite
user, I think Ignite has more wonderful features than redis.</div><div>Could storm
add support for ignite?&nbsp;</div><div>porting RedisKeyValueState to IgniteKeyValueState
is rather easy.</div><div><br>
<div id="ntes-pcmail-signature" style="font-family:'微软雅黑'">
    <style type="text/css">
        a#ntes-pcmail-signature-default:hover {
            text-decoration: underline;
            color: #3593db;
            cursor: pointer;
        }
    </style>

                <div style="font-size:14px; padding: 0;  margin:0;">
                    <div style="font-family:&quot;微软雅黑&quot;; font-size:
13px; color:#000000">
    <style>
        font{
            line-height: 1.5;
        }
    </style>
<div id="ntes-pcmail-signature-default" style="font-size:14px; color:#000; text-decoration:
none;">Thanks</div><div id="ntes-pcmail-signature-default" style="font-size:14px;
color:#000; text-decoration: none;">Shawn</div>
</div>
                </div>

</div><br>
</div><div class="J-reply" style="background-color:#f2f2f2;color:black;padding-top:6px;padding-bottom:6px;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;margin-top:45px;margin-bottom:20px;font-family:'微软雅黑';">
    <div style="font-size:14px;line-height:1.5;word-break:break-all;margin-left:10px;margin-right:10px">On
<span class="mail-date">02/7/2017 14:39</span>,<a class="mail-to" style="text-decoration:none;color:#2a97ff;"
href="mailto:shawn.du@neulion.com.cn">shawn.du&lt;shawn.du@neulion.com.cn&gt;</a>
wrote: </div>
</div>
<blockquote id="ntes-pcmail-quote" style="margin: 0; padding: 0; font-size: 13px; font-family:
'微软雅黑';">

<style>
    font{
        line-height: 1.5;
    }
</style>
<div style="font-family:&quot;微软雅黑&quot;; font-size: 16px; color:#000000;
line-height:1.5;">
    <div>Hi Arun,</div><div><br></div><div>Thanks your
reply. I have read the document your mentioned.&nbsp;</div><div>For current
storm 1.0.2 only provide a simple&nbsp;<span style="color: rgb(167, 29, 93); font-family:
Consolas, 'Liberation Mono', Menlo, Courier, monospace; font-size: 13.6px; line-height: 1.45;
orphans: 2; widows: 2; background-color: rgb(247, 247, 247);">KeyValueState</span><span
style="line-height: 1.5;">&nbsp;interface, &nbsp;We are still considering whether
it can fulfill our requirements.</span></div><div><br>
<div id="ntes-pcmail-signature" style="font-family:'微软雅黑'">
    <style type="text/css">
        a#ntes-pcmail-signature-default:hover {
            text-decoration: underline;
            color: #3593db;
            cursor: pointer;
        }
    </style>

                <div style="font-size:14px; padding: 0;  margin:0;">
                    <div style="font-family:&quot;微软雅黑&quot;; font-size:
13px; color:#000000">
    <style>
        font{
            line-height: 1.5;
        }
    </style>
<div id="ntes-pcmail-signature-default" style="font-size:14px; color:#000; text-decoration:
none;">Thanks</div><div id="ntes-pcmail-signature-default" style="font-size:14px;
color:#000; text-decoration: none;">Shawn</div>
</div>
                </div>

</div><br>
</div><div class="J-reply" style="background-color:#f2f2f2;color:black;padding-top:6px;padding-bottom:6px;border-radius:3px;-moz-border-radius:3px;-webkit-border-radius:3px;margin-top:45px;margin-bottom:20px;font-family:'微软雅黑';">
    <div style="font-size:14px;line-height:1.5;word-break:break-all;margin-left:10px;margin-right:10px">On
<span class="mail-date">02/7/2017 14:08</span>,<a class="mail-to" style="text-decoration:none;color:#2a97ff;"
href="mailto:arunm@apache.org">Arun Mahadevan&lt;arunm@apache.org&gt;</a>
wrote: </div>
</div>
<blockquote id="ntes-pcmail-quote" style="margin: 0; padding: 0; font-size: 13px; font-family:
'微软雅黑';">
<style type="text/css"><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:微软雅黑;
	panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
	{mso-style-priority:34;
	margin-top:0in;
	margin-right:0in;
	margin-bottom:0in;
	margin-left:.5in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman";}
span.EmailStyle17
	{mso-style-type:personal-reply;
	font-family:Calibri;
	color:windowtext;}
span.msoIns
	{mso-style-type:export-only;
	mso-style-name:"";
	text-decoration:underline;
	color:teal;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
-->
</style><div class="WordSection1"><p class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">&gt;
#1 when a worker is died or killed by manually, storm framework will restart this worker,
is there a ID which doesn't change for the new worker and the died worker? &nbsp;if there
is, how to get it?<o:p></o:p></span></p><p class="MsoNormal"><span
style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">Task
Id does not change. The worker can be restarted in the same or different host and the tasks
would be reassigned.<o:p></o:p></span></p><p class="MsoNormal"><span
style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black"><o:p>&nbsp;</o:p></span></p><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">&gt;
#2 when a worker is died, is there a case storm framework can't start a new worker? In this
case, how about the grouped message handled by this worker, it will auto take over by other
workers? &nbsp;&nbsp;<o:p></o:p></span></p><p class="MsoNormal"><span
style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">As
long as the state is per task it can be handled by other worker.<o:p></o:p></span></p><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black"><o:p>&nbsp;</o:p></span></p><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">&gt;
#3 suppose we have started a topology with 3 workers, rebalance topology can change the worker
numbers?<o:p></o:p></span></p><p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri">Rebalance can change the number of workers,
but the overall number of tasks remains the same. Only that the task assignment to workers
could change.<o:p></o:p></span></p><p class="MsoNormal"><span
style="font-size:11.0pt;font-family:Calibri"><o:p>&nbsp;</o:p></span></p><p
class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Not sure if
you are building something different, but storm already has basic support for stateful bolts
(see <a href="https://github.com/apache/storm/blob/master/docs/State-checkpointing.md)">https://github.com/apache/storm/blob/master/docs/State-checkpointing.md)</a>.<o:p></o:p></span></p><p
class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"> <o:p></o:p></span></p><p
class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Thanks,<o:p></o:p></span></p><p
class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Arun<o:p></o:p></span></p><p
class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><o:p>&nbsp;</o:p></span></p><p
class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><o:p>&nbsp;</o:p></span></p><div
style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in"><p class="MsoNormal"><b><span
style="font-family:Calibri;color:black">From: </span></b><span style="font-family:Calibri;color:black">"shawn.du"
&lt;shawn.du@neulion.com.cn&gt;<br><b>Reply-To: </b>"user@storm.apache.org"
&lt;user@storm.apache.org&gt;<br><b>Date: </b>Tuesday, February
7, 2017 at 11:25 AM<br><b>To: </b>user &lt;user@storm.apache.org&gt;<br><b>Subject:
</b>implmement state management with Apache Ignite<o:p></o:p></span></p></div><div><p
class="MsoNormal"><o:p>&nbsp;</o:p></p></div><div><div><div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">Hi
community,<o:p></o:p></span></p></div><div><p class="MsoNormal"><span
style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black"><o:p>&nbsp;</o:p></span></p></div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">Recently
we are trying implement state management using apache ignite.<o:p></o:p></span></p></div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">Before
do the real work, I have several questions, please help.<o:p></o:p></span></p></div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black"><o:p>&nbsp;</o:p></span></p></div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">#1
when a worker is died or killed by manually, storm framework will restart this worker, is
there a ID which doesn't change for the new worker and the died worker? &nbsp;if there
is, how to get it?<o:p></o:p></span></p></div><div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">#2
when a worker is died, is there a case storm framework can't start a new worker? In this case,
how about the grouped message handled by this worker, it will auto take over by other workers?
&nbsp;&nbsp;<o:p></o:p></span></p></div></div><div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">#3
suppose we have started a topology with 3 workers, rebalance topology can change the worker
numbers?<o:p></o:p></span></p></div><div><p class="MsoNormal"><span
style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black"><o:p>&nbsp;</o:p></span></p></div><div><div
id="ntes-pcmail-signature"><div><div><div id="ntes-pcmail-signature-default"><p
class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">Thanks<o:p></o:p></span></p></div><div
id="ntes-pcmail-signature-default"><p class="MsoNormal"><span style="font-size:10.5pt;font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black">Shawn<o:p></o:p></span></p></div></div></div></div><p
class="MsoNormal"><span style="font-family:&quot;微软雅黑&quot;,&quot;serif&quot;;color:black"><o:p>&nbsp;</o:p></span></p></div></div></div></div></div>
</blockquote>
</div></blockquote>
</div>
</body>
</html>

Mime
View raw message