stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashan Dhananjaya <dhananjay...@gmail.com>
Subject Re: [Dev] [GSoC-2015] Showing health statistics in GUI
Date Mon, 03 Aug 2015 07:10:40 GMT
Hi All,

As for the today's offline meeting. We have decided to add a functionality
to enable and disable the Health Statistic UI. I will be working on this
now onward. And after completing the chart with the tool tip we will going
to have the public hangout.

Thank You!
Best Regards,
Ashan

On Sun, Aug 2, 2015 at 8:35 PM, Ashan Dhananjaya <dhananjaya92@gmail.com>
wrote:

> Hi Imesh,
>
> I will be free for the whole next week. We can have the google hangout any
> day.Please give me a time slot to have the hangout.
>
> Thank You!
> Best Regards,
> Ashan
>
> On Sun, Aug 2, 2015 at 5:59 PM, Imesh Gunaratne <imesh@apache.org> wrote:
>
>> Hi Ashan,
>>
>> Great work! May be we could arrange a public Google Hangout when you are
>> available to present the current status of the project.
>>
>> Thanks
>>
>> On Thu, Jul 30, 2015 at 11:00 PM, Ashan Dhananjaya <
>> dhananjaya92@gmail.com> wrote:
>>
>>> Hi All,
>>>
>>> I have implemented formatters and did some changes in the cep event flow
>>> to change the RDBMS 3 tables in to one table as we discussed last week. And
>>> committed it. And id did few changes to the UI according to the feedback i
>>> had last week. I finished writing the REST API documentation and sent it to
>>> everyone.
>>>
>>> I have started to write a blog for the marketing aspect for stratos how
>>> Health Stat UI works and a documentation for the health statistics UI.
>>>
>>> [1]=
>>> https://github.com/apache/stratos/commit/1490310cae3ba085fbb77d84346dd66fd2b12132
>>>
>>> Thank You!
>>> Best Regards,
>>> Ashan
>>>
>>> On Fri, Jul 24, 2015 at 11:17 PM, Imesh Gunaratne <imesh@apache.org>
>>> wrote:
>>>
>>>> Great work Ashan!
>>>>
>>>> Actually you don't need to replace MySQL database with H2 rather both
>>>> options might be needed. The reason for having H2 is to allow users to see
>>>> the statistics when running on Single-JVM mode with embedded H2 database.
>>>>
>>>> On Thu, Jul 23, 2015 at 12:35 AM, Ashan Dhananjaya <
>>>> dhananjaya92@gmail.com> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I have implemented the UI for the Health Statistics UI. The git hub
>>>>> commits can be find from here [1].
>>>>>
>>>>> And im moving forward to replace the MySql database from the embedded
>>>>> H2 RDBMS as we discussed offline on 22nd of  July.
>>>>>
>>>>> Thank You!
>>>>> Best Regards,
>>>>> Ashan
>>>>>
>>>>>
>>>>> [1]=
>>>>> https://github.com/ashandk/stratos/commit/310ea343d80d009778f572da12a4098c7d2177ec
>>>>>
>>>>>
>>>>> On Thu, Jul 16, 2015 at 7:29 PM, Ashan Dhananjaya <
>>>>> dhananjaya92@gmail.com> wrote:
>>>>>
>>>>>> Hi Imesh,
>>>>>>
>>>>>> Noted. I will create a documentation for the REST API.
>>>>>>
>>>>>> Thank You!
>>>>>> Best Regards,
>>>>>> Ashan
>>>>>>
>>>>>> On Thu, Jul 16, 2015 at 10:51 AM, Imesh Gunaratne <imesh@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>>
>>>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu <
>>>>>>> reka@wso2.com> wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>>> 1.getAverageClusterMemoryByClusterId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /cluster/averageMemory/{Id}/{Interval}}
>>>>>>>>
>>>>>>>>
>>>>>>>>> 2.getAverageClusterLoadByClusterId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /cluster/averageLoad/{Id}/{Interval}}
>>>>>>>>
>>>>>>>>
>>>>>>>>> 3.getAverageMemberMemoryByMemberId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /member/averageMemory/{Id}/{Interval}}
>>>>>>>>
>>>>>>>> 4.getAverageMemberLoadByMemberId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /member/averageLoad/{Id}/{Interval}}
>>>>>>>>
>>>>>>>>
>>>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId
>>>>>>>>>
>>>>>>>>
>>>>>>>>  /cluster/flightRequestCount/{Id}/{Interval}}
>>>>>>>>
>>>>>>>
>>>>>>> +1 A great thought! @Ashan: It would be better if you can document
>>>>>>> the API methods (may be in a Google doc).
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>> On Tue, Jul 14, 2015 at 9:44 PM, Reka Thirunavukkarasu <
>>>>>>> reka@wso2.com> wrote:
>>>>>>>
>>>>>>>> Hi Ashan,
>>>>>>>>
>>>>>>>> Wouldn't it be better to stick with the REST API paths currently
>>>>>>>> used by stratos? You can inherit and add more stuffs as you
want. Please
>>>>>>>> see below for some sample paths:
>>>>>>>>
>>>>>>>> On Tue, Jul 14, 2015 at 1:55 AM, Ashan Dhananjaya <
>>>>>>>> dhananjaya92@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> I have implemented the REST api methods for the health
statistics
>>>>>>>>> UI in the stratos existing REST API.
>>>>>>>>>
>>>>>>>>> 1.getAverageClusterMemoryByClusterId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /cluster/averageMemory/{Id}/{Interval}}
>>>>>>>>
>>>>>>>>
>>>>>>>>> 2.getAverageClusterLoadByClusterId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /cluster/averageLoad/{Id}/{Interval}}
>>>>>>>>
>>>>>>>>
>>>>>>>>> 3.getAverageMemberMemoryByMemberId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /member/averageMemory/{Id}/{Interval}}
>>>>>>>>
>>>>>>>> 4.getAverageMemberLoadByMemberId
>>>>>>>>>
>>>>>>>>
>>>>>>>> /member/averageLoad/{Id}/{Interval}}
>>>>>>>>
>>>>>>>>
>>>>>>>>> 5.getAverageClusterFlightRequestCountByClusterId
>>>>>>>>>
>>>>>>>>
>>>>>>>>  /cluster/flightRequestCount/{Id}/{Interval}}
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Reka
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Please find the Github commit here[1].
>>>>>>>>>
>>>>>>>>> [1]=
>>>>>>>>> https://github.com/apache/stratos/commit/5ab9159744f136e649174f7293adabe5c77fb4bd
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thank You!
>>>>>>>>> Best Regards,
>>>>>>>>> Ashan
>>>>>>>>>
>>>>>>>>> On Thu, Jul 9, 2015 at 8:30 PM, Ashan Dhananjaya <
>>>>>>>>> dhananjaya92@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Noted Lahiru.
>>>>>>>>>>
>>>>>>>>>> On Thu, Jul 9, 2015 at 7:48 PM, Lahiru Sandaruwan
<
>>>>>>>>>> lahirus@wso2.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Ashan,
>>>>>>>>>>>
>>>>>>>>>>> Good stuff. It is fine to set the time stamp
from CEP for now.
>>>>>>>>>>> But ultimately we need the timestamp to be sent
from Python cartridge
>>>>>>>>>>> agent. Let's fix that part we proceed.
>>>>>>>>>>>
>>>>>>>>>>> Thanks.
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya
<
>>>>>>>>>>> dhananjaya92@gmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>
>>>>>>>>>>>> I was able to get the TimeaStamp to the RDBMS
without any
>>>>>>>>>>>> conflict AFAIK. I am testing the flow more.
Please find the commits [1],
>>>>>>>>>>>> [2] for the Formatters.
>>>>>>>>>>>>
>>>>>>>>>>>> [1]=
>>>>>>>>>>>> https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91
>>>>>>>>>>>> [2]=
>>>>>>>>>>>> https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c
>>>>>>>>>>>>
>>>>>>>>>>>> Thank You!
>>>>>>>>>>>> Best Regards,
>>>>>>>>>>>> Ashan
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan
<
>>>>>>>>>>>> lahirus@wso2.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Great work Ashan.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Thu, Jul 9, 2015 at 2:39 PM, Ashan
Dhananjaya <
>>>>>>>>>>>>> dhananjaya92@gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I was able to take the timestamp
from the cartridge agent
>>>>>>>>>>>>>> (WSO2CEPHealthStatisticsPublisher
and WSO2CEPInFlightRequestPublisher) to
>>>>>>>>>>>>>> CEP PayLoad definition.Git Hub commits
can be found here[1], [2]. Currently
>>>>>>>>>>>>>> working on sending the timestamp
to the RDBMS without conflicting execution
>>>>>>>>>>>>>> plans.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I have included the read-me [2] file
to the cep extensions
>>>>>>>>>>>>>> how to configure should happen for
the Health Stat publishing to the RDBMS.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> [1]=
>>>>>>>>>>>>>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76
>>>>>>>>>>>>>> [2]=
>>>>>>>>>>>>>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0
>>>>>>>>>>>>>> [3]=
>>>>>>>>>>>>>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thank You!
>>>>>>>>>>>>>> Best Regards,
>>>>>>>>>>>>>> Ashan
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha
Fernando <
>>>>>>>>>>>>>> lasantha.fdo@gmail.com> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Ashan,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Currently, you would not be able
to get the timestamp out of
>>>>>>>>>>>>>>> the event
>>>>>>>>>>>>>>> unless you use a databridge agent
callback. In that case,
>>>>>>>>>>>>>>> you can use
>>>>>>>>>>>>>>> Java code to simply get by calling
event.getTimestamp().
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> However, if you want to use the
timestamp as an attribute
>>>>>>>>>>>>>>> while doing
>>>>>>>>>>>>>>> processing within CEP, you would
have to pass the timestamp
>>>>>>>>>>>>>>> as an
>>>>>>>>>>>>>>> attribute of the stream. i.e.
add it as an attribute of
>>>>>>>>>>>>>>> either meta,
>>>>>>>>>>>>>>> correlation or payload data.
Then you can use that timestamp
>>>>>>>>>>>>>>> and
>>>>>>>>>>>>>>> format the output event as necessary.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>> Lasantha
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Jul 7, 2015 at 1:04 PM,
Ashan Dhananjaya <
>>>>>>>>>>>>>>> dhananjaya92@gmail.com> wrote:
>>>>>>>>>>>>>>> > Hi All,
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> > I applied the above patch
and get the timestamp in the
>>>>>>>>>>>>>>> Input Adapter. The
>>>>>>>>>>>>>>> > formatter i used was
>>>>>>>>>>>>>>> "member_average_memory_consumption_stats:1.0.0".
I
>>>>>>>>>>>>>>> > tried several time to get
the timeStamp attribute but
>>>>>>>>>>>>>>> failed. Is there any
>>>>>>>>>>>>>>> > way to get a data which
is outside in the payload? The
>>>>>>>>>>>>>>> Input stream is as
>>>>>>>>>>>>>>> > below,
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1]
 INFO
>>>>>>>>>>>>>>> TenantId=-1234 :
>>>>>>>>>>>>>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor,
>>>>>>>>>>>>>>> received
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> > Event{
>>>>>>>>>>>>>>> >   streamId='cartridge_agent_health_stats:1.0.0',
>>>>>>>>>>>>>>> >   timeStamp=1436245827731,
>>>>>>>>>>>>>>> >   metaData=null,
>>>>>>>>>>>>>>> >   correlationData=null,
>>>>>>>>>>>>>>> >   payloadData=[single-cartridge-app.my-php.php.domain,
>>>>>>>>>>>>>>> > single-cartridge-app-1,
network-partition-1,
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99,
>>>>>>>>>>>>>>> > partition-1, memory_consumption,
20.0],
>>>>>>>>>>>>>>> >   arbitraryDataMap={},
>>>>>>>>>>>>>>> > }
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> > Any help will be really
appreciated.
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> > Thank You!
>>>>>>>>>>>>>>> > Best Regards,
>>>>>>>>>>>>>>> > Ashan
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>> > On Tue, Jul 7, 2015 at 9:32
AM, Chamila De Alwis <
>>>>>>>>>>>>>>> chamilad@wso2.com> wrote:
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >> Hi Ashan,
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >> As I've seen from the
PCA testing recently, the timestamp
>>>>>>>>>>>>>>> is added to
>>>>>>>>>>>>>>> >> every ThriftEvent before
publishing. Are you working on
>>>>>>>>>>>>>>> PCA or the Mock
>>>>>>>>>>>>>>> >> IaaS? I took a look
at the Mock IaaS and the
>>>>>>>>>>>>>>> WSO2CEPStatisticsPublisher as
>>>>>>>>>>>>>>> >> well, and found out
that the latter indeed doesn't add
>>>>>>>>>>>>>>> the timestamp to the
>>>>>>>>>>>>>>> >> ThriftEvents. This means
that the JCA also publishes
>>>>>>>>>>>>>>> Thrift Events with
>>>>>>>>>>>>>>> >> empty timestamp fields.
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >> Following is the simple
fix for that. I've attached the
>>>>>>>>>>>>>>> patch herewith.
>>>>>>>>>>>>>>> >> Could you quickly verify
with the patch applied build
>>>>>>>>>>>>>>> also?
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master
*]$
>>>>>>>>>>>>>>> git diff
>>>>>>>>>>>>>>> >> diff --git
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java
>>>>>>>>>>>>>>> >> b/c
>>>>>>>>>>>>>>> >> index 653288d..f1fe426
100644
>>>>>>>>>>>>>>> >> ---
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java
>>>>>>>>>>>>>>> >> +++
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java
>>>>>>>>>>>>>>> >> @@ -29,6 +29,7 @@ import
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> org.wso2.carbon.databridge.agent.thrift.exception.AgentException;
>>>>>>>>>>>>>>> >>  import org.wso2.carbon.databridge.commons.Event;
>>>>>>>>>>>>>>> >>  import
>>>>>>>>>>>>>>> org.wso2.carbon.databridge.commons.StreamDefinition;
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >> +import java.util.Date;
>>>>>>>>>>>>>>> >>  import java.util.HashMap;
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>  /**
>>>>>>>>>>>>>>> >> @@ -98,6 +99,7 @@ public
class WSO2CEPStatisticsPublisher
>>>>>>>>>>>>>>> implements
>>>>>>>>>>>>>>> >> StatisticsPublisher
{
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>          Event event
= new Event();
>>>>>>>>>>>>>>> >>          event.setPayloadData(payload);
>>>>>>>>>>>>>>> >> +        event.setTimeStamp(new
Date().getTime());
>>>>>>>>>>>>>>> >>          event.setArbitraryDataMap(new
HashMap<String,
>>>>>>>>>>>>>>> String>());
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>          try {
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >> Regards,
>>>>>>>>>>>>>>> >> Chamila de Alwis
>>>>>>>>>>>>>>> >> Committer and PMC Member
- Apache Stratos
>>>>>>>>>>>>>>> >> Software Engineer |
WSO2 | +94772207163
>>>>>>>>>>>>>>> >> Blog: code.chamiladealwis.com
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >>
>>>>>>>>>>>>>>> >
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Lahiru Sandaruwan
>>>>>>>>>>>>> Committer and PMC member, Apache Stratos,
>>>>>>>>>>>>> Senior Software Engineer,
>>>>>>>>>>>>> WSO2 Inc., http://wso2.com
>>>>>>>>>>>>> lean.enterprise.middleware
>>>>>>>>>>>>>
>>>>>>>>>>>>> phone: +94773325954
>>>>>>>>>>>>> email: lahirus@wso2.com blog:
>>>>>>>>>>>>> http://lahiruwrites.blogspot.com/
>>>>>>>>>>>>> linked-in:
>>>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>> Dev mailing list
>>>>>>>>>>>>> Dev@wso2.org
>>>>>>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> --
>>>>>>>>>>> Lahiru Sandaruwan
>>>>>>>>>>> Committer and PMC member, Apache Stratos,
>>>>>>>>>>> Senior Software Engineer,
>>>>>>>>>>> WSO2 Inc., http://wso2.com
>>>>>>>>>>> lean.enterprise.middleware
>>>>>>>>>>>
>>>>>>>>>>> phone: +94773325954
>>>>>>>>>>> email: lahirus@wso2.com blog: http://lahiruwrites.blogspot.com/
>>>>>>>>>>> linked-in:
>>>>>>>>>>> http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Reka Thirunavukkarasu
>>>>>>>> Senior Software Engineer,
>>>>>>>> WSO2, Inc.:http://wso2.com,
>>>>>>>> Mobile: +94776442007
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Imesh Gunaratne
>>>>>>>
>>>>>>> Senior Technical Lead, WSO2
>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Imesh Gunaratne
>>>>
>>>> Senior Technical Lead, WSO2
>>>> Committer & PMC Member, Apache Stratos
>>>>
>>>
>>>
>>
>>
>> --
>> Imesh Gunaratne
>>
>> Senior Technical Lead, WSO2
>> Committer & PMC Member, Apache Stratos
>>
>
>

Mime
View raw message