incubator-s4-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jiaan Zeng <l.alle...@gmail.com>
Subject Re: how to set s4.metrics.config
Date Tue, 16 Jul 2013 23:13:27 GMT
That helps. Thanks.

On Tue, Jul 16, 2013 at 4:07 AM, Matthieu Morel <mmorel@apache.org> wrote:
> OK I see how you got there. 0.6.0 on github is not the tag for the final release code.
>
> Github repo is a mirror of the apache git which we use for development. 0.6.0 was removed
from the apache git but the change not propagated to github apparently.
>
> Anyway, for the 0.6.0 release you can either:
> - follow the instructions from the web page to download the package
> - checkout the 0.6.0-RC5 branch from apache's git repo (or github mirror)
> - checkout the 0.6.0-Final branch (which I just added) from apache's git repo. Should
propagate to github as well
>
> Regards,
>
> Matthieu
>
> On Jul 15, 2013, at 20:16 , Jiaan Zeng <l.allen09@gmail.com> wrote:
>
>> I am using the code tagged as 0.6.0 in github from here
>> https://github.com/apache/incubator-s4/tree/0.6.0
>>
>> Isn't it the final release? If not, where to get the final release source code?
>>
>> Thanks.
>>
>> On Mon, Jul 15, 2013 at 2:08 PM, Matthieu Morel <mmorel@apache.org> wrote:
>>> Hi,
>>>
>>> what version of S4 are you referring to?
>>>
>>> It looks like you are using a release candidate instead of the final release
and that you are hitting issue S4-130, which is fixed in the final release.
>>>
>>> When using the 0.6.0 final release, different metrics output directories can
be specified by passing metrics parameters when starting nodes (-p param) instead of specifying
that in the app deployment.
>>>
>>> Regards,
>>>
>>> Matthieu
>>>
>>> On Jul 12, 2013, at 16:01 , Jiaan Zeng <l.allen09@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I wonder how to set the metrics parameter, i.e. s4.metrics.config,
>>>> correctly. What I did is to specify
>>>> -p=s4.metrics.config=csv:/path/to/directory:10:SECONDS while deploying
>>>> the s4r archive to zookeeper. There are several problems here.
>>>>
>>>> 1) The csv option is not used. Metrics output is dumped to console.
>>>> org.apache.s4.core.util.S4Metrics uses following pattern which means
>>>> group 1 on this pattern is always "csv:sth" or "console".
>>>>
>>>> (csv:.+|console):(\\d+):(DAYS|HOURS|MICROSECONDS|MILLISECONDS|MINUTES|NANOSECONDS|SECONDS)
>>>>
>>>> In the init() function,  statement "String group1 = matcher.group(1);"
>>>> always returns "csv:/path/to/directory". That means following
>>>> statement "if ("csv".equals(group1))" is false.
>>>>
>>>> 2) How do I specify different csv files for different node since the
>>>> output path is set in application level? The way I set this parameter
>>>> make all the nodes use the same path stored in zookeeper.
>>>>
>>>> Thanks.
>>>>
>>>> --
>>>> Regards,
>>>> Jiaan
>>>
>>
>>
>>
>> --
>> Regards,
>> Jiaan
>



-- 
Regards,
Jiaan

Mime
View raw message