falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaik Idris Ali (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-306) Feed late replication is not working
Date Mon, 07 Apr 2014 13:26:15 GMT

    [ https://issues.apache.org/jira/browse/FALCON-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13961833#comment-13961833
] 

Shaik Idris Ali commented on FALCON-306:
----------------------------------------

Actually, you should enable delayed messaging for ActiveMQ, I think which is disabled by default.

so for activeMQ which is configured for Falcon server. i.e. one which is present in startup.properties

schedulerSupport= true 

{code}
<broker xmlns="http://activemq.apache.org/schema/core" brokerName="localhost" dataDirectory="${activemq.base}/data"
destroyApplicationContextOnStop="true" schedulerSupport="true"> 
{code} in apache-activemq-5.4.3/conf/activemq.xml 

depending upon the version of activeMQ you should enable schedulerSupport, which I think is
disabled by default.

Also in Falcon.server logs, you should be able to grep for messages, "Received:{"
and "No Late Data Detected, scheduling next late rerun for wf-id
and "Late changes detected in the following feeds"
and ""Scheduled late rerun for wf-id:"



> Feed late replication is not working
> ------------------------------------
>
>                 Key: FALCON-306
>                 URL: https://issues.apache.org/jira/browse/FALCON-306
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Raghav Kumar Gautam
>              Labels: falcon-regression
>
> *STR*
> - Source clusters have following folders:
>   at colo=ua3, partition=UK/${cluster.colo} folder=input-data/2014/02/05/22/08/UK/ua3
>   at colo=ua2, partition=US/${cluster.colo} folder=input-data/2014/02/05/22/08/US/ua2
> - Target cluster
>   at colo=ua1: folder=input-data/2014/02/05/22/08/
> - Upload some data in source folders
> - Replication goes through
> - Upload some more data in source folders
> - Late replication does not happen
> *Test*
> PrismFeedLateReplicationTest#multipleSourceOneTarget_pastData
> PrismFeedLateReplicationTest#multipleSourceOneTarget_futureData



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message