falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaik Idris Ali (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-306) Feed late replication is not working
Date Tue, 08 Apr 2014 17:29:36 GMT

    [ https://issues.apache.org/jira/browse/FALCON-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13963201#comment-13963201
] 

Shaik Idris Ali commented on FALCON-306:
----------------------------------------

[~svenkat], [~raghavgautam]. We ran a feed replication in embedded mode  (but used different
activeMQ end point ) with Hadoop 2 cluster.
And feed replication detected late changes and re-replicated the data.

Attaching the logs, please look for LaterunHandler thread in the log. I think its the issue
with the embedded broker, can you please try with a standalone apache activeMQ with scheduler
support, also same needs to be updated in the startup.properties.

> Feed late replication is not working
> ------------------------------------
>
>                 Key: FALCON-306
>                 URL: https://issues.apache.org/jira/browse/FALCON-306
>             Project: Falcon
>          Issue Type: Bug
>            Reporter: Raghav Kumar Gautam
>              Labels: falcon-regression
>         Attachments: falcon-306-upload.zip
>
>
> *STR*
> - Source clusters have following folders:
>   at colo=ua3, partition=UK/${cluster.colo} folder=input-data/2014/02/05/22/08/UK/ua3
>   at colo=ua2, partition=US/${cluster.colo} folder=input-data/2014/02/05/22/08/US/ua2
> - Target cluster
>   at colo=ua1: folder=input-data/2014/02/05/22/08/
> - Upload some data in source folders
> - Replication goes through
> - Upload some more data in source folders
> - Late replication does not happen
> *Test*
> PrismFeedLateReplicationTest#multipleSourceOneTarget_pastData
> PrismFeedLateReplicationTest#multipleSourceOneTarget_futureData



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message