metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dlyle65535 <>
Subject [GitHub] incubator-metron pull request: METRON-95: Create data purging scri...
Date Tue, 05 Apr 2016 01:05:26 GMT
Github user dlyle65535 commented on a diff in the pull request:
    --- Diff: deployment/roles/metron_streaming/defaults/main.yml ---
    @@ -34,3 +39,6 @@ storm_topologies:
         - "{{ metron_directory }}/config/topologies/yaf/remote.yaml"
         - "{{ metron_directory }}/config/topologies/pcap/remote.yaml"
         - "{{ metron_directory }}/config/topologies/enrichment/remote.yaml"
    +hdfs_retention_days: 30
    +hdfs_bro_purge_cronjob: "yarn jar {{ metron_directory }}/lib/{{ metron_dataloads_jar
}} org.apache.metron.dataloads.bulk.HDFSDataPruner -f {{ hdfs_url }} -g '/apps/metron/enrichment/indexed/bro_doc/*enrichment-*'
-s $(date -d '{{ hdfs_retention_days }} days ago' +%m/%d/%Y) -n 1 >> /var/log/bro-purge/cron-bro-purge.log
    --- End diff --
    By shadowing the command line arguments I mean having to maintain the command line arguments
in both a bash script and the java class. One of those two places to change one thing deals.

    How would you feel about a runnable jar?

If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message