metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From merrimanr <...@git.apache.org>
Subject [GitHub] incubator-metron pull request #484: METRON-623: Management UI
Date Fri, 24 Mar 2017 13:53:31 GMT
GitHub user merrimanr reopened a pull request:

    https://github.com/apache/incubator-metron/pull/484

    METRON-623: Management UI

    ## Contributor Comments
    This PR includes the latest version of the Management UI.  Instructions for building and
installing are located in metron-interface/metron-config/README.md.  
    
    Here are the commands I used to deploy to Quick Dev:
    
    1. Install REST application:
    ```
    scp ./metron-interface/metron-rest/target/metron-rest-0.3.1-archive.tar.gz root@node1:/usr/metron/0.3.1/
    ssh root@node1
    cd /usr/metron/0.3.1/
    tar -xf metron-rest-0.3.1-archive.tar.gz
    java -jar ./lib/metron-rest-0.3.1.jar --spring.profiles.active=vagrant,dev --server.port=8082
    ```
    2. Install the Management UI:
    ```
    scp ./metron-interface/metron-config/target/metron-config-0.3.1-archive.tar.gz root@node1:/usr/metron/0.3.1/
    ssh root@node1
    cd /usr/metron/0.3.1/
    tar -xf metron-config-0.3.1-archive.tar.gz
    yum install -y npm
    npm install npm@3.8.9 -g
    export METRON_REST_URL=http://node1:8082
    ./bin/start_management_ui.sh
    ```
    The UI should be available at http://node1:4200 (login with user/password).
    
    So far this UI has only been dev tested and there will likely be some bugs found.  If
reviewers feel they have found a critical bug that should be fixed before this can be accepted,
please state that and we will address it ASAP.  Otherwise I will create Jiras for bugs/issues
that can be done as follow on work.
    
    This is a very large pull request that contains mostly client-side code.  The application
was built on the [Angular 2](https://angular.io/docs/ts/latest/) framework using [Angular
CLI](https://github.com/angular/angular-cli).
    
    Changes that are outside of metron-interface/metron-config (Management UI module) include:
    
    - Addition of "/api/v1/grok/get/statement" REST endpoint that gets a grok statement from
the classpath instead of HDFS
    - A couple fields added to the Storm topology status response (emitted and acked tuples)
    - Updated REST documentation
    - Apache Rat exclusions added to the top level pom.xml
    
    There are a couple tasks still outstanding so don't merge until those are complete.  These
tasks should not affect functional testing or code review.  They include:
    
    - add angular unit tests to the Maven build cycle (tests pass and can be run with `npm
test` in the metron-config directory, they just don't get executed on a top level build yet)
    - optimize build process and dependencies (our build process is already painful, need
to ensure this doesn't make it worse)
    - add architectural documentation to the README
    - resolve error when building the site-book
    
    I will keep the thread updated as these are completed.  Thanks for reviewing!
    
    ## Pull Request Checklist
    
    Thank you for submitting a contribution to Apache Metron (Incubating).  
    Please refer to our [Development Guidelines](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=61332235)
for the complete guide to follow for contributions.  
    Please refer also to our [Build Verification Guidelines](https://cwiki.apache.org/confluence/display/METRON/Verifying+Builds?show-miniview)
for complete smoke testing guides.  
    
    
    In order to streamline the review of the contribution we ask you follow these guidelines
and ask you to double check the following:
    
    ### For all changes:
    - [x] Is there a JIRA ticket associated with this PR? If not one needs to be created at
[Metron Jira](https://issues.apache.org/jira/browse/METRON/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel).

    - [x] Does your PR title start with METRON-XXXX where XXXX is the JIRA number you are
trying to resolve? Pay particular attention to the hyphen "-" character.
    - [x] Has your PR been rebased against the latest commit within the target branch (typically
master)?
    
    
    ### For code changes:
    - [x] Have you included steps to reproduce the behavior or problem that is being changed
or addressed?
    - [x] Have you included steps or a guide to how the change may be verified and tested
manually?
    - [x] Have you ensured that the full suite of tests and checks have been executed in the
root incubating-metron folder via:
      ```
      mvn -q clean integration-test install && build_utils/verify_licenses.sh 
      ```
    
    - [x] Have you written or updated unit tests and or integration tests to verify your changes?
    - [x] If adding new dependencies to the code, are these dependencies licensed in a way
that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?

    - [x] Have you verified the basic functionality of the build by building and running locally
with Vagrant full-dev environment or the equivalent?
    
    ### For documentation related changes:
    - [ ] Have you ensured that format looks appropriate for the output in which it is rendered
by building and verifying the site-book? If not then run the following commands and the verify
changes via `site-book/target/site/index.html`:
    
      ```
      cd site-book
      bin/generate-md.sh
      mvn site:site
      ```
    
    #### Note:
    Please ensure that once the PR is submitted, you check travis-ci for build issues and
submit an update to your PR as soon as possible.
    It is also recommened that [travis-ci](https://travis-ci.org) is set up for your personal
repository such that your branches are built there before submitting a pull request.
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/merrimanr/incubator-metron METRON-623

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-metron/pull/484.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #484
    
----
commit b7d310ede8785f411c9a4518207dfa3ef77983b3
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-10-19T15:24:52Z

    Initial implementation of REST service

commit 77e79aba34e992c951ee804d918aea1e70b638ec
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-10-19T15:31:18Z

    added newline at the end of application.yml

commit b042dfdce8e12bf320ff5dcd7b46edf68c66a302
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-10-24T16:07:21Z

    Added logging configuration and fixed SLF4J warnings.

commit 2012369e3094dcc0d15365b914005d035e938824
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-18T23:11:40Z

    Metron Docker implementation

commit d9ea03eeafb6971390899c93bad73ee00216b3f6
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-18T23:19:13Z

    Cleaned up comments and added newlines to the end of files

commit b73e8084ba6c9299227bea8085d34731dabcdd88
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-21T17:34:14Z

    Merge branch 'METRON-503' into middleware

commit 072f3ec7e856acdd6d565ce0c69b52fc038ec352
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-28T22:18:45Z

    Merge remote-tracking branch 'mirror/master' into middleware

commit d4ff4703fcc9c84f646bf00653af43a74df3fe9d
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-29T13:52:24Z

    Initial middleware commit

commit c87474befc2564040d14324926efac8485a751cb
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-29T23:12:18Z

    Initial metron-config UI commit

commit 50b4cf4aeb5a084d43a2c70d9a364dc81b7c3a42
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-30T18:38:10Z

    Added start script and fixed Maven issues

commit ba70d7f851978a7aee7cab09a94ac0108b70d29f
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-30T18:38:45Z

    Merge branch 'middleware' into webapp

commit ecddc0b47b2a15738e42040b9154905f170a513e
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-11-30T19:06:42Z

    Moved to separate metron-config project.

commit d79977bac43c30f0434e54f089d1be1c1c91d306
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-01T20:57:06Z

    Added install and start scripts.  Now serving UI from Spring appplication server.

commit e5c3b3b25b6958b4bcd22c09cf1e4ac9333bcae9
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-02T00:02:15Z

    User feedback bug fixes

commit 46d0ff32c5317f5a6c55363cac0e948893bbf755
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-02T00:02:37Z

    Fixed pattern label bug

commit cd61e7d9e9f59fc9fe19a378266511b534b36437
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-02T00:03:02Z

    Merge branch 'middleware' into webapp

commit 1ced51e188074bc151a1cd90993b03d13633f9d9
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-05T18:35:52Z

    Fixes to parseMessage service.  Now patternLabel defaults to sensor name only if it doesn't
exist and patternLabel is not appended to grokStatement (that now happens in middleware).
 Changed Stellar panel to Raw JSON.

commit 53c33409916d9bfb74bb928debbe60bba18349e6
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-05T18:47:08Z

    Fixes to parseMessage service.  Now writes temporary grok statement to local filesystem.
 Also fixed some corner cases for sensorParserConfigHistoryService (history doesn't exist,
deleting a history that doesn't exist, etc).  Added context path to integration tests.

commit 0a329c7ee49290d2cf31d7fed744300bf2ad2e07
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-05T18:52:01Z

    Merge remote-tracking branch 'mirror/master' into docker

commit ce11ab5bcf67b051e0bbe9356d8f733de0a1ccbf
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-05T18:52:59Z

    Merge branch 'docker' into middleware

commit a985b5ac60e9635e15ea9f79b54fdf381de1a3e6
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-05T18:54:14Z

    Merge branch 'middleware' into webapp
    
    # Conflicts:
    #	metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/SensorParserConfigHistoryService.java

commit 7db0810f76ca36b1bb9c8d98c21038175ffed117
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:00:09Z

    Resolved licensing issues

commit 8825a85bfab5eaa792ea24efb1e025c90d41664b
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:09:02Z

    Resolved licensing issues

commit 35240d267f1939b78991da1b3ff0210d45839299
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:10:17Z

    Merge branch 'docker' into middleware

commit 21300e21c99db32e2c4921f389db3bab6f6271da
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:10:54Z

    Merge branch 'middleware' into webapp

commit a7dea157fb9b02739ed9d4f5a647d97b086d4822
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:11:57Z

    Resolved licensing issues

commit d38b6265b4c0806826db6f77c7c036f6115db53e
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:12:38Z

    Resolved licensing issues

commit f1ce2d0ab740b9c67f4abe00e8e88d81b43dc8cd
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:12:54Z

    Merge branch 'docker' into middleware

commit a7b9e7e96aa339e922ec6d2098eeee563f726ced
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:13:32Z

    Merge branch 'middleware' into webapp
    
    # Conflicts:
    #	pom.xml

commit f7bf12e12c979f541b4ac16174db39d1bf739bae
Author: rmerriman <rmerriman@hortonworks.com>
Date:   2016-12-06T00:15:28Z

    Resolved licensing issues

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message