metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Allen <n...@nickallen.org>
Subject Re: Metron Release 0.6.1 and/or Plugin release 0.3.0?
Date Mon, 03 Dec 2018 20:49:59 GMT
In light of this comment [1], I propose that we move forward with another
Metron release and forgo the Metron Bro Plugin 0.3.0 release until we can
resolve METRON-1910 [2].  There is no need to rush the fix as the current
0.2.0 release of the Bro Plugin is not impacted by the bug. We do have a
good amount of other Metron functionality to release though.  I do not see
a need to hold-up the release.

---

[1]
https://github.com/apache/metron-bro-plugin-kafka/pull/20#issuecomment-443481440
[2] https://github.com/apache/metron-bro-plugin-kafka/pull/20

On Thu, Nov 29, 2018 at 10:29 AM Justin Leet <justinjleet@gmail.com> wrote:

> There's a few issues I would like to see at least triaged and preferably
> addressed prior to the release of the main repo. In Jira, we have a
> "test-failures" label, that has a few things attached to it. If we know of
> any other Jiras that should have this label attached, please do so and I'd
> appreciate it if you replied to the thread.  See test-failures
> <
> https://issues.apache.org/jira/browse/METRON-1851?jql=project%20%3D%20METRON%20AND%20labels%20%3D%20test-failure
> >
> .
>
> The Jiras are:
> METRON-1810 <https://issues.apache.org/jira/browse/METRON-1810>
> METRON-1814 <https://issues.apache.org/jira/browse/METRON-1814>
> METRON-1851 <https://issues.apache.org/jira/browse/METRON-1851>
>
> On Wed, Nov 21, 2018 at 2:20 PM Zeolla@GMail.com <zeolla@gmail.com> wrote:
>
> > A metron-bro-plugin-kafka 0.3 release is good to go from my side.  Thanks
> > for all of the reviews Nick
> >
> > On Wed, Nov 21, 2018 at 11:16 AM Nick Allen <nick@nickallen.org> wrote:
> >
> > > Ha.  Yes, that definitely counts and makes a ton of sense.  Thanks!
> > >
> > > On Wed, Nov 21, 2018 at 11:00 AM Justin Leet <justinjleet@gmail.com>
> > > wrote:
> > >
> > > > Does "I forgot to pull master fresh before running the command" count
> > as
> > > a
> > > > reason?
> > > >
> > > > The missing Jiras are:
> > > >
> > > >     METRON-1890 Metron Vagrant should disable audio (ottobackwards)
> > > closes
> > > > apache/metron#1277
> > > >     METRON-1874 Create a Parser Debugger (nickwallen) closes
> > > > apache/metron#1265
> > > >     METRON-1880 Use Caffeine for Profiler Caching (nickwallen) closes
> > > > apache/metron#1270
> > > >     METRON-1877 Nested IF ELSE statements can cause parse errors in
> > > Stellar
> > > > (justinleet) closes apache/metron#1268
> > > >     METRON-1872 Move rat plugin away from snapshot version
> (justinleet)
> > > > closes apache/metron#1264
> > > >
> > > > On Wed, Nov 21, 2018 at 10:59 AM Nick Allen <nick@nickallen.org>
> > wrote:
> > > >
> > > > > Also, I'd like to get this one included in the release.  This is
> > really
> > > > > annoying for people just wanting to try out the Profiler.  And this
> > was
> > > > > 'broken' after the last release, so there currently is no release
> > with
> > > > this
> > > > > problem and I'd like to keep it that way. :)
> > > > >
> > > > > https://github.com/apache/metron/pull/1276
> > > > >
> > > > > On Wed, Nov 21, 2018 at 10:11 AM Justin Leet <
> justinjleet@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Realized I'd never sent the updated list of Jiras.  I changed the
> > > > command
> > > > > > slightly (to remove a clause I thought we'd already removed re:
> > http,
> > > > and
> > > > > > added the awk to remove dupes resulting from multiple commits
> for a
> > > > > single
> > > > > > Jira. I'll do a PR for these changes).
> > > > > >
> > > > > > *apache/metron*
> > > > > > git log "master" "^tags/apache-metron-0.6.0-release" --no-merges
> |
> > > grep
> > > > > -E
> > > > > > "^[[:blank:]]+METRON" | sed 's/\[//g' | sed 's/\]//g' | awk
> > > '!x[$1]++'
> > > > > >     METRON-1875 Expose configurable global settings in the Alerts
> > UI
> > > > > > (merrimanr) closes apache/metron#1266
> > > > > >     METRON-1834: Migrate Elasticsearch from TransportClient to
> new
> > > Java
> > > > > > REST API (mmiklavc via mmiklavc) closes apache/metron#1242
> > > > > >     METRON-1749 Update Angular to latest release in Management UI
> > > > > (sardell
> > > > > > via nickwallen) closes apache/metron#1217
> > > > > >     METRON-1870 Intermittent Stellar REST test failures
> (merrimanr
> > > via
> > > > > > nickwallen) closes apache/metron#1263
> > > > > >     METRON-1868 metron-committer-common incorrectly checking
> > > REPO_NAME
> > > > > > (JonZeolla via jonzeolla) closes apache/metron#1260
> > > > > >     METRON-1740 Improve Palo Alto parser to handle CONFIG and
> > SYSTEM
> > > > > syslog
> > > > > > messages (liuy-tnz via nickwallen) closes apache/metron#1171
> > > > > >     METRON-1847 Create reusable script with functions from
> > > > prepare-commit
> > > > > > (ottobackwards) closes apache/metron#1248
> > > > > >     METRON-1850 Stellar REST function (merrimanr) closes
> > > > > apache/metron#1250
> > > > > >     METRON-1858 BasicFireEyeParser check style cleanup and
> > > optimization
> > > > > > (ottobackwards) closes apache/metron#1255
> > > > > >     METRON-1864 Stellar date format test fails after daylight
> > saving
> > > > > > (ottobackwards) closes apache/metron#1258
> > > > > >     METRON-1861 METRON-1861: REST fails to start when LDAP
> enabled
> > > and
> > > > > > 'Active Spring profiles' config is empty (anandsubbu via
> > justinleet)
> > > > > closes
> > > > > > apache/metron#1256
> > > > > >     METRON-1853: Add shutdown hook to Stellar
> BaseFunctionResolver
> > > > > > (mmiklavc via mmiklavc) closes apache/metron#1251
> > > > > >     METRON-1857 Fix Metaalert Nested Alert Field Name in Index
> > > Template
> > > > > > (nickwallen) closes apache/metron#1253
> > > > > >     METRON-1855: Make unified enrichment topology the default and
> > > > > deprecate
> > > > > > split-join (mmiklavc via mmiklavc) closes apache/metron#1252
> > > > > >     METRON-1790 Unsubscribe from every observable in the pcap
> panel
> > > UI
> > > > > > component (ruffle via nickwallen) closes apache/metron#1208
> > > > > >     METRON-1803: Integrate Cypress with Travis (tiborm via
> > mmiklavc)
> > > > > closes
> > > > > > apache/metron#1226
> > > > > >     METRON-1844 Allow for LDAP to be used for authentication and
> > > roles
> > > > > > (justinleet) closes apache/metron#1246
> > > > > >     METRON-1830 Re-implement Alerts dialog box without jQuery
> > > (sardell
> > > > > via
> > > > > > merrimanr) closes apache/metron#1240
> > > > > >     METRON-1826 Update librdkafka and devtoolset (JonZeolla via
> > > > > jonzeolla)
> > > > > > closes apache/metron#1238
> > > > > >     METRON-1839 Install Elasticsearch MPack Step in Ansible Not
> > > > > Idempotent
> > > > > > (nickwallen) closes apache/metron#1244
> > > > > >     METRON-1833: Management UI incorrectly displaying sensor
> > topology
> > > > > > latency units as seconds instead of millis (mmiklavc via
> mmiklavc)
> > > > closes
> > > > > > apache/metron#1241
> > > > > >     METRON-1829 Large Error Message Causes Slow Search
> Performance
> > > > > > (merrimanr) closes apache/metron#1239
> > > > > >     METRON-1831 Project Version Substitution Not Working
> > (nickwallen)
> > > > > > closes apache/metron#1243
> > > > > >     METRON-1816 Date format Stellar function (merrimanr) closes
> > > > > > apache/metron#1233
> > > > > >     METRON-1681 Decouple the ParserBolt from the Parse execution
> > > logic
> > > > > > (merrimanr) closes apache/metron#1213
> > > > > >     METRON-1820 Update to new Simple-Syslog-5424 version to
> support
> > > > error
> > > > > > handling (ottobackwards) closes apache/metron#1234
> > > > > >     METRON-1805 Provide a default value for the Storm
> > > > > > topology.max.spout.pending setting (merrimanr) closes
> > > > apache/metron#1221
> > > > > >     METRON-1821 Align prepare-release-candidate with
> documentation
> > > > > > (JonZeolla via jonzeolla) closes apache/metron#1236
> > > > > >     METRON-1801 Allow Customization of Elasticsearch Document ID
> > > > > > (nickwallen) closes apache/metron#1218
> > > > > >     METRON-1799 Remove outdated bylaws from site. (justinleet)
> > closes
> > > > > > apache/metron#1216
> > > > > >     METRON-1769 Script creation of a release candidate
> (justinleet)
> > > > > closes
> > > > > > apache/metron#1188
> > > > > >     METRON-1761 Allow a grok statement to be applied to each line
> > in
> > > a
> > > > > > file. (ottobackwards) closes apache/metron#1184
> > > > > >     METRON-1813 Stellar REPL Not Initialized with Client JAAS
> > > > > (nickwallen)
> > > > > > closes apache/metron#1232
> > > > > >     METRON-1812: Fix dependencies_with_url.csv (mmiklavc via
> > > mmiklavc)
> > > > > > closes apache/metron#1230
> > > > > >     METRON-1811 Alert Search Fails When Sorting by Alert Status
> > > > > (merrimanr)
> > > > > > closes apache/metron#1231
> > > > > >     METRON-1809 Support Column Oriented Input with Batch Profiler
> > > > > > (nickwallen) closes apache/metron#1229
> > > > > >     METRON-1806: Upgrade Maven Shade Plugin version (mmiklavc via
> > > > > mmiklavc)
> > > > > > closes apache/metron#1224
> > > > > >     METRON-1792 Simplify Profile Definitions in Integration Tests
> > > > > > (nickwallen) closes apache/metron#1211
> > > > > >     METRON-1807 Auto populate the recommended values to some of
> the
> > > > > metron
> > > > > > config parameters  (MohanDV via merrimanr) closes
> > apache/metron#1227
> > > > > >     METRON-1808 Add Ansible created pyc to gitignore (justinleet)
> > > > closes
> > > > > > apache/metron#1228
> > > > > >     METRON-1695 Expose pcap properties through Ambari
> (anandsubbu)
> > > > closes
> > > > > > apache/metron#1207
> > > > > >     METRON-1771 Update REST endpoints to support eventually
> > > consistent
> > > > UI
> > > > > > updates (merrimanr) closes apache/metron#1190
> > > > > >     METRON-1791 Add GUID to Messages Produced by Profiler
> > > (nickwallen)
> > > > > > closes apache/metron#1210
> > > > > >     METRON-1804 Update version to 0.6.1 (justinleet) closes
> > > > > > apache/metron#1220
> > > > > >     METRON-1798 Add mpack support for parser aggregation
> > (anandsubbu)
> > > > > > closes apache/metron#1215
> > > > > >     METRON-1750 Create Parser for Syslog RFC 5424 Messages
> > > > > (ottobackwards)
> > > > > > closes apache/metron#1175
> > > > > >     METRON-1794 Include User Details When Escalating Alerts
> > > > (nickwallen)
> > > > > > closes apache/metron#1212
> > > > > >     METRON-1782 Add Kafka Partition and Offset to Profiler Debug
> > Logs
> > > > > > (nickwallen) closes apache/metron#1202
> > > > > >     METRON-1758 Add support for Ansible 2.6 in dev (JonZeolla via
> > > > > > jonzeolla) closes apache/metron#1179
> > > > > >     METRON-1784: Re-allow remote ssh and scp in Centos full dev
> > > > (mmiklavc
> > > > > > via mmiklavc) closes apache/metron#1204
> > > > > >     METRON-1787 Input Time Constraints for Batch Profiler
> > > (nickwallen)
> > > > > > closes apache/metron#1209
> > > > > >     METRON-1508 In Ubuntu14 Dev Indexing Fails to Write to
> > > > Elasticsearch
> > > > > > (nickwallen) closes apache/metron#1185
> > > > > >     METRON-1786 Pcap Topology Status Incorrect (MohanDV via
> > > nickwallen)
> > > > > > closes apache/metron#1206
> > > > > >     METRON-1709 Add controls to start / stop the PCAP topology
> from
> > > > > Ambari.
> > > > > > (MohanDV via nickwallen) closes apache/metron#1201
> > > > > >     METRON-1759 PCAP UI: Removing wrong Input annotations from
> pcap
> > > > panel
> > > > > > component (tiborm via nickwallen) closes apache/metron#1180
> > > > > >     METRON-1772 Support alternative input formats in the Batch
> > > Profiler
> > > > > > (nickwallen) closes apache/metron#1191
> > > > > >     METRON-1770 Add Docs for Running the Profiler with Spark on
> > YARN
> > > > > > (nickwallen) closes apache/metron#1189
> > > > > >     METRON-1774 Allow user to configure JAAS client in Ambari
> > > > > (nickwallen)
> > > > > > closes apache/metron#1192
> > > > > >     METRON-1760 Kill PCAP job should prompt for confirmation
> > (ruffle
> > > > via
> > > > > > nickwallen) closes apache/metron#1199
> > > > > >     METRON-1777: Fix Elasticsearch X-Pack sample pom in
> > documentation
> > > > > > (mmiklavc via mmiklavc) closes apache/metron#1196
> > > > > >     METRON-1781 Fix RPM Spec File (nickwallen) closes
> > > > apache/metron#1200
> > > > > >     METRON-1780 Fix broken website images (justinleet) closes
> > > > > > apache/metron#1198
> > > > > >     METRON-1476 Update to Angular 6.1.3 (sardell via nickwallen)
> > > closes
> > > > > > apache/metron#1096
> > > > > >     METRON-1776 Update public web site to point at 0.6.0 new
> > release
> > > > > > (justinleet) closes apache/metron#1195
> > > > > >     METRON-1775 Transient exception could prevent expired
> profiles
> > > from
> > > > > > being flushed (nickwallen) closes apache/metron#1194
> > > > > >     METRON-1717 Relocate Storm Profiler Code (nickwallen) closes
> > > > > > apache/metron#1187
> > > > > >     METRON-1748 Improve Storm Profiler Integration Test
> > (nickwallen)
> > > > > closes
> > > > > > apache/metron#1174
> > > > > >     METRON-1741 Move REPL Port of Profiler to Separate Project
> > > > > (nickwallen)
> > > > > > closes apache/metron#1170
> > > > > >     METRON-1715 Create DEB Packaging for Batch Profiler
> > (nickwallen)
> > > > > closes
> > > > > > apache/metron#1167
> > > > > >     METRON-1736 Enhance Batch Profiler Integration Test
> > (nickwallen)
> > > > > closes
> > > > > > apache/metron#1162
> > > > > >     METRON-1714 Create RPM Packaging for the Batch Profiler
> > > > (nickwallen)
> > > > > > closes apache/metron#1163
> > > > > >     METRON-1708 Run the Batch Profiler in Spark (nickwallen)
> closes
> > > > > > apache/metron#1161
> > > > > >     METRON-1707 Port Profiler to Spark (nickwallen) closes
> > > > > > apache/metron#1150
> > > > > >     METRON-1705 Create ProfilePeriod Using Period ID (nickwallen)
> > > > closes
> > > > > > apache/metron#1148
> > > > > >     METRON-1706 HbaseClient.mutate should return the number of
> > > > mutations
> > > > > > (nickwallen) closes apache/metron#1147
> > > > > >     METRON-1704 Message Timestamp Logic Should be Shared
> > (nickwallen)
> > > > > > closes apache/metron#1146
> > > > > >     METRON-1703 Make Core Profiler Components Serializable
> > > (nickwallen)
> > > > > > closes apache/metron#1145
> > > > > >
> > > > > >
> > > > > > *apache/metron-bro-plugin-kafka*
> > > > > > git log "master"
> > "^tags/apache-metron-bro-plugin-kafka_0.2.0-release"
> > > > > > --no-merges | grep -E "^[[:blank:]]+METRON" | sed 's/\[//g' | sed
> > > > > 's/\]//g'
> > > > > > | awk '!x[$1]++'
> > > > > >     METRON-1827 Update librdkafka in metron-bro-plugin-kafka
> > > (JonZeolla
> > > > > via
> > > > > > jonzeolla) closes apache/metron-bro-plugin-kafka#13
> > > > > >     METRON-1866 Improve metron-bro-plugin-kafka documentation
> > > > (JonZeolla
> > > > > > via jonzeolla) closes apache/metron-bro-plugin-kafka#17
> > > > > >     METRON-1304 Allow metron-bro-plugin-kafka to include or
> exclude
> > > > logs
> > > > > > (JonZeolla via nickwallen) closes
> apache/metron-bro-plugin-kafka#2
> > > > > >     METRON-1865 Fix metron-bro-plugin-kafka tests (JonZeolla via
> > > > > jonzeolla)
> > > > > > closes apache/metron-bro-plugin-kafka#16
> > > > > >     METRON-1828 Improve bro plugin contributing documentation
> > > > (JonZeolla)
> > > > > > closes apache/metron-bro-plugin-kafka#14
> > > > > >     METRON-1818 Remove config_files from bro-pkg.meta (JonZeolla)
> > > > closes
> > > > > > apache/metron-bro-plugin-kafka#11
> > > > > >     METRON-1800 Increment metron-bro-plugin-kafka version
> > (JonZeolla
> > > > via
> > > > > > jonzeolla) closes apache/metron-bro-plugin-kafka#10
> > > > > >     METRON-1773 Bro plugin docs should refer to Apache Metron
> > project
> > > > > > (nickwallen) closes apache/metron-bro-plugin-kafka#9
> > > > > >
> > > > > > On Sun, Nov 18, 2018 at 7:52 AM Zeolla@GMail.com <
> zeolla@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > > I'm good with that release schedule, and using version 0.7.0
> for
> > > the
> > > > > > > apache/metron release.
> > > > > > >
> > > > > > > I opened up METRON-1881 and have a branch ready to PR for the
> 0.3
> > > > > > > plugin upgrade.
> > > > > > >
> > > > > > > Jon
> > > > > > >
> > > > > > > On Fri, Nov 16, 2018 at 10:08 AM Otto Fowler <
> > > > ottobackwards@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Can you generate the jiras that would be included in the
> > release?
> > > > > > >>
> > > > > > >>
> > > > > > >> On November 16, 2018 at 10:05:50, Justin Leet (
> > > > justinjleet@gmail.com)
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> Given that we've had a couple major PRs (the ES client
> migration
> > > > along
> > > > > > >> with
> > > > > > >> the Angular upgrade stuff, and I'm sure others), I'd be in
> favor
> > > of
> > > > > > >> releasing both the plugin and the main repo.
> > > > > > >>
> > > > > > >> I'd be in favor of doing something like:
> > > > > > >> metron-bro-plugin-kafka release 0.3.0
> > > > > > >> PR to update full dev
> > > > > > >> metron release 0.7.0 (given that things changed a good amount)
> > > > > > >>
> > > > > > >> I would also expect this process to most likely be kicked off
> > post
> > > > > > >> Thanksgiving break (Thursday 22nd and Friday 23rd for anybody
> > not
> > > in
> > > > > the
> > > > > > >> US).
> > > > > > >>
> > > > > > >> I can kick out another summarization thread if we want, but
> > > > basically:
> > > > > > >> * Nov 26 - Start the Bro plugin release process
> > > > > > >> * Once that finishes, PR to update full dev with new plugin
> > > version
> > > > > > >> * Once PR is in, start metron release process (hopefully)
> > sometime
> > > > the
> > > > > > >> week
> > > > > > >> of the 3rd?
> > > > > > >>
> > > > > > >> Are there any objections to staggering the releases like that?
> > > They
> > > > > > could
> > > > > > >> also be done together, but it means that we have to update
> full
> > > dev
> > > > to
> > > > > > >> match the plugin version post release.
> > > > > > >>
> > > > > > >> On Wed, Nov 14, 2018 at 10:29 AM Zeolla@GMail.com <
> > > zeolla@gmail.com
> > > > >
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > In my opinion metron-bro-plugin-kafka is ready for a
> release.
> > > > > Anything
> > > > > > >> > else people would want to see? Once it gets released, I
> would
> > > like
> > > > > to
> > > > > > >> > update full dev to use the newest version prior to any
> future
> > > > metron
> > > > > > >> > release (0.6.1 or whatever we choose).
> > > > > > >> >
> > > > > > >> > Jon
> > > > > > >> >
> > > > > > >> > On Wed, Nov 7, 2018 at 8:07 PM Zeolla@GMail.com <
> > > zeolla@gmail.com
> > > > >
> > > > > > >> wrote:
> > > > > > >> >
> > > > > > >> > > So, about this release, anybody have time to review
> > > > > > >> > > apache/metron-bro-plugin-kafka#2 and
> > > > > > >> apache/metron-bro-plugin-kafka#13?
> > > > > > >> > >
> > > > > > >> > > Jon
> > > > > > >> > >
> > > > > > >> > > On Wed, Oct 17, 2018 at 10:37 AM Michael Miklavcic <
> > > > > > >> > > michael.miklavcic@gmail.com> wrote:
> > > > > > >> > >
> > > > > > >> > >> And I do think we will be ready to roll another Metron
> > > release
> > > > in
> > > > > > the
> > > > > > >> > near
> > > > > > >> > >> future as well.
> > > > > > >> > >>
> > > > > > >> > >> On Wed, Oct 17, 2018 at 8:26 AM Justin Leet <
> > > > > justinjleet@gmail.com
> > > > > > >
> > > > > > >> > >> wrote:
> > > > > > >> > >>
> > > > > > >> > >> > I tend to agree with Mike. I think we could do a
> release
> > of
> > > > the
> > > > > > >> main
> > > > > > >> > >> > project and get benefit, but I think skipping this
> cycle
> > > > > > >> (especially
> > > > > > >> > >> since
> > > > > > >> > >> > we had a release last month) let's us get things like
> the
> > > ES
> > > > > > client
> > > > > > >> > >> > migration in and settled and just generally make
> > > > recommending a
> > > > > > >> newer
> > > > > > >> > >> > version easier.
> > > > > > >> > >> >
> > > > > > >> > >> > The main reason for doing a release for the Bro plugin
> is
> > > to
> > > > > > >> address
> > > > > > >> > >> > shortcomings that we discovered and are addressing.
> > > > > > >> > >> >
> > > > > > >> > >> > On Tue, Oct 16, 2018 at 4:42 PM Michael Miklavcic <
> > > > > > >> > >> > michael.miklavcic@gmail.com> wrote:
> > > > > > >> > >> >
> > > > > > >> > >> > > Migrating the ES client, refactoring parser bolt.
> There
> > > are
> > > > > > some
> > > > > > >> > >> > interface
> > > > > > >> > >> > > changes in flight right now that I think would be
> > > > beneficial
> > > > > to
> > > > > > >> see
> > > > > > >> > in
> > > > > > >> > >> > the
> > > > > > >> > >> > > next release.
> > > > > > >> > >> > >
> > > > > > >> > >> > > On Tue, Oct 16, 2018 at 2:01 PM Nick Allen <
> > > > > nick@nickallen.org
> > > > > > >
> > > > > > >> > >> wrote:
> > > > > > >> > >> > >
> > > > > > >> > >> > > > I am in favor of a release for both.
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > There are a lot of really useful bug fixes,
> > management
> > > of
> > > > > > pcap
> > > > > > >> > >> through
> > > > > > >> > >> > > > Ambari, more flexibility for configuring JAAS in
> > > Ambari,
> > > > > > >> increased
> > > > > > >> > >> > > > Elasticsearch performance, the Syslog parser, and
> the
> > > > Batch
> > > > > > >> > >> Profiler,
> > > > > > >> > >> > > among
> > > > > > >> > >> > > > others. I would be happy with calling it a 0.6.1
> > point
> > > > > > release.
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > Mike - What is outstanding that you would like to
> see
> > > in
> > > > > the
> > > > > > >> > >> release?
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > On Tue, Oct 16, 2018, 12:21 PM Michael Miklavcic <
> > > > > > >> > >> > > > michael.miklavcic@gmail.com> wrote:
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > > I'd be +1 on going with just the
> > > > metron-bro-kafka-plugin
> > > > > > >> > release.
> > > > > > >> > >> It
> > > > > > >> > >> > > > seems
> > > > > > >> > >> > > > > like it's ready to go, and I think there are a
> few
> > > more
> > > > > > >> things
> > > > > > >> > I'd
> > > > > > >> > >> > like
> > > > > > >> > >> > > > to
> > > > > > >> > >> > > > > see get into our next Metron release so I'm good
> > with
> > > > > > holding
> > > > > > >> > off
> > > > > > >> > >> > > there.
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > Mike
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > On Tue, Oct 16, 2018 at 10:26 AM Justin Leet <
> > > > > > >> > >> justinjleet@gmail.com>
> > > > > > >> > >> > > > > wrote:
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > > Hi all,
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > As you might recall from a prior discussion
> about
> > > > > release
> > > > > > >> > >> cadence,
> > > > > > >> > >> > we
> > > > > > >> > >> > > > > were
> > > > > > >> > >> > > > > > interested in initiating release threads near
> our
> > > > board
> > > > > > >> > reports
> > > > > > >> > >> to
> > > > > > >> > >> > > see
> > > > > > >> > >> > > > if
> > > > > > >> > >> > > > > > we wanted to do releases or not. Additionally,
> > the
> > > > work
> > > > > > is
> > > > > > >> > done
> > > > > > >> > >> to
> > > > > > >> > >> > do
> > > > > > >> > >> > > > two
> > > > > > >> > >> > > > > > separate releases, so our options are releasing
> > > > both, a
> > > > > > >> single
> > > > > > >> > >> one,
> > > > > > >> > >> > > or
> > > > > > >> > >> > > > > > neither.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > Having said that, a metron-bro-kafka-plugin
> 0.3.0
> > > > > release
> > > > > > >> came
> > > > > > >> > >> up
> > > > > > >> > >> > on
> > > > > > >> > >> > > > this
> > > > > > >> > >> > > > > > thread
> > > > > > >> > >> > > > > > <
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> https://lists.apache.org/thread.html/3c18c3aba6b436b11032831e7db541d50eb7cb1e3ae54b7423057c88@%3Cdev.metron.apache.org%3E
> > > > > > >> > >> > > > > > >.
> > > > > > >> > >> > > > > > In particular, the prospect of a release came
> up
> > in
> > > > the
> > > > > > >> > context
> > > > > > >> > >> of
> > > > > > >> > >> > > > > having a
> > > > > > >> > >> > > > > > version with better (and working) testing.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > Version Number
> > > > > > >> > >> > > > > > If we choose to do a core Metron release, I
> > propose
> > > > > > 0.6.1.
> > > > > > >> For
> > > > > > >> > >> > > > > > metron-bro-kafka-plugin, I propose 0.3.0. Keep
> in
> > > > mind,
> > > > > > the
> > > > > > >> > >> > > versioning
> > > > > > >> > >> > > > > for
> > > > > > >> > >> > > > > > the plugin is a bit different in that we need
> x.y
> > > for
> > > > > > >> bro-pkg,
> > > > > > >> > >> > > instead
> > > > > > >> > >> > > > of
> > > > > > >> > >> > > > > > x.y.z, so we wouldn't release 0.2.1.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > I would personally be in favor of doing a
> plugin
> > > > > release,
> > > > > > >> but
> > > > > > >> > >> I'm
> > > > > > >> > >> > > less
> > > > > > >> > >> > > > > > inclined to do a core Metron release.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > For Metron, I believe the main feature is the
> > batch
> > > > > > >> profiler
> > > > > > >> > >> work,
> > > > > > >> > >> > > but
> > > > > > >> > >> > > > > > there's a fair amount of fixes and
> improvements.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > For the plugin, I believe the main improvements
> > > would
> > > > > be
> > > > > > >> > around
> > > > > > >> > >> the
> > > > > > >> > >> > > > > fixing
> > > > > > >> > >> > > > > > our testing and more maintenance type work.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > JIRA status
> > > > > > >> > >> > > > > > *metron*
> > > > > > >> > >> > > > > > There are 24 opens PRs at
> > > > > > >> > >> https://github.com/apache/metron/pulls.
> > > > > > >> > >> > > If
> > > > > > >> > >> > > > we
> > > > > > >> > >> > > > > > do
> > > > > > >> > >> > > > > > decide to release, we should work on getting
> > > anything
> > > > > > >> meriting
> > > > > > >> > >> > > > inclusion
> > > > > > >> > >> > > > > > closed out.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > There have been 49 commits since the 0.6.0
> > release
> > > > > > (listed
> > > > > > >> at
> > > > > > >> > >> the
> > > > > > >> > >> > end
> > > > > > >> > >> > > > of
> > > > > > >> > >> > > > > > the message). This assumes a release from
> master.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > *metron-bro-kafka-plugin*
> > > > > > >> > >> > > > > > There are 6 open PRs at
> > > > > > >> > >> > > > > >
> > > > > https://github.com/apache/metron-bro-plugin-kafka/pulls.
> > > > > > >> If
> > > > > > >> > >> we do
> > > > > > >> > >> > > > > decide
> > > > > > >> > >> > > > > > to release, we should get anything we need
> closed
> > > > out.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > There have been 2 commits since the 0.2.0
> release
> > > > > (listed
> > > > > > >> at
> > > > > > >> > the
> > > > > > >> > >> > end
> > > > > > >> > >> > > of
> > > > > > >> > >> > > > > the
> > > > > > >> > >> > > > > > message). This assumes a release from master.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > *Metron changelog*
> > > > > > >> > >> > > > > > METRON-1801 Allow Customization of
> Elasticsearch
> > > > > Document
> > > > > > >> > ID
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1218
> > > > > > >> > >> > > > > > METRON-1799 Remove outdated bylaws from site.
> > > > > > (justinleet)
> > > > > > >> > >> > closes
> > > > > > >> > >> > > > > > apache/metron#1216
> > > > > > >> > >> > > > > > METRON-1769 Script creation of a release
> > candidate
> > > > > > >> > >> (justinleet)
> > > > > > >> > >> > > > > closes
> > > > > > >> > >> > > > > > apache/metron#1188
> > > > > > >> > >> > > > > > METRON-1761 Allow a grok statement to be
> applied
> > to
> > > > > each
> > > > > > >> > >> line
> > > > > > >> > >> > in
> > > > > > >> > >> > > a
> > > > > > >> > >> > > > > > file. (ottobackwards) closes apache/metron#1184
> > > > > > >> > >> > > > > > METRON-1813 Stellar REPL Not Initialized with
> > > Client
> > > > > JAAS
> > > > > > >> > >> > > > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1232
> > > > > > >> > >> > > > > > METRON-1812: Fix dependencies_with_url.csv
> > > (mmiklavc
> > > > > via
> > > > > > >> > >> > > mmiklavc)
> > > > > > >> > >> > > > > > closes apache/metron#1230
> > > > > > >> > >> > > > > > METRON-1811 Alert Search Fails When Sorting by
> > > Alert
> > > > > > >> > Status
> > > > > > >> > >> > > > > (merrimanr)
> > > > > > >> > >> > > > > > closes apache/metron#1231
> > > > > > >> > >> > > > > > METRON-1809 Support Column Oriented Input with
> > > Batch
> > > > > > >> > >> Profiler
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1229
> > > > > > >> > >> > > > > > METRON-1806: Upgrade Maven Shade Plugin version
> > > > > (mmiklavc
> > > > > > >> > >> via
> > > > > > >> > >> > > > > mmiklavc)
> > > > > > >> > >> > > > > > closes apache/metron#1224
> > > > > > >> > >> > > > > > METRON-1792 Simplify Profile Definitions in
> > > > Integration
> > > > > > >> > >> Tests
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1211
> > > > > > >> > >> > > > > > METRON-1807 Auto populate the recommended
> values
> > to
> > > > > some
> > > > > > >> > of
> > > > > > >> > >> the
> > > > > > >> > >> > > > > metron
> > > > > > >> > >> > > > > > config parameters (MohanDV via merrimanr)
> closes
> > > > > > >> > >> > apache/metron#1227
> > > > > > >> > >> > > > > > METRON-1808 Add Ansible created pyc to
> gitignore
> > > > > > >> > >> (justinleet)
> > > > > > >> > >> > > > closes
> > > > > > >> > >> > > > > > apache/metron#1228
> > > > > > >> > >> > > > > > METRON-1695 Expose pcap properties through
> Ambari
> > > > > > >> > >> (anandsubbu)
> > > > > > >> > >> > > > closes
> > > > > > >> > >> > > > > > apache/metron#1207
> > > > > > >> > >> > > > > > METRON-1771 Update REST endpoints to support
> > > > eventually
> > > > > > >> > >> > > consistent
> > > > > > >> > >> > > > UI
> > > > > > >> > >> > > > > > updates (merrimanr) closes apache/metron#1190
> > > > > > >> > >> > > > > > METRON-1791 Add GUID to Messages Produced by
> > > Profiler
> > > > > > >> > >> > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1210
> > > > > > >> > >> > > > > > METRON-1804 Update version to 0.6.1
> (justinleet)
> > > > closes
> > > > > > >> > >> > > > > > apache/metron#1220
> > > > > > >> > >> > > > > > METRON-1798 Add mpack support for parser
> > > aggregation
> > > > > > >> > >> > (anandsubbu)
> > > > > > >> > >> > > > > > closes apache/metron#1215
> > > > > > >> > >> > > > > > METRON-1750 Create Parser for Syslog RFC 5424
> > > > Messages
> > > > > > >> > >> > > > > (ottobackwards)
> > > > > > >> > >> > > > > > closes apache/metron#1175
> > > > > > >> > >> > > > > > METRON-1794 Include User Details When
> Escalating
> > > > Alerts
> > > > > > >> > >> > > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1212
> > > > > > >> > >> > > > > > METRON-1782 Add Kafka Partition and Offset to
> > > > Profiler
> > > > > > >> > Debug
> > > > > > >> > >> > Logs
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1202
> > > > > > >> > >> > > > > > METRON-1758 Add support for Ansible 2.6 in dev
> > > > > (JonZeolla
> > > > > > >> > >> via
> > > > > > >> > >> > > > > > jonzeolla) closes apache/metron#1179
> > > > > > >> > >> > > > > > METRON-1784: Re-allow remote ssh and scp in
> > Centos
> > > > full
> > > > > > >> > dev
> > > > > > >> > >> > > > (mmiklavc
> > > > > > >> > >> > > > > > via mmiklavc) closes apache/metron#1204
> > > > > > >> > >> > > > > > METRON-1787 Input Time Constraints for Batch
> > > Profiler
> > > > > > >> > >> > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1209
> > > > > > >> > >> > > > > > METRON-1508 In Ubuntu14 Dev Indexing Fails to
> > Write
> > > > to
> > > > > > >> > >> > > > Elasticsearch
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1185
> > > > > > >> > >> > > > > > METRON-1786 Pcap Topology Status Incorrect
> > (MohanDV
> > > > via
> > > > > > >> > >> > > nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1206
> > > > > > >> > >> > > > > > METRON-1709 Add controls to start / stop the
> PCAP
> > > > > > topology
> > > > > > >> > >> from
> > > > > > >> > >> > > > > Ambari.
> > > > > > >> > >> > > > > > (MohanDV via nickwallen) closes
> > apache/metron#1201
> > > > > > >> > >> > > > > > METRON-1759 PCAP UI: Removing wrong Input
> > > annotations
> > > > > > from
> > > > > > >> > >> pcap
> > > > > > >> > >> > > > panel
> > > > > > >> > >> > > > > > component (tiborm via nickwallen) closes
> > > > > > apache/metron#1180
> > > > > > >> > >> > > > > > METRON-1772 Support alternative input formats
> in
> > > the
> > > > > > Batch
> > > > > > >> > >> > > Profiler
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1191
> > > > > > >> > >> > > > > > METRON-1770 Add Docs for Running the Profiler
> > with
> > > > > Spark
> > > > > > >> > on
> > > > > > >> > >> > YARN
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1189
> > > > > > >> > >> > > > > > METRON-1774 Allow user to configure JAAS client
> > in
> > > > > Ambari
> > > > > > >> > >> > > > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1192
> > > > > > >> > >> > > > > > METRON-1760 Kill PCAP job should prompt for
> > > > > confirmation
> > > > > > >> > >> > (ruffle
> > > > > > >> > >> > > > via
> > > > > > >> > >> > > > > > nickwallen) closes apache/metron#1199
> > > > > > >> > >> > > > > > METRON-1777: Fix Elasticsearch X-Pack sample
> pom
> > in
> > > > > > >> > >> > documentation
> > > > > > >> > >> > > > > > (mmiklavc via mmiklavc) closes
> apache/metron#1196
> > > > > > >> > >> > > > > > METRON-1781 Fix RPM Spec File (nickwallen)
> closes
> > > > > > >> > >> > > > apache/metron#1200
> > > > > > >> > >> > > > > > METRON-1780 Fix broken website images
> > (justinleet)
> > > > > closes
> > > > > > >> > >> > > > > > apache/metron#1198
> > > > > > >> > >> > > > > > METRON-1476 Update to Angular 6.1.3 (sardell
> via
> > > > > > >> > nickwallen)
> > > > > > >> > >> > > closes
> > > > > > >> > >> > > > > > apache/metron#1096
> > > > > > >> > >> > > > > > METRON-1776 Update public web site to point at
> > > 0.6.0
> > > > > new
> > > > > > >> > >> > release
> > > > > > >> > >> > > > > > (justinleet) closes apache/metron#1195
> > > > > > >> > >> > > > > > METRON-1775 Transient exception could prevent
> > > expired
> > > > > > >> > >> profiles
> > > > > > >> > >> > > from
> > > > > > >> > >> > > > > > being flushed (nickwallen) closes
> > > apache/metron#1194
> > > > > > >> > >> > > > > > METRON-1717 Relocate Storm Profiler Code
> > > (nickwallen)
> > > > > > >> > closes
> > > > > > >> > >> > > > > > apache/metron#1187
> > > > > > >> > >> > > > > > METRON-1748 Improve Storm Profiler Integration
> > Test
> > > > > > >> > >> > (nickwallen)
> > > > > > >> > >> > > > > closes
> > > > > > >> > >> > > > > > apache/metron#1174
> > > > > > >> > >> > > > > > METRON-1741 Move REPL Port of Profiler to
> > Separate
> > > > > > Project
> > > > > > >> > >> > > > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1170
> > > > > > >> > >> > > > > > METRON-1715 Create DEB Packaging for Batch
> > Profiler
> > > > > > >> > >> > (nickwallen)
> > > > > > >> > >> > > > > closes
> > > > > > >> > >> > > > > > apache/metron#1167
> > > > > > >> > >> > > > > > METRON-1736 Enhance Batch Profiler Integration
> > Test
> > > > > > >> > >> > (nickwallen)
> > > > > > >> > >> > > > > closes
> > > > > > >> > >> > > > > > apache/metron#1162
> > > > > > >> > >> > > > > > METRON-1714 Create RPM Packaging for the Batch
> > > > Profiler
> > > > > > >> > >> > > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1163
> > > > > > >> > >> > > > > > METRON-1708 Run the Batch Profiler in Spark
> > > > > (nickwallen)
> > > > > > >> > >> closes
> > > > > > >> > >> > > > > > apache/metron#1161
> > > > > > >> > >> > > > > > METRON-1707 Port Profiler to Spark (nickwallen)
> > > > closes
> > > > > > >> > >> > > > > > apache/metron#1150
> > > > > > >> > >> > > > > > METRON-1705 Create ProfilePeriod Using Period
> ID
> > > > > > >> > >> (nickwallen)
> > > > > > >> > >> > > > closes
> > > > > > >> > >> > > > > > apache/metron#1148
> > > > > > >> > >> > > > > > METRON-1706 HbaseClient.mutate should return
> the
> > > > number
> > > > > > of
> > > > > > >> > >> > > > mutations
> > > > > > >> > >> > > > > > (nickwallen) closes apache/metron#1147
> > > > > > >> > >> > > > > > METRON-1704 Message Timestamp Logic Should be
> > > Shared
> > > > > > >> > >> > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1146
> > > > > > >> > >> > > > > > METRON-1703 Make Core Profiler Components
> > > > Serializable
> > > > > > >> > >> > > (nickwallen)
> > > > > > >> > >> > > > > > closes apache/metron#1145
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > *Metron-bro-kafka-plugin changelog*
> > > > > > >> > >> > > > > > METRON-1800 Increment metron-bro-plugin-kafka
> > > version
> > > > > > >> > >> > (JonZeolla
> > > > > > >> > >> > > > via
> > > > > > >> > >> > > > > > jonzeolla) closes
> > apache/metron-bro-plugin-kafka#10
> > > > > > >> > >> > > > > > METRON-1773 Bro plugin docs should refer to
> > Apache
> > > > > Metron
> > > > > > >> > >> > project
> > > > > > >> > >> > > > > > (nickwallen) closes
> > > apache/metron-bro-plugin-kafka#9
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> > > --
> > > > > > >> > >
> > > > > > >> > > Jon Zeolla
> > > > > > >> > >
> > > > > > >> > --
> > > > > > >> >
> > > > > > >> > Jon Zeolla
> > > > > > >> >
> > > > > > >>
> > > > > > > --
> > > > > > >
> > > > > > > Jon Zeolla
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> > --
> >
> > Jon Zeolla
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message