metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zeolla@GMail.com" <zeo...@gmail.com>
Subject Re: Metron Release 0.6.1 and/or Plugin release 0.3.0?
Date Wed, 14 Nov 2018 15:29:07 GMT
In my opinion metron-bro-plugin-kafka is ready for a release.  Anything
else people would want to see?  Once it gets released, I would like to
update full dev to use the newest version prior to any future metron
release (0.6.1 or whatever we choose).

Jon

On Wed, Nov 7, 2018 at 8:07 PM Zeolla@GMail.com <zeolla@gmail.com> wrote:

> So, about this release, anybody have time to review
> apache/metron-bro-plugin-kafka#2 and apache/metron-bro-plugin-kafka#13?
>
> Jon
>
> On Wed, Oct 17, 2018 at 10:37 AM Michael Miklavcic <
> michael.miklavcic@gmail.com> wrote:
>
>> And I do think we will be ready to roll another Metron release in the near
>> future as well.
>>
>> On Wed, Oct 17, 2018 at 8:26 AM Justin Leet <justinjleet@gmail.com>
>> wrote:
>>
>> > I tend to agree with Mike. I think we could do a release of the main
>> > project and get benefit, but I think skipping this cycle (especially
>> since
>> > we had a release last month) let's us get things like the ES client
>> > migration in and settled and just generally make recommending a newer
>> > version easier.
>> >
>> > The main reason for doing a release for the Bro plugin is to address
>> > shortcomings that we discovered and are addressing.
>> >
>> > On Tue, Oct 16, 2018 at 4:42 PM Michael Miklavcic <
>> > michael.miklavcic@gmail.com> wrote:
>> >
>> > > Migrating the ES client, refactoring parser bolt. There are some
>> > interface
>> > > changes in flight right now that I think would be beneficial to see in
>> > the
>> > > next release.
>> > >
>> > > On Tue, Oct 16, 2018 at 2:01 PM Nick Allen <nick@nickallen.org>
>> wrote:
>> > >
>> > > > I am in favor of a release for both.
>> > > >
>> > > > There are a lot of really useful bug fixes, management of pcap
>> through
>> > > > Ambari, more flexibility for configuring JAAS in Ambari, increased
>> > > > Elasticsearch performance, the Syslog parser, and the Batch
>> Profiler,
>> > > among
>> > > > others. I would be happy with calling it a 0.6.1 point release.
>> > > >
>> > > > Mike - What is outstanding that you would like to see in the
>> release?
>> > > >
>> > > > On Tue, Oct 16, 2018, 12:21 PM Michael Miklavcic <
>> > > > michael.miklavcic@gmail.com> wrote:
>> > > >
>> > > > > I'd be +1 on going with just the metron-bro-kafka-plugin release.
>> It
>> > > > seems
>> > > > > like it's ready to go, and I think there are a few more things
I'd
>> > like
>> > > > to
>> > > > > see get into our next Metron release so I'm good with holding
off
>> > > there.
>> > > > >
>> > > > > Mike
>> > > > >
>> > > > > On Tue, Oct 16, 2018 at 10:26 AM Justin Leet <
>> justinjleet@gmail.com>
>> > > > > wrote:
>> > > > >
>> > > > > > Hi all,
>> > > > > >
>> > > > > > As you might recall from a prior discussion about release
>> cadence,
>> > we
>> > > > > were
>> > > > > > interested in initiating release threads near our board
reports
>> to
>> > > see
>> > > > if
>> > > > > > we wanted to do releases or not. Additionally, the work
is done
>> to
>> > do
>> > > > two
>> > > > > > separate releases, so our options are releasing both, a
single
>> one,
>> > > or
>> > > > > > neither.
>> > > > > >
>> > > > > > Having said that, a metron-bro-kafka-plugin 0.3.0 release
came
>> up
>> > on
>> > > > this
>> > > > > > thread
>> > > > > > <
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> https://lists.apache.org/thread.html/3c18c3aba6b436b11032831e7db541d50eb7cb1e3ae54b7423057c88@%3Cdev.metron.apache.org%3E
>> > > > > > >.
>> > > > > > In particular, the prospect of a release came up in the
context
>> of
>> > > > > having a
>> > > > > > version with better (and working) testing.
>> > > > > >
>> > > > > > Version Number
>> > > > > > If we choose to do a core Metron release, I propose 0.6.1.
For
>> > > > > > metron-bro-kafka-plugin, I propose 0.3.0.  Keep in mind,
the
>> > > versioning
>> > > > > for
>> > > > > > the plugin is a bit different in that we need x.y for bro-pkg,
>> > > instead
>> > > > of
>> > > > > > x.y.z, so we wouldn't release 0.2.1.
>> > > > > >
>> > > > > > I would personally be in favor of doing a plugin release,
but
>> I'm
>> > > less
>> > > > > > inclined to do a core Metron release.
>> > > > > >
>> > > > > > For Metron, I believe the main feature is the batch profiler
>> work,
>> > > but
>> > > > > > there's a fair amount of fixes and improvements.
>> > > > > >
>> > > > > > For the plugin, I believe the main improvements would be
around
>> the
>> > > > > fixing
>> > > > > > our testing and more maintenance type work.
>> > > > > >
>> > > > > > JIRA status
>> > > > > > *metron*
>> > > > > > There are 24 opens PRs at
>> https://github.com/apache/metron/pulls.
>> > > If
>> > > > we
>> > > > > > do
>> > > > > > decide to release, we should work on getting anything meriting
>> > > > inclusion
>> > > > > > closed out.
>> > > > > >
>> > > > > > There have been 49 commits since the 0.6.0 release (listed
at
>> the
>> > end
>> > > > of
>> > > > > > the message). This assumes a release from master.
>> > > > > >
>> > > > > > *metron-bro-kafka-plugin*
>> > > > > > There are 6 open PRs at
>> > > > > > https://github.com/apache/metron-bro-plugin-kafka/pulls.
 If
>> we do
>> > > > > decide
>> > > > > > to release, we should get anything we need closed out.
>> > > > > >
>> > > > > > There have been 2 commits since the 0.2.0 release (listed
at the
>> > end
>> > > of
>> > > > > the
>> > > > > > message).  This assumes a release from master.
>> > > > > >
>> > > > > > *Metron changelog*
>> > > > > >     METRON-1801 Allow Customization of Elasticsearch Document
ID
>> > > > > > (nickwallen) closes apache/metron#1218
>> > > > > >     METRON-1799 Remove outdated bylaws from site. (justinleet)
>> > closes
>> > > > > > apache/metron#1216
>> > > > > >     METRON-1769 Script creation of a release candidate
>> (justinleet)
>> > > > > closes
>> > > > > > apache/metron#1188
>> > > > > >     METRON-1761 Allow a grok statement to be applied to
each
>> line
>> > in
>> > > a
>> > > > > > file. (ottobackwards) closes apache/metron#1184
>> > > > > >     METRON-1813 Stellar REPL Not Initialized with Client
JAAS
>> > > > > (nickwallen)
>> > > > > > closes apache/metron#1232
>> > > > > >     METRON-1812: Fix dependencies_with_url.csv (mmiklavc
via
>> > > mmiklavc)
>> > > > > > closes apache/metron#1230
>> > > > > >     METRON-1811 Alert Search Fails When Sorting by Alert
Status
>> > > > > (merrimanr)
>> > > > > > closes apache/metron#1231
>> > > > > >     METRON-1809 Support Column Oriented Input with Batch
>> Profiler
>> > > > > > (nickwallen) closes apache/metron#1229
>> > > > > >     METRON-1806: Upgrade Maven Shade Plugin version (mmiklavc
>> via
>> > > > > mmiklavc)
>> > > > > > closes apache/metron#1224
>> > > > > >     METRON-1792 Simplify Profile Definitions in Integration
>> Tests
>> > > > > > (nickwallen) closes apache/metron#1211
>> > > > > >     METRON-1807 Auto populate the recommended values to
some of
>> the
>> > > > > metron
>> > > > > > config parameters  (MohanDV via merrimanr) closes
>> > apache/metron#1227
>> > > > > >     METRON-1808 Add Ansible created pyc to gitignore
>> (justinleet)
>> > > > closes
>> > > > > > apache/metron#1228
>> > > > > >     METRON-1695 Expose pcap properties through Ambari
>> (anandsubbu)
>> > > > closes
>> > > > > > apache/metron#1207
>> > > > > >     METRON-1771 Update REST endpoints to support eventually
>> > > consistent
>> > > > UI
>> > > > > > updates (merrimanr) closes apache/metron#1190
>> > > > > >     METRON-1791 Add GUID to Messages Produced by Profiler
>> > > (nickwallen)
>> > > > > > closes apache/metron#1210
>> > > > > >     METRON-1804 Update version to 0.6.1 (justinleet) closes
>> > > > > > apache/metron#1220
>> > > > > >     METRON-1798 Add mpack support for parser aggregation
>> > (anandsubbu)
>> > > > > > closes apache/metron#1215
>> > > > > >     METRON-1750 Create Parser for Syslog RFC 5424 Messages
>> > > > > (ottobackwards)
>> > > > > > closes apache/metron#1175
>> > > > > >     METRON-1794 Include User Details When Escalating Alerts
>> > > > (nickwallen)
>> > > > > > closes apache/metron#1212
>> > > > > >     METRON-1782 Add Kafka Partition and Offset to Profiler
Debug
>> > Logs
>> > > > > > (nickwallen) closes apache/metron#1202
>> > > > > >     METRON-1758 Add support for Ansible 2.6 in dev (JonZeolla
>> via
>> > > > > > jonzeolla) closes apache/metron#1179
>> > > > > >     METRON-1784: Re-allow remote ssh and scp in Centos full
dev
>> > > > (mmiklavc
>> > > > > > via mmiklavc) closes apache/metron#1204
>> > > > > >     METRON-1787 Input Time Constraints for Batch Profiler
>> > > (nickwallen)
>> > > > > > closes apache/metron#1209
>> > > > > >     METRON-1508 In Ubuntu14 Dev Indexing Fails to Write
to
>> > > > Elasticsearch
>> > > > > > (nickwallen) closes apache/metron#1185
>> > > > > >     METRON-1786 Pcap Topology Status Incorrect (MohanDV
via
>> > > nickwallen)
>> > > > > > closes apache/metron#1206
>> > > > > >     METRON-1709 Add controls to start / stop the PCAP topology
>> from
>> > > > > Ambari.
>> > > > > > (MohanDV via nickwallen) closes apache/metron#1201
>> > > > > >     METRON-1759 PCAP UI: Removing wrong Input annotations
from
>> pcap
>> > > > panel
>> > > > > > component (tiborm via nickwallen) closes apache/metron#1180
>> > > > > >     METRON-1772 Support alternative input formats in the
Batch
>> > > Profiler
>> > > > > > (nickwallen) closes apache/metron#1191
>> > > > > >     METRON-1770 Add Docs for Running the Profiler with Spark
on
>> > YARN
>> > > > > > (nickwallen) closes apache/metron#1189
>> > > > > >     METRON-1774 Allow user to configure JAAS client in Ambari
>> > > > > (nickwallen)
>> > > > > > closes apache/metron#1192
>> > > > > >     METRON-1760 Kill PCAP job should prompt for confirmation
>> > (ruffle
>> > > > via
>> > > > > > nickwallen) closes apache/metron#1199
>> > > > > >     METRON-1777: Fix Elasticsearch X-Pack sample pom in
>> > documentation
>> > > > > > (mmiklavc via mmiklavc) closes apache/metron#1196
>> > > > > >     METRON-1781 Fix RPM Spec File (nickwallen) closes
>> > > > apache/metron#1200
>> > > > > >     METRON-1780 Fix broken website images (justinleet) closes
>> > > > > > apache/metron#1198
>> > > > > >     METRON-1476 Update to Angular 6.1.3 (sardell via nickwallen)
>> > > closes
>> > > > > > apache/metron#1096
>> > > > > >     METRON-1776 Update public web site to point at 0.6.0
new
>> > release
>> > > > > > (justinleet) closes apache/metron#1195
>> > > > > >     METRON-1775 Transient exception could prevent expired
>> profiles
>> > > from
>> > > > > > being flushed (nickwallen) closes apache/metron#1194
>> > > > > >     METRON-1717 Relocate Storm Profiler Code (nickwallen)
closes
>> > > > > > apache/metron#1187
>> > > > > >     METRON-1748 Improve Storm Profiler Integration Test
>> > (nickwallen)
>> > > > > closes
>> > > > > > apache/metron#1174
>> > > > > >     METRON-1741 Move REPL Port of Profiler to Separate Project
>> > > > > (nickwallen)
>> > > > > > closes apache/metron#1170
>> > > > > >     METRON-1715 Create DEB Packaging for Batch Profiler
>> > (nickwallen)
>> > > > > closes
>> > > > > > apache/metron#1167
>> > > > > >     METRON-1736 Enhance Batch Profiler Integration Test
>> > (nickwallen)
>> > > > > closes
>> > > > > > apache/metron#1162
>> > > > > >     METRON-1714 Create RPM Packaging for the Batch Profiler
>> > > > (nickwallen)
>> > > > > > closes apache/metron#1163
>> > > > > >     METRON-1708 Run the Batch Profiler in Spark (nickwallen)
>> closes
>> > > > > > apache/metron#1161
>> > > > > >     METRON-1707 Port Profiler to Spark (nickwallen) closes
>> > > > > > apache/metron#1150
>> > > > > >     METRON-1705 Create ProfilePeriod Using Period ID
>> (nickwallen)
>> > > > closes
>> > > > > > apache/metron#1148
>> > > > > >     METRON-1706 HbaseClient.mutate should return the number
of
>> > > > mutations
>> > > > > > (nickwallen) closes apache/metron#1147
>> > > > > >     METRON-1704 Message Timestamp Logic Should be Shared
>> > (nickwallen)
>> > > > > > closes apache/metron#1146
>> > > > > >     METRON-1703 Make Core Profiler Components Serializable
>> > > (nickwallen)
>> > > > > > closes apache/metron#1145
>> > > > > >
>> > > > > > *Metron-bro-kafka-plugin changelog*
>> > > > > >     METRON-1800 Increment metron-bro-plugin-kafka version
>> > (JonZeolla
>> > > > via
>> > > > > > jonzeolla) closes apache/metron-bro-plugin-kafka#10
>> > > > > >     METRON-1773 Bro plugin docs should refer to Apache Metron
>> > project
>> > > > > > (nickwallen) closes apache/metron-bro-plugin-kafka#9
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
> --
>
> Jon Zeolla
>
-- 

Jon Zeolla

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message