metron-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Foley <mfo...@hortonworks.com>
Subject Re: [DISCUSS] Metron release 0.4.1
Date Thu, 31 Aug 2017 19:11:38 GMT
Please mark them 0.4.1, as that’s what the community says we want to call the upcoming release,
and everything that’s there when I throw the switch will be included.

Jon and Anand, will they be in by end/day Friday?
Thanks,
--Matt

On 8/31/17, 7:45 AM, "Nick Allen" <nick@nickallen.org> wrote:

    Matt, et al - For JIRAs that are going into master, should we be marking
    these as "Next + 1" or "0.4.1" ?
    
    On Thu, Aug 31, 2017 at 8:17 AM Zeolla@GMail.com <zeolla@gmail.com> wrote:
    
    > Can I advocate to get METRON-1129 in the RC, and throw in a second vote for
    > METRON-1134?  Both in an attempt to better support of prod/offline use.
    > Happy to provide testing cycles for the former.
    >
    > Jon
    >
    > On Wed, Aug 30, 2017 at 11:41 AM Anand Subramanian <
    > asubramanian@hortonworks.com> wrote:
    >
    > > Hi Matt,
    > >
    > > This defect needs to be included as a follow-on to METRON-1122:
    > > * METRON-1141 (https://github.com/apache/metron/pull/723)
    > >
    > >
    > > Thanks,
    > > Anand
    > >
    > >
    > >
    > > On 8/30/17, 8:57 PM, "Michael Miklavcic" <michael.miklavcic@gmail.com>
    > > wrote:
    > >
    > > >I have some work around fixing how we handle config with Ambari that I'd
    > > >like to see go in. No PR yet, but coming soon. I expect to have this by
    > > the
    > > >RC deadline.
    > > >
    > > >Mike
    > > >
    > > >On Wed, Aug 30, 2017 at 8:57 AM, Nick Allen <nick@nickallen.org> wrote:
    > > >
    > > >> The following PRs are usability enhancements for the Profiler.  They
    > are
    > > >> fairly simple and I think are very helpful for troubleshooting.  I
    > don't
    > > >> want to hold up the release, but it would be a "nice to have" to get
    > > these
    > > >> in.
    > > >>
    > > >> If anyone has cycles, I would appreciate some reviews of these PRs.
    > > >> https://github.com/apache/metron/pull/721
    > > >> https://github.com/apache/metron/pull/716
    > > >>
    > > >>
    > > >>
    > > >> On Tue, Aug 29, 2017 at 8:59 PM Matt Foley <mattf@apache.org>
wrote:
    > > >>
    > > >> > Okay, just to be clear, you’re requesting we wait until Friday,
if
    > > >> > necessary, to cut an RC with 717 in it?
    > > >> > Thanks,
    > > >> > --Matt
    > > >> >
    > > >> > On 8/29/17, 11:45 AM, "Casey Stella" <cestella@gmail.com>
wrote:
    > > >> >
    > > >> >     709 is in and 717 is under concerted review by Otto.  I'd
like
    > to
    > > see
    > > >> > it in
    > > >> >     by Friday.
    > > >> >
    > > >> >     On Tue, Aug 29, 2017 at 1:35 PM, Matt Foley <mattf@apache.org>
    > > >> wrote:
    > > >> >
    > > >> >     > Hi all,
    > > >> >     > Thanks for your inputs.  The three PRs Nick mentioned
have
    > been
    > > >> >     > successfully closed.
    > > >> >     > Casey, do you have an ETA for these two PRs? (PR#709
and 717)
    > > >> >     > Thanks,
    > > >> >     > --Matt
    > > >> >     >
    > > >> >     > On 8/29/17, 9:34 AM, "Casey Stella" <cestella@gmail.com>
    > wrote:
    > > >> >     >
    > > >> >     >     For my PRs, I'd vote for METRON-1122 being in (commit
very
    > > >> > imminent).
    > > >> >     >     I'd very much like METRON-1134 to be in as well.
    > > >> >     >
    > > >> >     >     Beyond that, I'm ok
    > > >> >     >
    > > >> >     >     On Tue, Aug 22, 2017 at 4:37 PM, Nick Allen <
    > > >> nick@nickallen.org>
    > > >> >     > wrote:
    > > >> >     >
    > > >> >     >     > Thanks for starting the process, Matt.
    > > >> >     >     >
    > > >> >     >     > These are my own open PRs that I would most
like to see
    > > get
    > > >> in.
    > > >> >     > They all
    > > >> >     >     > relate to the Profiler. My other outstanding
PRs are
    > less
    > > >> > important.
    > > >> >     >     >
    > > >> >     >     >    - https://github.com/apache/metron/pull/705
    > > >> >     >     >    - https://github.com/apache/metron/pull/707
    > > >> >     >     >    - https://github.com/apache/metron/pull/708
    > > >> >     >     >
    > > >> >     >     >
    > > >> >     >     >
    > > >> >     >     >
    > > >> >     >     >
    > > >> >     >     > On Tue, Aug 22, 2017 at 4:17 PM Matt Foley <
    > > mattf@apache.org
    > > >> >
    > > >> > wrote:
    > > >> >     >     >
    > > >> >     >     > > Hello all,
    > > >> >     >     > > At the meeting this morning, the community
expressed
    > the
    > > >> > wish to
    > > >> >     > create a
    > > >> >     >     > > new release, to be a point release and
not including
    > > >> > METRON-777.
    > > >> >     >     > >
    > > >> >     >     > > Therefore, I propose to create release
0.4.1 from
    > Metron
    > > >> > master
    > > >> >     > branch,
    > > >> >     >     > > with whatever additional commits the community
    > considers
    > > >> > vital and
    > > >> >     > can
    > > >> >     >     > get
    > > >> >     >     > > in in the next few days.
    > > >> >     >     > >
    > > >> >     >     > > There have been 74 commits since the 0.4.0
release
    > (list
    > > >> > appended
    > > >> >     > to end
    > > >> >     >     > > of this message).
    > > >> >     >     > > I have not yet done a compare to make sure
all 74
    > > completed
    > > >> >     > commits have
    > > >> >     >     > > closed their Jiras, but I will follow up
with that
    > info.
    > > >> >     >     > >
    > > >> >     >     > > There are 35 open PRs, see
    > > >> > https://github.com/apache/metron/pulls
    > > >> >     > ,
    > > >> >     >     > which
    > > >> >     >     > > is getting a little clunky.  Surely not
all of them
    > can
    > > get
    > > >> > in in
    > > >> >     > the
    > > >> >     >     > next
    > > >> >     >     > > few days, but do we want to try to close
and include
    > > some
    > > >> of
    > > >> > them?
    > > >> >     >     > >
    > > >> >     >     > > Please respond to the list with your requests
to
    > include
    > > >> > specific
    > > >> >     >     > > additional PRs before we cut the 0.4.1
release
    > > candidate.
    > > >> > Let’s
    > > >> >     > keep it
    > > >> >     >     > > practical so we don’t delay more than
a week or so.
    > > >> >     >     > >
    > > >> >     >     > > TIMEFRAME:  Tentatively I would like to
start the
    > > process
    > > >> of
    > > >> >     > cutting an
    > > >> >     >     > RC
    > > >> >     >     > > this coming Monday 28 August.  If we have
too many PRs
    > > >> > required to
    > > >> >     > be in,
    > > >> >     >     > > we may have to slip that.  Likewise, if
there is need
    > > for
    > > >> > urgency,
    > > >> >     > I can
    > > >> >     >     > > start as soon as tomorrow.  We will be
guided by your
    > > >> > responses.
    > > >> >     >     > >
    > > >> >     >     > > Thanks,
    > > >> >     >     > > --Matt
    > > >> >     >     > > (Release Manager)
    > > >> >     >     > >
    > > >> >     >     > > COMPLETED PRs as of 22 Aug 2017:
    > > >> >     >     > >     METRON-1115 Jackson is not properly
serializing
    > > >> > readMetadata
    > > >> >     > and
    > > >> >     >     > > mergeMetadata SensorParserConfig properties
    > (merrimanr)
    > > >> > closes
    > > >> >     >     > > apache/metron#703
    > > >> >     >     > >     METRON-1047 REST should use core-site.xml
for
    > Hadoop
    > > >> >     > configuration
    > > >> >     >     > > (merrimanr) closes apache/metron#672
    > > >> >     >     > >     METRON-1111 Mislabeled Configuration
Property in
    > > Ambari
    > > >> >     > (nickwallen)
    > > >> >     >     > > closes apache/metron#698
    > > >> >     >     > >     METRON-1113 UpdateControllerIntegrationTest
fails
    > > with
    > > >> > 500
    > > >> >     > error
    > > >> >     >     > > (merrimanr) closes apache/metron#701
    > > >> >     >     > >     METRON-711 StellarShell assigns variables
even if
    > an
    > > >> > exception
    > > >> >     > was
    > > >> >     >     > > thrown in the statement. (ottobackwards)
closes
    > > >> > apache/metron#686
    > > >> >     >     > >     METRON-1110 REST jvm flags property
is being
    > > >> overwritten
    > > >> > when
    > > >> >     >     > Kerberos
    > > >> >     >     > > is enabled (merrimanr) closes apache/metron#697
    > > >> >     >     > >     METRON-739 Create Local Profile Runner
    > (nickwallen)
    > > >> > closes
    > > >> >     >     > > apache/metron#693
    > > >> >     >     > >     METRON-1109 Indexing topology fails
to start after
    > > >> > Kerberos is
    > > >> >     >     > enabled
    > > >> >     >     > > (merrimanr) closes apache/metron#696
    > > >> >     >     > >     METRON-1108 Metron configuration tabs
are not
    > > showing
    > > >> up
    > > >> > in
    > > >> >     > Ambari
    > > >> >     >     > > this closes apache/incubator-metron#695
    > > >> >     >     > >     METRON-1078 Metron Indexing fails to
stop during
    > > >> > &quot;Stop All
    > > >> >     >     > > Services&quot; (dlyle65535) closes
apache/metron#680
    > > >> >     >     > >     METRON-1104 Build Failure - Due to
Bootstrap
    > version
    > > >> > change
    > > >> >     >     > > (iraghumitra via justinleet) closes apache/metron#691
    > > >> >     >     > >     METRON-1094 MaaS will not start due
to classpath
    > > error
    > > >> >     > relating to
    > > >> >     >     > > Yarn closes apache/incubator-metron#688
    > > >> >     >     > >     METRON-1102 Add support for ingesting
cybox URI
    > > >> > observables
    > > >> >     > from
    > > >> >     >     > taxii
    > > >> >     >     > > feeds closes apache/incubator-metron#689
    > > >> >     >     > >     METRON-838 Incorrect set of ts in FireEye
parser
    > > >> (bjigmp
    > > >> > via
    > > >> >     >     > > justinleet) closes apache/metron#528
    > > >> >     >     > >     METRON-322 Global Batching and Flushing
    > > (mattf-horton)
    > > >> > closes
    > > >> >     >     > > apache/metron#481
    > > >> >     >     > >     METRON-988 UI for viewing alerts generated
by
    > Metron
    > > >> >     > (iraghumitra
    > > >> >     >     > via
    > > >> >     >     > > nickwallen) closes apache/metron#620
    > > >> >     >     > >     METRON-1084 Management UI web server
license
    > should
    > > be
    > > >> > Apache
    > > >> >     >     > > (merrimanr) closes apache/metron#683
    > > >> >     >     > >     METRON-1026 threatintel_taxii_load.sh
throws
    > > exception
    > > >> > closes
    > > >> >     >     > > apache/incubator-metron#643
    > > >> >     >     > >     METRON-1051 Enable the ability to update
indexed
    > > >> messages
    > > >> >     > closes
    > > >> >     >     > > apache/incubator-metron#666
    > > >> >     >     > >     METRON-1069 Ambari MPack documentation
around
    > > >> development
    > > >> >     > strategies
    > > >> >     >     > > (justinleet) closes apache/metron#1069
    > > >> >     >     > >     METRON-1069 Ambari MPack documentation
around
    > > >> development
    > > >> >     > strategies
    > > >> >     >     > > (merrimanr via justinleet) closes apache/metron#1069
    > > >> >     >     > >     METRON-1069 Ambari MPack documentation
around
    > > >> development
    > > >> >     > strategies
    > > >> >     >     > > (justinleet) closes apache/metron#1069
    > > >> >     >     > >     METRON-1076 Management UI status check
always
    > > reports
    > > >> the
    > > >> >     > service as
    > > >> >     >     > > running (merrimanr) closes apache/metron#678
    > > >> >     >     > >     METRON-1075 Add faceted search capabilities
    > > (merrimanr)
    > > >> > closes
    > > >> >     >     > > apache/metron#679
    > > >> >     >     > >     METRON-379 Stellar - No Error When
Adding
    > Variables
    > > >> That
    > > >> > Do
    > > >> >     > Not Exist
    > > >> >     >     > > (ottobackwards) closes apache/metron#675
    > > >> >     >     > >     METRON-1038 Stellar should have a better
    > collection
    > > of
    > > >> > basic
    > > >> >     > math
    > > >> >     >     > > operations closes apache/incubator-metron#650
    > > >> >     >     > >     METRON-1072 Cleanup Maven build warnings
    > (mmiklavc)
    > > >> > closes
    > > >> >     >     > > apache/metron#676
    > > >> >     >     > >     METRON-1056 Get field types from Elasticsearch
    > > >> > (merrimanr)
    > > >> >     > closes
    > > >> >     >     > > apache/metron#662
    > > >> >     >     > >     METRON-1011 Stellar ENRICHMENT functions
should
    > > enforce
    > > >> >     > submission of
    > > >> >     >     > > 4 parameters (jasper-k via ottobackwards)
closes
    > > >> > apache/metron#628
    > > >> >     >     > >     METRON-975 Normalize logging and switch
to common
    > > idiom
    > > >> > with
    > > >> >     > SLF4J
    > > >> >     >     > > (mmiklavc) closes apache/metron#599
    > > >> >     >     > >     METRON-681 CSVConverter should trim
values (basvdl
    > > via
    > > >> >     > ottobackwards)
    > > >> >     >     > > closes apache/metron#674
    > > >> >     >     > >     METRON-746 Build Custom Checkstyle
and IDE
    > > formatting
    > > >> > settings
    > > >> >     >     > > (justinleet via mmiklavc) closes apache/metron#577
    > > >> >     >     > >     METRON-1060 Add performance timing
logging to
    > > >> enrichment
    > > >> >     > topology
    > > >> >     >     > > (mmiklavc) closes apache/metron#665
    > > >> >     >     > >     METRON-982 REST STORM Support for supervisor
    > summary
    > > >> >     > (ottobackwards)
    > > >> >     >     > > closes apache/metron#607
    > > >> >     >     > >     METRON-1064 Make init script OS-agnostic
    > (merrimanr)
    > > >> > closes
    > > >> >     >     > > apache/metron#669
    > > >> >     >     > >     METRON-984 Create STELLAR Decoding
Functions
    > > >> > (ottobackwards)
    > > >> >     > closes
    > > >> >     >     > > apache/metron#642
    > > >> >     >     > >     METRON-1067 Minor typo in documentation
    > > (spencer-hanson
    > > >> > via
    > > >> >     >     > > justinleet) closes apache/metron#671
    > > >> >     >     > >     METRON-1018 Integration tests should
reference
    > flux
    > > >> yaml
    > > >> > and
    > > >> >     > property
    > > >> >     >     > > files deployed by Ambari (merrimanr) closes
    > > >> apache/metron#635
    > > >> >     >     > >     METRON-1050 Improve Docs of
    > > `profiler.period.duration`
    > > >> >     > (nickwallen)
    > > >> >     >     > > closes apache/metron#656
    > > >> >     >     > >     METRON-1043 Profiler Should be Less
Dramatic When
    > > >> Missing
    > > >> >     >     > > Configuration (nickwallen) closes apache/metron#655
    > > >> >     >     > >     METRON-1053 Relocate Metron Docker
(nickwallen)
    > > closes
    > > >> >     >     > > apache/metron#659
    > > >> >     >     > >     METRON-1058 address checkstyle warnings
for
    > > >> > UnusedImports in
    > > >> >     >     > > metron-stellar (dbist via ottobackwards)
closes
    > > >> > apache/metron#663
    > > >> >     >     > >     METRON-1035 Added SUM to the rules
triage
    > > aggregation
    > > >> > docs
    > > >> >     > closes
    > > >> >     >     > > apache/incubator-metron#649
    > > >> >     >     > >     METRON-1039 Add ZIP function to Stellar
closes
    > > >> >     >     > > apache/incubator-metron#652
    > > >> >     >     > >     METRON-1054 Ambari Mpack Attempts to
Kill
    > Topologies
    > > >> > That Are
    > > >> >     > Not
    > > >> >     >     > > Running (nickwallen) closes apache/metron#660
    > > >> >     >     > >     METRON-992: Create performance tuning
guide
    > > (mmiklavc)
    > > >> > closes
    > > >> >     >     > > apache/metron#614
    > > >> >     >     > >     METRON-1044 Disabled writers are not
acking
    > messages
    > > >> >     > (merrimanr)
    > > >> >     >     > > closes apache/metron#654
    > > >> >     >     > >     METRON-1022 Elasticsearch REST endpoint
this
    > closes
    > > >> >     >     > > apache/incubator-metron#636
    > > >> >     >     > >     METRON-1048 Intermittent Test Failure
for
    > > >> >     >     > > SimpleHBaseEnrichmentWriterLoggingTest
(nickwallen)
    > > closes
    > > >> >     >     > apache/metron#658
    > > >> >     >     > >     METRON-1029 Topology worker opts are
not being set
    > > when
    > > >> >     > Kerberos is
    > > >> >     >     > > enabled (merrimanr) closes apache/metron#645
    > > >> >     >     > >     METRON-1031 Management UI Cannot Start
Topologies
    > in
    > > >> > Kerberized
    > > >> >     >     > > Environment (nickwallen) closes apache/metron#647
    > > >> >     >     > >     METRON-1008 Migrate Travis build to
use Trusty
    > > (jjmeyer
    > > >> > via
    > > >> >     >     > > justinleet) closes apache/metron#633
    > > >> >     >     > >     METRON-633 Create better logging for
    > > >> > HbaseEnrichmentWriter
    > > >> >     > (zezutom
    > > >> >     >     > > via justinleet) closes apache/metron#572
    > > >> >     >     > >     METRON-1003 ParserUtil parses dates
incorrect
    > > (bjigmp
    > > >> via
    > > >> >     > justinleet)
    > > >> >     >     > > closes apache/metron#623
    > > >> >     >     > >     METRON-1040 Create Installation Instructions
for
    > the
    > > >> > Profiler
    > > >> >     >     > > (nickwallen) closes apache/metron#653
    > > >> >     >     > >     METRON-833 Update MaaS documentation
to explain
    > how
    > > it
    > > >> >     > interacts with
    > > >> >     >     > > kerberos (cestella via justinleet) closes
    > > apache/metron#520
    > > >> >     >     > >     METRON-1033 Profiler example uses incorrect
units
    > > for
    > > >> > expires
    > > >> >     >     > > (simonellistonball via nickwallen) closes
    > > apache/metron#648
    > > >> >     >     > >     METRON-1019 Metron 0.4.0 manual installation
guide
    > > for
    > > >> > CentOS 6
    > > >> >     >     > > (lvets via ottobackwards) closes apache/metron#631
    > > >> >     >     > >     METRON-1013 StellarShell does not validate
    > > parameters
    > > >> >     > (ottobackwards)
    > > >> >     >     > > closes apache/metron#639
    > > >> >     >     > >     METRON-1017 Ambari components should
be separate
    > > >> > (merrimanr)
    > > >> >     > closes
    > > >> >     >     > > apache/metron#634
    > > >> >     >     > >     METRON-933 STELLAR support for setting
fields to
    > > regex
    > > >> > match
    > > >> >     > captures
    > > >> >     >     > > (ottobackwards) closes apache/metron#638
    > > >> >     >     > >     METRON-1001 Allow metron to ingest
parser metadata
    > > >> along
    > > >> > with
    > > >> >     > data
    > > >> >     >     > > closes apache/incubator-metron#621
    > > >> >     >     > >     METRON-1027 Errant Log Message When
No GeoIP Hit
    > on
    > > >> > Valid,
    > > >> >     > External
    > > >> >     >     > > IPv4 Address (nickwallen) closes apache/metron#644
    > > >> >     >     > >     METRON-1025 Metron github pr template
should not
    > > >> > reference
    > > >> >     > incubator
    > > >> >     >     > > (ottobackwards) closes apache/metron#640
    > > >> >     >     > >     METRON-1021 increment metron version
number to
    > > 0.4.1 in
    > > >> > poms
    > > >> >     > etc
    > > >> >     >     > > (mattf-horton) closes apache/metron#637
    > > >> >     >     > >     METRON-986 Enhance Fastcapa to Support
Intel X520
    > > >> > (nickwallen)
    > > >> >     > closes
    > > >> >     >     > > apache/metron#608
    > > >> >     >     > >     METRON-1012 Update Metron public web
site for
    > 0.4.0
    > > >> > release
    > > >> >     >     > > (mattf-horton) closes apache/metron#629
    > > >> >     >     > >     METRON-1014 StellarShell class name
typo
    > > (mattf-horton)
    > > >> > closes
    > > >> >     >     > > apache/metron#630
    > > >> >     >     > >     METRON-990 Clean up and organize flux
properties
    > > >> > (merrimanr)
    > > >> >     > closes
    > > >> >     >     > > apache/metron#613
    > > >> >     >     > >     METRON-508 Expand Elasticsearch templates
to
    > support
    > > >> the
    > > >> >     > standard bro
    > > >> >     >     > > logs (JonZeolla) closes apache/metron#586
    > > >> >     >     > >     METRON-1007 Ship the metron-management
jar as part
    > > of
    > > >> > the mpack
    > > >> >     >     > > install (ottobackwards) closes apache/metron#627
    > > >> >     >     > >     METRON-877 Extract core implementation
and UDF
    > > support,
    > > >> > create
    > > >> >     >     > > metron-stellar module (mattf-horton) closes
    > > >> apache/metron#616
    > > >> >     >     > >     METRON-1004 Travis CI - Job Exceeded
Maximum Time
    > > Limit
    > > >> >     > (justinleet)
    > > >> >     >     > > closes apache/metron#624
    > > >> >     >     > >     METRON-999 Add virtualization support
checks to
    > > >> >     > platform-info.sh
    > > >> >     >     > > (JonZeolla via jonzeolla) closes apache/metron#618
    > > >> >     >     > >
    > > >> >     >     > >
    > > >> >     >     > >
    > > >> >     >     > >
    > > >> >     >     > >
    > > >> >     >     >
    > > >> >     >
    > > >> >     >
    > > >> >     >
    > > >> >     >
    > > >> >
    > > >> >
    > > >> >
    > > >> >
    > > >>
    > >
    > --
    >
    > Jon
    >
    

Mime
View raw message