drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arina Yelchiyeva <arina.yelchiy...@gmail.com>
Subject Re: [DISCUSS] Drill 1.12.0 release
Date Wed, 29 Nov 2017 11:21:52 GMT
All pending Jiras are merged. Starting release candidate preparation.

*Note for the committers:*
*until the release is not over and Drill version is not changed to
1.13.0-SNAPSHOT, please do not push any changes into Drill master. *

Kind regards
Arina

On Mon, Nov 27, 2017 at 6:52 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status:
>
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - fix is expected by the EOD in new pull request.
> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
> reviewer - Paul) - unit test failures are fixed. Unit test performance
> degraded x3 times!
>
> Kind regards
>
> On Sun, Nov 26, 2017 at 6:15 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
>> Current status:
>>
>> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
>> reviewer - Paul) - could not cherry-pick the commits. Needs fix.
>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>> reviewer - Paul) - there are unit test failures. Needs fix.
>>
>> Kind regards
>>
>> On Sat, Nov 25, 2017 at 11:53 PM, AnilKumar B <akumarb2010@gmail.com>
>> wrote:
>>
>>> Hi Arina,
>>>
>>> Sorry for the delay. Just now we squashed Kafka storage plugin commits
>>> into
>>> one commit and pushed.
>>>
>>> Thanks & Regards,
>>> B Anil Kumar.
>>>
>>> On Sat, Nov 25, 2017 at 5:56 AM, Arina Yelchiyeva <
>>> arina.yelchiyeva@gmail.com> wrote:
>>>
>>> > Current status:
>>> >
>>> > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>>> code
>>> > reviewer - Paul) - needs to squash the commits.
>>> > DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
>>> > reviewer - Paul) - needs to address some code review comments.
>>> >
>>> > Kind regards
>>> > Arina
>>> >
>>> > On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
>>> > arina.yelchiyeva@gmail.com> wrote:
>>> >
>>> > > Current status, we are close to the code freeze which will happen not
>>> > > later then the end of the next week.
>>> > >
>>> > > Blocker:
>>> > > DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R.,
>>> code
>>> > > reviewer - Arina) - in progress.
>>> > >
>>> > > Targeted for 1.12 release:
>>> > > DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh,
>>> code
>>> > > reviewer - Paul) - needs next round of code review.
>>> > > DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
>>> > > mechanism (developer - Sorabh, code reviewer - Parth & Laurent)
-
>>> waiting
>>> > > for Parth code review.
>>> > > DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>>> code
>>> > > reviewer - Tim) - code review is done, waiting for the merge.
>>> > >
>>> > > Kind regards
>>> > >
>>> > > On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cshi@mapr.com>
wrote:
>>> > >
>>> > >> Hi Arina,
>>> > >>
>>> > >>
>>> > >> Could we consider to include DRILL-5089 in 1.12.0? It is about
lazy
>>> > >> loading schema for storage plugins. Could you or Paul take a look
>>> at the
>>> > >> pull request for this JIRA https://github.com/apache/dril
>>> l/pull/1032? I
>>> > >> think both of you are familiar with this part.
>>> > >>
>>> > >>
>>> > >> Thanks,
>>> > >>
>>> > >>
>>> > >> Chunhui
>>> > >>
>>> > >> ________________________________
>>> > >> From: Arina Yelchiyeva <arina.yelchiyeva@gmail.com>
>>> > >> Sent: Thursday, November 9, 2017 8:11:35 AM
>>> > >> To: dev@drill.apache.org
>>> > >> Subject: Re: [DISCUSS] Drill 1.12.0 release
>>> > >>
>>> > >> Yes, they are already in master.
>>> > >>
>>> > >> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cgivre@gmail.com>
>>> wrote:
>>> > >>
>>> > >> > We’re including the Networking functions in this release
right?
>>> > >> >
>>> > >> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>>> > >> arina.yelchiyeva@gmail.com>
>>> > >> > wrote:
>>> > >> > >
>>> > >> > > If changes will be done before cut off date, targeting
mid
>>> November
>>> > >> that
>>> > >> > it
>>> > >> > > will be possible to include this Jira.
>>> > >> > >
>>> > >> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cgivre@gmail.com
>>> >
>>> > >> wrote:
>>> > >> > >
>>> > >> > >> Hi Arina,
>>> > >> > >> Can we include DRILL-4091 Support for additional
GIS
>>> operations in
>>> > >> > version
>>> > >> > >> 1.12?  In general the code looked pretty good.  There
was a
>>> unit
>>> > test
>>> > >> > >> missing which the developer submitted and some minor
formatting
>>> > >> issues
>>> > >> > >> which I’m still waiting on.
>>> > >> > >> Thanks,
>>> > >> > >> —C
>>> > >> > >>
>>> > >> > >>
>>> > >> > >>
>>> > >> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>>> > >> arina.yelchiyeva@gmail.com
>>> > >> > >
>>> > >> > >> wrote:
>>> > >> > >>>
>>> > >> > >>> Current status:
>>> > >> > >>>
>>> > >> > >>> Blocker:
>>> > >> > >>> DRILL-5917: Ban org.json:json library in Drill
(developer -
>>> Vlad
>>> > R.,
>>> > >> > code
>>> > >> > >>> reviewer - ?) - in progress.
>>> > >> > >>>
>>> > >> > >>> Targeted for 1.12 release:
>>> > >> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy
& Vlad S.,
>>> code
>>> > >> > >> reviewer -
>>> > >> > >>> Arina) - code review in final stage.
>>> > >> > >>> DRILL-4779: Kafka storage plugin support (developer
- Anil &
>>> > Kamesh,
>>> > >> > code
>>> > >> > >>> reviewer - Paul) - in review.
>>> > >> > >>> DRILL-5943: Avoid the strong check introduced
by DRILL-5582
>>> for
>>> > >> PLAIN
>>> > >> > >>> mechanism (developer - Sorabh, code reviewer
- Parth &
>>> Laurent) -
>>> > >> > waiting
>>> > >> > >>> for the code review.
>>> > >> > >>> DRILL-5771: Fix serDe errors for format plugins
(developer -
>>> > Arina,
>>> > >> > code
>>> > >> > >>> reviewer - Tim) - waiting for the code review.
>>> > >> > >>>
>>> > >> > >>> Kind regards
>>> > >> > >>> Arina
>>> > >> > >>>
>>> > >> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva
<
>>> > >> > >>> arina.yelchiyeva@gmail.com> wrote:
>>> > >> > >>>
>>> > >> > >>>> Current status:
>>> > >> > >>>>
>>> > >> > >>>> Targeted for 1.12 release:
>>> > >> > >>>> DRILL-5832: Migrate OperatorFixture to use
>>> SystemOptionManager
>>> > >> rather
>>> > >> > >> than
>>> > >> > >>>> mock (developer - Paul, code reviewer - ?)
- waiting for the
>>> code
>>> > >> > review
>>> > >> > >>>> DRILL-5842: Refactor and simplify the fragment,
operator
>>> contexts
>>> > >> for
>>> > >> > >>>> testing (developer - Paul, code reviewer
- ?) - waiting for
>>> the
>>> > >> code
>>> > >> > >>>> review
>>> > >> > >>>> DRILL-5834: Adding network functions (developer
- Charles,
>>> code
>>> > >> > reviewer
>>> > >> > >>>> - Arina) - waiting changes after code review
>>> > >> > >>>> DRILL-5337: OpenTSDB plugin (developer -
Dmitriy, code
>>> reviewer -
>>> > >> > >> Arina) - waiting
>>> > >> > >>>> for the code review
>>> > >> > >>>> DRILL-5772: Enable UTF-8 support in query
string by default
>>> > >> > (developer -
>>> > >> > >>>> Arina, code reviewer - Paul) - finalizing
approach
>>> > >> > >>>> DRILL-4779: Kafka storage plugin support
(developer - Anil,
>>> code
>>> > >> > >> reviewer
>>> > >> > >>>> - ?) - finishing implementation
>>> > >> > >>>>
>>> > >> > >>>> Under question:
>>> > >> > >>>> DRILL-4286: Graceful shutdown of drillbit
(developer -
>>> Jyothsna,
>>> > >> code
>>> > >> > >>>> reviewer - ?) - waiting for the status update
from the
>>> developer
>>> > >> > >>>>
>>> > >> > >>>> Please free to suggest other items that are
targeted for 1.12
>>> > >> release.
>>> > >> > >>>> There are many Jiras that have fix version
marked as 1.12, it
>>> > >> would be
>>> > >> > >> good
>>> > >> > >>>> if developers revisit them and update fix
version to the
>>> actual
>>> > >> one.
>>> > >> > >>>> Link to the dashboard - https://issues.apache.org/
>>> > >> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>>> > >> > DRILL&view=detail
>>> > >> > >>>>
>>> > >> > >>>> Kind regards
>>> > >> > >>>> Arina
>>> > >> > >>>>
>>> > >> > >>>>
>>> > >> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra
<
>>> > parthc@apache.org>
>>> > >> > >> wrote:
>>> > >> > >>>>
>>> > >> > >>>>> I'm waiting to merge the SSL  changes
in. Waiting a couple
>>> of
>>> > days
>>> > >> > >> more to
>>> > >> > >>>>> see if there are any more comments before
I merge the
>>> changes
>>> > in.
>>> > >> > >>>>>
>>> > >> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul
Rogers <
>>> progers@mapr.com>
>>> > >> > wrote:
>>> > >> > >>>>>
>>> > >> > >>>>>> Hi Arina,
>>> > >> > >>>>>>
>>> > >> > >>>>>> In addition to my own PRs, there
are several in the
>>> “active”
>>> > >> queue
>>> > >> > >> that
>>> > >> > >>>>> we
>>> > >> > >>>>>> could get in if we can just push
them over the line and
>>> clear
>>> > the
>>> > >> > >> queue.
>>> > >> > >>>>>> The owners of the PRs should check
if we are waiting on
>>> them to
>>> > >> take
>>> > >> > >>>>> action.
>>> > >> > >>>>>>
>>> > >> > >>>>>> 977     DRILL-5849: Add freemarker
lib to
>>> dependencyManagement
>>> > to
>>> > >> > >> ensure
>>> > >> > >>>>>> prop…
>>> > >> > >>>>>> 976     DRILL-5797: Choose parquet
reader from read columns
>>> > >> > >>>>>> 975     DRILL-5743: Handling column
family and column scan
>>> for
>>> > >> hbase
>>> > >> > >>>>>> 973     DRILL-5775: Select * query
on a maprdb binary table
>>> > fails
>>> > >> > >>>>>> 972     DRILL-5838: Fix MaprDB filter
pushdown for the
>>> case of
>>> > >> > nested
>>> > >> > >>>>>> field (reg. of DRILL-4264)
>>> > >> > >>>>>> 950     Drill 5431: SSL Support
>>> > >> > >>>>>> 949     DRILL-5795: Parquet Filter
push down at rowgroup
>>> level
>>> > >> > >>>>>> 936     DRILL-5772: Add unit tests
to indicate how utf-8
>>> > support
>>> > >> can
>>> > >> > >> be
>>> > >> > >>>>>> enabled / disabled in Drill
>>> > >> > >>>>>> 904     DRILL-5717: change some date
time test cases with
>>> > >> specific
>>> > >> > >>>>>> timezone or Local
>>> > >> > >>>>>> 892     DRILL-5645: negation of expression
causes null
>>> pointer
>>> > >> > >> exception
>>> > >> > >>>>>> 889     DRILL-5691: enhance scalar
sub queries checking
>>> for the
>>> > >> > >>>>> cartesian
>>> > >> > >>>>>> join
>>> > >> > >>>>>>
>>> > >> > >>>>>> (Items not on the list above have
become “inactive” for a
>>> > >> variety of
>>> > >> > >>>>>> reasons.)
>>> > >> > >>>>>>
>>> > >> > >>>>>> Thanks,
>>> > >> > >>>>>>
>>> > >> > >>>>>> - Paul
>>> > >> > >>>>>>
>>> > >> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul
Rogers <progers@mapr.com
>>> >
>>> > >> wrote:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> Hi Arina,
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> I’d like to include the following
that are needed to
>>> finish up
>>> > >> the
>>> > >> > >>>>>> “managed” sort and spill-to-disk
for hash agg:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #928: DRILL-5716: Queue-driven
memory allocation
>>> > >> > >>>>>>> #958, DRILL-5808: Reduce memory
allocator strictness for
>>> > >> "managed"
>>> > >> > >>>>>> operators
>>> > >> > >>>>>>> #960, DRILL-5815: Option to set
query memory as percent of
>>> > total
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following is needed to resolve
issues with HBase
>>> support
>>> > in
>>> > >> > empty
>>> > >> > >>>>>> batches:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #968, DRILL-5830: Resolve regressions
to MapR DB from
>>> > DRILL-5546
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following are nice-to-haves
that build on work already
>>> > done
>>> > >> in
>>> > >> > >>>>> this
>>> > >> > >>>>>> release, and that some of my own
work depends on:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture
to use
>>> > >> > SystemOptionManager
>>> > >> > >>>>>> rather than mock
>>> > >> > >>>>>>> #978: DRILL-5842: Refactor and
simplify the fragment,
>>> operator
>>> > >> > >>>>> contexts
>>> > >> > >>>>>> for testing
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The following is not needed for
1.12 per-se, but is the
>>> > >> foundation
>>> > >> > >>>>> for a
>>> > >> > >>>>>> project I’m working on; would be
good to get this in after
>>> 2-3
>>> > >> > months
>>> > >> > >> of
>>> > >> > >>>>>> review time:
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> #921, foundation for batch size
limitation
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> The key issue with each of the
above is that they each
>>> need a
>>> > >> > >>>>> committer
>>> > >> > >>>>>> to review. Some have reviews from
non-committers. Any
>>> > volunteers?
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> Thanks,
>>> > >> > >>>>>>>
>>> > >> > >>>>>>> - Paul
>>> > >> > >>>>>>>
>>> > >> > >>>>>>>> On Oct 9, 2017, at 9:38 AM,
Charles Givre <
>>> cgivre@gmail.com>
>>> > >> > wrote:
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>> Hi Arina,
>>> > >> > >>>>>>>> I’d like to include Drill-5834,
Adding network functions.
>>> > >> > >>>>>>>> https://github.com/apache/drill/pull/971
<
>>> > >> > >> https://github.com/apache/
>>> > >> > >>>>>> drill/pull/971>
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>> Hopefully I didn’t violate
too many coding standards this
>>> > time
>>> > >> ;-)
>>> > >> > >>>>>>>> —C
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>>> On Oct 9, 2017, at 9:09
AM, Arina Yelchiyeva <
>>> > >> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> I want to include DRILL-5337
(OpenTSDB plugin), I'll
>>> try to
>>> > >> > finish
>>> > >> > >>>>> code
>>> > >> > >>>>>>>>> review during this week.
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> Kind regards
>>> > >> > >>>>>>>>> Arina
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>> On Mon, Oct 9, 2017 at
4:08 PM, Arina Ielchiieva <
>>> > >> > arina@apache.org
>>> > >> > >>>
>>> > >> > >>>>>> wrote:
>>> > >> > >>>>>>>>>
>>> > >> > >>>>>>>>>> Hi Drillers,
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> It's been several
months since the last release and it
>>> is
>>> > >> time
>>> > >> > to
>>> > >> > >>>>> do
>>> > >> > >>>>>> the
>>> > >> > >>>>>>>>>> next one. I am volunteering
to be the release manager.
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> If there are any
issues on which work is in progress,
>>> that
>>> > >> you
>>> > >> > >>>>> feel we
>>> > >> > >>>>>>>>>> *must* include in
the release, please post in reply to
>>> this
>>> > >> > >> thread.
>>> > >> > >>>>>> Based
>>> > >> > >>>>>>>>>> on your input we'll
define release cut off date.
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>>> Kind regards
>>> > >> > >>>>>>>>>> Arina
>>> > >> > >>>>>>>>>>
>>> > >> > >>>>>>>>
>>> > >> > >>>>>>>
>>> > >> > >>>>>>
>>> > >> > >>>>>>
>>> > >> > >>>>>
>>> > >> > >>>>
>>> > >> > >>>>
>>> > >> > >>
>>> > >> > >>
>>> > >> >
>>> > >> >
>>> > >>
>>> > >
>>> > >
>>> >
>>>
>>
>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message