drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arina Yelchiyeva <arina.yelchiy...@gmail.com>
Subject Re: [DISCUSS] Drill 1.12.0 release
Date Sat, 25 Nov 2017 13:56:18 GMT
Current status:

DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
reviewer - Paul) - needs to squash the commits.
DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna, code
reviewer - Paul) - needs to address some code review comments.

Kind regards
Arina

On Wed, Nov 15, 2017 at 2:38 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:

> Current status, we are close to the code freeze which will happen not
> later then the end of the next week.
>
> Blocker:
> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad R., code
> reviewer - Arina) - in progress.
>
> Targeted for 1.12 release:
> DRILL-4779: Kafka storage plugin support (developer - Anil & Kamesh, code
> reviewer - Paul) - needs next round of code review.
> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for PLAIN
> mechanism (developer - Sorabh, code reviewer - Parth & Laurent) - waiting
> for Parth code review.
> DRILL-5771: Fix serDe errors for format plugins (developer - Arina, code
> reviewer - Tim) - code review is done, waiting for the merge.
>
> Kind regards
>
> On Fri, Nov 10, 2017 at 9:32 AM, Chunhui Shi <cshi@mapr.com> wrote:
>
>> Hi Arina,
>>
>>
>> Could we consider to include DRILL-5089 in 1.12.0? It is about lazy
>> loading schema for storage plugins. Could you or Paul take a look at the
>> pull request for this JIRA https://github.com/apache/drill/pull/1032? I
>> think both of you are familiar with this part.
>>
>>
>> Thanks,
>>
>>
>> Chunhui
>>
>> ________________________________
>> From: Arina Yelchiyeva <arina.yelchiyeva@gmail.com>
>> Sent: Thursday, November 9, 2017 8:11:35 AM
>> To: dev@drill.apache.org
>> Subject: Re: [DISCUSS] Drill 1.12.0 release
>>
>> Yes, they are already in master.
>>
>> On Thu, Nov 9, 2017 at 6:05 PM, Charles Givre <cgivre@gmail.com> wrote:
>>
>> > We’re including the Networking functions in this release right?
>> >
>> > > On Nov 9, 2017, at 11:04, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com>
>> > wrote:
>> > >
>> > > If changes will be done before cut off date, targeting mid November
>> that
>> > it
>> > > will be possible to include this Jira.
>> > >
>> > > On Thu, Nov 9, 2017 at 6:03 PM, Charles Givre <cgivre@gmail.com>
>> wrote:
>> > >
>> > >> Hi Arina,
>> > >> Can we include DRILL-4091 Support for additional GIS operations in
>> > version
>> > >> 1.12?  In general the code looked pretty good.  There was a unit test
>> > >> missing which the developer submitted and some minor formatting
>> issues
>> > >> which I’m still waiting on.
>> > >> Thanks,
>> > >> —C
>> > >>
>> > >>
>> > >>
>> > >>> On Nov 9, 2017, at 10:58, Arina Yelchiyeva <
>> arina.yelchiyeva@gmail.com
>> > >
>> > >> wrote:
>> > >>>
>> > >>> Current status:
>> > >>>
>> > >>> Blocker:
>> > >>> DRILL-5917: Ban org.json:json library in Drill (developer - Vlad
R.,
>> > code
>> > >>> reviewer - ?) - in progress.
>> > >>>
>> > >>> Targeted for 1.12 release:
>> > >>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy & Vlad S.,
code
>> > >> reviewer -
>> > >>> Arina) - code review in final stage.
>> > >>> DRILL-4779: Kafka storage plugin support (developer - Anil &
Kamesh,
>> > code
>> > >>> reviewer - Paul) - in review.
>> > >>> DRILL-5943: Avoid the strong check introduced by DRILL-5582 for
>> PLAIN
>> > >>> mechanism (developer - Sorabh, code reviewer - Parth & Laurent)
-
>> > waiting
>> > >>> for the code review.
>> > >>> DRILL-5771: Fix serDe errors for format plugins (developer - Arina,
>> > code
>> > >>> reviewer - Tim) - waiting for the code review.
>> > >>>
>> > >>> Kind regards
>> > >>> Arina
>> > >>>
>> > >>> On Fri, Oct 20, 2017 at 1:49 PM, Arina Yelchiyeva <
>> > >>> arina.yelchiyeva@gmail.com> wrote:
>> > >>>
>> > >>>> Current status:
>> > >>>>
>> > >>>> Targeted for 1.12 release:
>> > >>>> DRILL-5832: Migrate OperatorFixture to use SystemOptionManager
>> rather
>> > >> than
>> > >>>> mock (developer - Paul, code reviewer - ?) - waiting for the
code
>> > review
>> > >>>> DRILL-5842: Refactor and simplify the fragment, operator contexts
>> for
>> > >>>> testing (developer - Paul, code reviewer - ?) - waiting for
the
>> code
>> > >>>> review
>> > >>>> DRILL-5834: Adding network functions (developer - Charles,
code
>> > reviewer
>> > >>>> - Arina) - waiting changes after code review
>> > >>>> DRILL-5337: OpenTSDB plugin (developer - Dmitriy, code reviewer
-
>> > >> Arina) - waiting
>> > >>>> for the code review
>> > >>>> DRILL-5772: Enable UTF-8 support in query string by default
>> > (developer -
>> > >>>> Arina, code reviewer - Paul) - finalizing approach
>> > >>>> DRILL-4779: Kafka storage plugin support (developer - Anil,
code
>> > >> reviewer
>> > >>>> - ?) - finishing implementation
>> > >>>>
>> > >>>> Under question:
>> > >>>> DRILL-4286: Graceful shutdown of drillbit (developer - Jyothsna,
>> code
>> > >>>> reviewer - ?) - waiting for the status update from the developer
>> > >>>>
>> > >>>> Please free to suggest other items that are targeted for 1.12
>> release.
>> > >>>> There are many Jiras that have fix version marked as 1.12,
it
>> would be
>> > >> good
>> > >>>> if developers revisit them and update fix version to the actual
>> one.
>> > >>>> Link to the dashboard - https://issues.apache.org/
>> > >>>> jira/secure/RapidBoard.jspa?rapidView=185&projectKey=
>> > DRILL&view=detail
>> > >>>>
>> > >>>> Kind regards
>> > >>>> Arina
>> > >>>>
>> > >>>>
>> > >>>> On Wed, Oct 11, 2017 at 2:42 AM, Parth Chandra <parthc@apache.org>
>> > >> wrote:
>> > >>>>
>> > >>>>> I'm waiting to merge the SSL  changes in. Waiting a couple
of days
>> > >> more to
>> > >>>>> see if there are any more comments before I merge the changes
in.
>> > >>>>>
>> > >>>>> On Mon, Oct 9, 2017 at 10:28 AM, Paul Rogers <progers@mapr.com>
>> > wrote:
>> > >>>>>
>> > >>>>>> Hi Arina,
>> > >>>>>>
>> > >>>>>> In addition to my own PRs, there are several in the
“active”
>> queue
>> > >> that
>> > >>>>> we
>> > >>>>>> could get in if we can just push them over the line
and clear the
>> > >> queue.
>> > >>>>>> The owners of the PRs should check if we are waiting
on them to
>> take
>> > >>>>> action.
>> > >>>>>>
>> > >>>>>> 977     DRILL-5849: Add freemarker lib to dependencyManagement
to
>> > >> ensure
>> > >>>>>> prop…
>> > >>>>>> 976     DRILL-5797: Choose parquet reader from read
columns
>> > >>>>>> 975     DRILL-5743: Handling column family and column
scan for
>> hbase
>> > >>>>>> 973     DRILL-5775: Select * query on a maprdb binary
table fails
>> > >>>>>> 972     DRILL-5838: Fix MaprDB filter pushdown for
the case of
>> > nested
>> > >>>>>> field (reg. of DRILL-4264)
>> > >>>>>> 950     Drill 5431: SSL Support
>> > >>>>>> 949     DRILL-5795: Parquet Filter push down at rowgroup
level
>> > >>>>>> 936     DRILL-5772: Add unit tests to indicate how
utf-8 support
>> can
>> > >> be
>> > >>>>>> enabled / disabled in Drill
>> > >>>>>> 904     DRILL-5717: change some date time test cases
with
>> specific
>> > >>>>>> timezone or Local
>> > >>>>>> 892     DRILL-5645: negation of expression causes null
pointer
>> > >> exception
>> > >>>>>> 889     DRILL-5691: enhance scalar sub queries checking
for the
>> > >>>>> cartesian
>> > >>>>>> join
>> > >>>>>>
>> > >>>>>> (Items not on the list above have become “inactive”
for a
>> variety of
>> > >>>>>> reasons.)
>> > >>>>>>
>> > >>>>>> Thanks,
>> > >>>>>>
>> > >>>>>> - Paul
>> > >>>>>>
>> > >>>>>>> On Oct 9, 2017, at 9:57 AM, Paul Rogers <progers@mapr.com>
>> wrote:
>> > >>>>>>>
>> > >>>>>>> Hi Arina,
>> > >>>>>>>
>> > >>>>>>> I’d like to include the following that are needed
to finish up
>> the
>> > >>>>>> “managed” sort and spill-to-disk for hash agg:
>> > >>>>>>>
>> > >>>>>>> #928: DRILL-5716: Queue-driven memory allocation
>> > >>>>>>> #958, DRILL-5808: Reduce memory allocator strictness
for
>> "managed"
>> > >>>>>> operators
>> > >>>>>>> #960, DRILL-5815: Option to set query memory as
percent of total
>> > >>>>>>>
>> > >>>>>>> The following is needed to resolve issues with
HBase support in
>> > empty
>> > >>>>>> batches:
>> > >>>>>>>
>> > >>>>>>> #968, DRILL-5830: Resolve regressions to MapR DB
from DRILL-5546
>> > >>>>>>>
>> > >>>>>>> The following are nice-to-haves that build on work
already done
>> in
>> > >>>>> this
>> > >>>>>> release, and that some of my own work depends on:
>> > >>>>>>>
>> > >>>>>>> #970, DRILL-5832: Migrate OperatorFixture to use
>> > SystemOptionManager
>> > >>>>>> rather than mock
>> > >>>>>>> #978: DRILL-5842: Refactor and simplify the fragment,
operator
>> > >>>>> contexts
>> > >>>>>> for testing
>> > >>>>>>>
>> > >>>>>>> The following is not needed for 1.12 per-se, but
is the
>> foundation
>> > >>>>> for a
>> > >>>>>> project I’m working on; would be good to get this
in after 2-3
>> > months
>> > >> of
>> > >>>>>> review time:
>> > >>>>>>>
>> > >>>>>>> #921, foundation for batch size limitation
>> > >>>>>>>
>> > >>>>>>> The key issue with each of the above is that they
each need a
>> > >>>>> committer
>> > >>>>>> to review. Some have reviews from non-committers. Any
volunteers?
>> > >>>>>>>
>> > >>>>>>> Thanks,
>> > >>>>>>>
>> > >>>>>>> - Paul
>> > >>>>>>>
>> > >>>>>>>> On Oct 9, 2017, at 9:38 AM, Charles Givre <cgivre@gmail.com>
>> > wrote:
>> > >>>>>>>>
>> > >>>>>>>> Hi Arina,
>> > >>>>>>>> I’d like to include Drill-5834, Adding network
functions.
>> > >>>>>>>> https://github.com/apache/drill/pull/971 <
>> > >> https://github.com/apache/
>> > >>>>>> drill/pull/971>
>> > >>>>>>>>
>> > >>>>>>>> Hopefully I didn’t violate too many coding
standards this time
>> ;-)
>> > >>>>>>>> —C
>> > >>>>>>>>
>> > >>>>>>>>> On Oct 9, 2017, at 9:09 AM, Arina Yelchiyeva
<
>> > >>>>>> arina.yelchiyeva@gmail.com> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>> I want to include DRILL-5337 (OpenTSDB
plugin), I'll try to
>> > finish
>> > >>>>> code
>> > >>>>>>>>> review during this week.
>> > >>>>>>>>>
>> > >>>>>>>>> Kind regards
>> > >>>>>>>>> Arina
>> > >>>>>>>>>
>> > >>>>>>>>> On Mon, Oct 9, 2017 at 4:08 PM, Arina Ielchiieva
<
>> > arina@apache.org
>> > >>>
>> > >>>>>> wrote:
>> > >>>>>>>>>
>> > >>>>>>>>>> Hi Drillers,
>> > >>>>>>>>>>
>> > >>>>>>>>>> It's been several months since the
last release and it is
>> time
>> > to
>> > >>>>> do
>> > >>>>>> the
>> > >>>>>>>>>> next one. I am volunteering to be the
release manager.
>> > >>>>>>>>>>
>> > >>>>>>>>>> If there are any issues on which work
is in progress, that
>> you
>> > >>>>> feel we
>> > >>>>>>>>>> *must* include in the release, please
post in reply to this
>> > >> thread.
>> > >>>>>> Based
>> > >>>>>>>>>> on your input we'll define release
cut off date.
>> > >>>>>>>>>>
>> > >>>>>>>>>> Kind regards
>> > >>>>>>>>>> Arina
>> > >>>>>>>>>>
>> > >>>>>>>>
>> > >>>>>>>
>> > >>>>>>
>> > >>>>>>
>> > >>>>>
>> > >>>>
>> > >>>>
>> > >>
>> > >>
>> >
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message