beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ianzhou1 <>
Subject [GitHub] incubator-beam pull request #440: [BEAM-???] Modify range tracker to use fir...
Date Thu, 09 Jun 2016 17:52:57 GMT
GitHub user ianzhou1 opened a pull request:

    [BEAM-???] Modify range tracker to use first response as start key

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull beam

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #440
commit 5e1fc31c5b666ca50105a5588f7f7f68c6f527b7
Author: Aljoscha Krettek <>
Date:   2016-05-18T15:46:34Z

    [BEAM-295] Remove erroneous close() calls in Flink Create Sources
    Collector.close() should only be called by internal Flink components,
    not by user functions.

commit c20c9ef6b978bda01c7358c9674ba3e4f11dd3c5
Author: Mark Shields <>
Date:   2016-05-31T21:44:20Z

    Forward port changes to GC holds
    Forward port changes to BEAM/pull/391 from DataflowJavaSDK/pull/289.

commit af794e1afe8f2b22432e7e0285a45f157bdac969
Author: Jean-Baptiste Onofré <>
Date:   2016-05-31T19:46:46Z

    [BEAM-242] Set javadoc less strict around missing return or param statements

commit df0633d7b5105206928d7d30ccf62410388e46a3
Author: Davor Bonaci <>
Date:   2016-06-01T20:13:02Z

    Update pom.xml files formatting
    This makes it easier to run maven-release-plugin and understand the output. Otherwise,
the release plugin will make such changes repeatedly in a release branch.

commit 06690614e58dfae6f9509dd01cf69df59bd94f36
Author: Davor Bonaci <>
Date:   2016-06-01T21:14:08Z

    [maven-release-plugin] prepare branch release-0.1.0-incubating

commit f8cbd4d78c9b6aced6ad1375684b60707ce1c6e9
Author: Thomas Groh <>
Date:   2016-06-01T21:28:18Z

    Use Structural Value keys instead of User Values
    This fixes problems with lookup by basing entirely on structural

commit 1f3dfa288f526335f52cbce9c36f9e3dd28541ff
Author: Davor Bonaci <>
Date:   2016-06-01T22:21:41Z

    [maven-release-plugin] prepare for next development iteration

commit 5c6e980098486f404df87ff080184c0ede521671
Author: JianfengQian <>
Date:   2016-05-21T10:32:29Z

    [BEAM-297] Update Flink to  0.2.0-incubating-SNAPSHOT

commit 801f2d7768aba2efc12b14ff6f0d9716ed2ed1b0
Author: Thomas Groh <>
Date:   2016-05-30T18:04:15Z

    Return from awaitCompletion if Already Done
    This ensures that a call to ExecutorService#awaitCompletion returns immediately
    if there are no visible updates and the executor has completed. If the executor is
    in this state, no additional visible updates will be published and the call will hang.
    This sequence generally will not happen, as calls via InProcessPipelineResult
    return if the state is already terminal, but this ensures that parallel calls to
    awaitCompletion do not hang one calling thread.

commit 8524c745eefec73c734c336cd44db18649d53f9b
Author: Davor Bonaci <>
Date:   2016-06-02T20:21:31Z

    Remove reporting section from Spark's pom.xml file
    This is currently triggering Maven warnings, due to a missing version qualifier. However,
we don't run 'site', so this isn't being used at this point. Hence, removing instead of adding
the version qualifier.

commit 74ba140139b4df97182e4b4bece2a75a09fc5824
Author: Davor Bonaci <>
Date:   2016-06-02T22:09:53Z

    Move 'travis/' directory into 'testing/travis/'

commit a9fbba9fabf1897b35ad23573f4e276b22f09a6e
Author: Jean-Baptiste Onofré <>
Date:   2016-06-03T11:05:58Z

    [BEAM-319][BEAM-320] Add distributions module responsible of packaging source and binaries

commit d2172de8d8f320837fb80a7ea101bf16c8accbe5
Author: Jean-Baptiste Onofré <>
Date:   2016-06-03T11:55:37Z

    Use zip source distribution only (tar.gz doesn't work on Jenkins due to UTF-8 encoding
and long path name)

commit 459ecf7ae2e3c643e9ee96111b55acfe4c848f13
Author: Raghu Angadi <>
Date:   2016-06-04T00:46:38Z

    squash PR 271

commit d5ac610220dfb0ea027d1a0be1384f4742b24f2e
Author: Kenneth Knowles <>
Date:   2016-06-06T20:07:35Z

    Fix validation in PubsubIO

commit f043b488e27a823943d52014497bdc0828ac4cf1
Author: Dan Halperin <>
Date:   2016-06-07T04:46:37Z

    [BEAM-292] Write: always produce at least 1 WriteT
    Write has a degenerate case wherein, if no elements were in the written PCollection,
    the finalize step will get produced with nothing to finalize. This often prevents
    correct operation, for example when a FileBasedSink produces no files instead of one
    empty file.
    Catch and handle this case in Write by opening and closing an empty
    Writer to produce a single WriteT.

commit a0257e16fae22f846d6f234a563a0ed62670eab8
Author: Davor Bonaci <>
Date:   2016-06-06T20:27:50Z

    [BEAM-287] Use flat groupId structure and full qualified artifactIds

commit 51ee1e8a043cbb59b41d97f400384f8154beee10
Author: Davor Bonaci <>
Date:   2016-06-07T17:36:42Z

    Add Xdoclint:missing to the Kafka connector
    This makes the Javadoc build actually pass.

commit 8388c2d31f90964ad3c8f37c257262787331d259
Author: Davor Bonaci <>
Date:   2016-06-07T17:38:20Z

    Update Flink's pom.xml
    Remove unnecessary version specifier.

commit aa980e701656e2aa7adf2c2510efc3aa6a8b665d
Author: Pei He <>
Date:   2016-05-21T00:16:58Z

    [BEAM-48] Code cleanup in BigQueryIO
    1. Use toJsonString() to avoid try catch
    2. add getTableWithDefaultProject in BigQuery.Write

commit 4dc0f59d3bb89e153cf0aecda7d502566c784bd7
Author: Thomas Groh <>
Date:   2016-05-25T01:05:16Z

    Relocate Immutability Enforcement Tests
    These tests are of runner behavior rather than the model, and should be
    tested as a runner test.
    Stop wrapping IllegalMutationExceptions to surface failures due to
    model invariant violations directly, rather than going through a

commit c4867a00cd7e8d65ae6bf376858493b039a546da
Author: Thomas Groh <>
Date:   2016-06-01T00:09:19Z

    Remove DirectRunner implementations from DoFnTester
    Part of the removal of runners-core from the Core SDK, and the deletion
    of the DirectRunner from the core SDK.

commit 8a6e40430c55f3a7f1004a404bc3914204f17a29
Author: Maximilian Michels <>
Date:   2016-06-03T09:13:45Z

    [BEAM-287] adjust README to changed Maven layout

commit 39e8a3dc80a5cab3d1878ec2b0b5817de5eda0a0
Author: Thomas Groh <>
Date:   2016-06-04T00:57:24Z

    Remove Unnecessary Fn cloning
    The ParDoInProcessEvaluator is provided clones of a DoFn when
    appropriate, and should not serialize them.

commit f5410c4568e388bfcbf7b2037c8fb39edf918d4d
Author: Thomas Groh <>
Date:   2016-06-06T18:52:58Z

    Allow DoFns to be Reused
    Modify the documentation of ParDo to allow DoFns to be reused for
    multiple bundles in the general case. This allows DoFns which implement
    start and finish bundle to be reused.
    Update ParDoTest.TestDoFn to succeed if reused.

commit 49cbd0e7ea50c0ddc059168896a6a00d149bfaa2
Author: Maximilian Michels <>
Date:   2016-06-06T10:40:50Z

    [flink] improve lifecycle of ParDoBoundWrapper

commit 997d78527927e9f1425ee3e97e0685407bd7dbfb
Author: Raghu Angadi <>
Date:   2016-06-07T16:55:34Z

    KafkaIO javadoc update

commit b98eb2ec7b099953935a6ce25b20576939cdbd5b
Author: Maximilian Michels <>
Date:   2016-06-07T11:57:33Z

    [BEAM-196] provide PipelineOptions in DoFn
    - fixes NPE when accessing the PipelineOptions
    - adds a test to verify that the PipelineOptions are available

commit fec936f3b44ab95fddd75bab1acd0bbd65914c1d
Author: Thomas Groh <>
Date:   2016-06-07T21:52:20Z

    Reset Writer in WriteBundles.finishBundle
    This allows the WriteBundles DoFn to be reused.

commit 5abc869eaf47593766609ad46f3dd123c6dba137
Author: Davor Bonaci <>
Date:   2016-06-07T23:12:39Z

    Flink: move plugin invocation to each child module
    Specifying module invocation in the parent pom.xml file, causes
    the release process to produce empty files for the parent pom.


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

View raw message