beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (BEAM-597) Provide type information from Coders
Date Sat, 17 Sep 2016 01:15:20 GMT


ASF GitHub Bot commented on BEAM-597:

GitHub user jeremiele opened a pull request:

    [BEAM-597] Added public where method to specify parameter types.

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](

You can merge this pull request into a Git repository by running:

    $ git pull add_where_to_type_descriptor

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #968
commit 9ab876f2a2d37ac0142103e1f3509a9bac900ad1
Author: Jeremie Lenfant-Engelmann <>
Date:   2016-08-17T22:52:50Z

    Added a where method on TypeDescriptor to allow substituting a type parameter
    with a TypeDescriptor. In the process introduced a TypeParameter class which
    represents the parameter type.
    This is useful when having a type such as Set<T> to be able to specify
    what T is as part of the TypeDescriptor information.

commit 6dd324ec418b1f9e8bc7c01ce4654b3309bedb30
Author: Aljoscha Krettek <>
Date:   2016-06-11T08:55:55Z

    Fix Emission in startBundle/finishBundle in Flink Wrappers

commit 42e9649e588cd1ad5cb004d61daca785beb39552
Author: Aljoscha Krettek <>
Date:   2016-06-11T09:42:12Z

    [BEAM-253] Unify Flink-Streaming Operator Wrappers
    This also replaces the custom Flink StateInternals by proper Flink
    Partitioned StateInternals.

commit eaba203c5fa283923150c692321350bd37aefa56
Author: Aljoscha Krettek <>
Date:   2016-07-10T15:01:38Z

    Fix Checkstyle Errors in FlinkStreamingTransformTranslators

commit f3f52b0500f59054c6b701bcd9b0a35e30e6d524
Author: Aljoscha Krettek <>
Date:   2016-07-11T12:08:35Z

    [BEAM-102] Add Side Inputs in Flink Streaming Runner
    This adds a generic SideInputHandler in runners-core that is only used
    by the Flink runner right now but can be used by other runner

commit 4c6e3a3b761d76e9a1b51be36ab47520ac93de9b
Author: Aljoscha Krettek <>
Date:   2016-07-23T08:48:42Z

    Allow DoFn Reuse in ParDoTest.TestDoFnWithContext

commit 1cfbaeec29b468a46f9b07ba6c7168fdd177352a
Author: Aljoscha Krettek <>
Date:   2016-07-24T10:04:28Z

    Don't Suppress Throwable in PAssert in Streaming Mode

commit c36e9bd8eb3d3a305d995b9982b872f356cf9618
Author: Aljoscha Krettek <>
Date:   2016-07-26T12:02:00Z

    Enable Flink Streaming Runner RunnableOnService tests

commit 17ee0a21e8751b6f8dc15966347db3a99ae5de72
Author: Thomas Groh <>
Date:   2016-07-27T16:04:06Z

    Fix combine tests with Accumulation Mode
    These tests were not written in such a way as to succeed if the trigger
    fired multiple times.

commit d9dc86e84bf096804c88381722069c21c734a78e
Author: Kenneth Knowles <>
Date:   2016-07-27T21:23:15Z

    Replace ParDo with simpler transforms where possible
    There are a number of places in the Java SDK where we use
    ParDo.of(DoFn) when MapElements or other higher-level
    composites are applicable and readable. This change
    alters a number of those.

commit 00f0ff732217ae0411be75e3cadd6ca2107c50de
Author: Thomas Groh <>
Date:   2016-07-28T15:26:43Z

    Use AllPanes as the PaneExtractor in IterableAssert
    This ensures that tests with triggering in the global window which assert
    on the entire PCollection (not a singleton iterable) will succeed over the
    entire PCollection

commit 491d1cb8b5de558e31184cf8c602a2065367ff06
Author: Thomas Groh <>
Date:   2016-08-11T22:46:10Z

    Add inEarlyPanesInGlobalWindow as a PAssert Extractor
    This is for use in asserting the contents of speculative panes in the
    global window.

commit bbdb1f04adfd3504c7544bb6e878cebfbf9ac362
Author: Dan Halperin <>
Date:   2016-08-15T06:08:21Z

    FileBasedSink: improve parallelism in GCS copy/remove

commit c87be95e9f30e84cd2f844ff288c0880e22c7221
Author: Pei He <>
Date:   2016-08-15T19:22:11Z

    Set Gcs upload buffer size to 1M in streaming mode in DataflowRunner

commit 18f80acf7b459ae74bb392060ff7e276d83aa2e8
Author: Vikas Kedigehalli <>
Date:   2016-08-15T22:28:07Z

    DatastoreIO Sink as ParDo

commit 75dd2761635584117a1db2d89824261d4a63d272
Author: Pei He <>
Date:   2016-08-16T00:23:20Z

    Fix NPE in BigQueryIO.TransformingReader

commit f527831924089962c16ad99c0673f99b244db0fc
Author: Thomas Groh <>
Date:   2016-08-16T02:43:28Z

    Add TestStream to the Testing package
    This is a source suitable for use with tests that have interesting
    triggering behavior. It is an Unbounded source that emits elements in
    bundles, and advances the watermark and processing time appropriately.

commit 2825cc1a7c9987bf21a9ffa6893e3351f9fc7c0a
Author: Thomas Groh <>
Date:   2016-08-16T02:45:58Z

    Implement TestStream in the DirectRunner

commit 6f2a384e562efcafd1a888c3c7151eb30a1ef677
Author: Frank Yellin <>
Date:   2016-08-16T21:40:41Z

    Change name of result returned by BigQueryIO.Read

commit 2fa01c7d4e7ff169f45553b273af2e89de922b69
Author: Pei He <>
Date:   2016-08-17T20:56:37Z

    addressed feedback

commit 88ac5b7fe57d5694b90762fe74a8fbf6946b7077
Author: Pei He <>
Date:   2016-08-17T21:30:23Z

    fix unused imports

commit 5f74ba2fbddb0830c66f441b3976ade852f19980
Author: Vikas Kedigehalli <>
Date:   2016-08-18T01:19:52Z

    Datastore Sink support for writing Mutations
    This generalizes Write to Write and Delete cleanly.

commit 263d9e03a9b3b3467e3ed6de205da92f6633abb7
Author: Luke Cwik <>
Date:   2016-08-18T23:35:33Z

    Modify example dependencies to only add runners as optional dependencies.
    Also support excluding runners by disabling the include-runners profile.
    Tested ITs
    BQ and WordCount pass on Dataflow
    WordCount passes on Flink and Spark

commit 38c30ce43053efa0d1e7868c5a3e67b6108d2a08
Author: sammcveety <>
Date:   2016-08-18T22:02:06Z

    Incorporate private IP option for Dataflow runner

commit edc0f790d4babc31da40f578a9afcfb92ec06547
Author: Thomas Groh <>
Date:   2016-08-19T17:24:00Z

    Mark JAXBContext as Volatile in JAXBCoder
    This corrects the double-checked locking and lazy intialization

commit 051848b694ed23442dcd719ba689faef979c64e9
Author: Vikas Kedigehalli <>
Date:   2016-08-19T23:18:37Z

    DatastoreIO v1beta3 to v1

commit b6d48a33b2f635548ba820d4a672eb23b97d469f
Author: Aljoscha Krettek <>
Date:   2016-08-20T08:23:06Z

    Make ParDoLifecycleTest Serializable to Fix Test with TupleTag

commit a74aa6763f201aae835730e26eb3eb20af3032e4
Author: Aljoscha Krettek <>
Date:   2016-08-20T08:37:42Z

    Fix Exception Unwrapping in TestFlinkRunner

commit dc72b08fae12460a530af07fbbc02dcaee999099
Author: Aljoscha Krettek <>
Date:   2016-08-20T08:42:39Z

    Fix Flink Runner Pom for Batch RunnableOnService tests

commit 1035fad9b1eedad0d45e0e97e400067cab029ccd
Author: Thomas Groh <>
Date:   2016-08-22T16:23:57Z

    Remove unused constant in ExecutorServiceParallelExecutor


> Provide type information from Coders
> ------------------------------------
>                 Key: BEAM-597
>                 URL:
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Jeremie Lenfant-Engelmann
>            Assignee: Jeremie Lenfant-Engelmann
>            Priority: Minor
> The Coder interface should return a TypeDescriptor describing the type that is currently
encoded/decoded by the Coder.

This message was sent by Atlassian JIRA

View raw message