beam-commits mailing list archives: July 2019

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
aromane...@apache.org [beam] branch master updated (f22070b -> 0d74293) Mon, 01 Jul, 12:30
aromane...@apache.org   [beam] 01/01: Merge pull request #8963: [BEAM-7640] Create amazon-web-services2 module and AwsOptions Mon, 01 Jul, 12:30
an...@apache.org [beam] branch master updated: [BEAM-7545] Adding RowCount to TextTable. Mon, 01 Jul, 16:46
lc...@apache.org [beam] branch beam5605 created (now 3d576f7) Mon, 01 Jul, 17:58
lc...@apache.org [beam] branch beam5605 deleted (was 3d576f7) Mon, 01 Jul, 17:58
lc...@apache.org [beam] branch master updated (3d576f7 -> 45d8a28) Mon, 01 Jul, 19:28
lc...@apache.org   [beam] 01/01: [BEAM-3645] add ParallelBundleManager Mon, 01 Jul, 19:28
boyu...@apache.org [beam] branch master updated: Tiny typo fix Mon, 01 Jul, 23:46
ieme...@apache.org [beam] branch BEAM-1861-orcio created (now ff724e8) Tue, 02 Jul, 07:46
ieme...@apache.org   [beam] 01/01: --wip-- [skip ci] Tue, 02 Jul, 07:46
ieme...@apache.org [beam] branch BEAM-1861-orcio deleted (was ff724e8) Tue, 02 Jul, 08:06
ieme...@apache.org [beam] branch lgajowy-portable-load-tests-proposal deleted (was 278c1e8) Tue, 02 Jul, 08:08
ieme...@apache.org [beam] branch udim-patch-1 deleted (was 2d49e58) Tue, 02 Jul, 08:09
lgaj...@apache.org [beam] branch master updated (05900a4 -> 6aceab4) Tue, 02 Jul, 10:18
lgaj...@apache.org   [beam] 01/01: Merge pull request #8834: [BEAM-7536] Fix BigQuery dataset name in collecting Load Tests metrics Tue, 02 Jul, 10:18
lc...@apache.org [beam] branch master updated (6aceab4 -> fbd1f4c) Tue, 02 Jul, 15:25
aromane...@apache.org [beam] branch master updated (fbd1f4c -> 3643f43) Tue, 02 Jul, 16:00
aromane...@apache.org   [beam] 01/01: Merge pull request #8983: [BEAM-7640] Rename the package name for amazon-web-services2 from aws to aws2 Tue, 02 Jul, 16:00
ieme...@apache.org [beam] branch master updated (3643f43 -> 7f83599) Tue, 02 Jul, 16:55
ieme...@apache.org   [beam] 01/01: Merge pull request #8813: [BEAM-7504] Created Combine Python Load Test Jenkins job Tue, 02 Jul, 16:55
chamik...@apache.org [beam] branch master updated (7f83599 -> b79f24c) Tue, 02 Jul, 22:02
chamik...@apache.org   [beam] 01/01: Merge pull request #8878: [BEAM-5315] improve test coverage bigquery special chars Tue, 02 Jul, 22:02
aromane...@apache.org [beam] branch master updated (b79f24c -> 32e2e3e) Wed, 03 Jul, 13:21
aromane...@apache.org   [beam] 01/01: Merge pull request #8986: [BEAM-4420] Add KafkaIO Integration Tests Wed, 03 Jul, 13:21
ieme...@apache.org [beam] branch master updated (32e2e3e -> cfecfb0) Thu, 04 Jul, 09:18
ieme...@apache.org   [beam] 01/01: Merge pull request #9004: [BEAM-7683] MongoDBIO.withQueryFn ignores custom filter Thu, 04 Jul, 09:18
aromane...@apache.org [beam] branch master updated (cfecfb0 -> b2f0171) Thu, 04 Jul, 09:41
aromane...@apache.org   [beam] 01/01: Merge pull request #8995: [BEAM-7682] Fix Combine.GroupedValues javadoc code snippet Thu, 04 Jul, 09:41
m..@apache.org [beam] branch master updated (b2f0171 -> 73735cc) Thu, 04 Jul, 11:23
git-site-r...@apache.org [beam] branch asf-site updated: Publishing website 2019/07/04 11:24:45 at commit 73735cc Thu, 04 Jul, 11:24
lgaj...@apache.org [beam] branch master updated (73735cc -> 2d5e493) Thu, 04 Jul, 11:44
lgaj...@apache.org   [beam] 01/01: Merge pull request #8847: [BEAM-7550] Missing pipeline parameters in ParDo Load Test Thu, 04 Jul, 11:44
echauc...@apache.org [beam] branch spark-runner_structured-streaming updated (dcb3949 -> fc83520) Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 01/13: Fix bug in the window merging logic Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 02/13: Remove the mapPartition that adds a key per partition because otherwise spark will reduce values per key instead of globally Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 03/13: Remove CombineGlobally translation because it is less performant than the beam sdk one (key + combinePerKey.withHotkeyFanout) Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 04/13: Now that there is only Combine.PerKey translation, make only one Aggregator Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 05/13: Clean no more needed KVHelpers Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 06/13: Clean not more needed RowHelpers Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 07/13: Clean not more needed WindowingHelpers Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 08/13: Fix javadoc of AggregatorCombiner Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 09/13: Fixed immutable list bug Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 10/13: add comment in combine globally test Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 11/13: Clean groupByKeyTest Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 12/13: Add a test that combine per key preserves windowing Fri, 05 Jul, 13:53
echauc...@apache.org   [beam] 13/13: Ignore for now not working test testCombineGlobally Fri, 05 Jul, 13:53
aromane...@apache.org [beam] branch spark-runner_structured-streaming updated: Add metrics support in DoFn Fri, 05 Jul, 14:53
ieme...@apache.org [beam] branch spark-runner_structured-streaming updated: Add missing dependencies to run Spark Structured Streaming Runner on Nexmark Fri, 05 Jul, 15:14
aromane...@apache.org [beam] branch spark-runner_structured-streaming updated: Add setEnableSparkMetricSinks() Mon, 08 Jul, 09:57
echauc...@apache.org [beam] branch spark-runner_structured-streaming updated (239bc93 -> 7356ec2) Mon, 08 Jul, 12:12
aromane...@apache.org [beam] branch spark-runner_structured-streaming updated: Add setEnableSparkMetricSinks() method Mon, 08 Jul, 16:03
lc...@apache.org [beam] branch master updated (2d5e493 -> 82cfdb8) Mon, 08 Jul, 20:30
lc...@apache.org   [beam] 01/01: [BEAM-5605] Update Beam Java SDK backlog to track latest changes in Beam Python SDK. Mon, 08 Jul, 20:30
boyu...@apache.org [beam] branch master updated: Fix RestrictionTracker docstring Mon, 08 Jul, 22:19
echauc...@apache.org [beam] branch master updated: Consider Elasticsearch as one word in camelCase. Tue, 09 Jul, 09:15
echauc...@apache.org [beam] branch spark-runner_structured-streaming updated (d14a29a -> c6d2c52) Tue, 09 Jul, 12:59
echauc...@apache.org   [beam] 01/03: Fix javadoc Tue, 09 Jul, 13:00
echauc...@apache.org   [beam] 02/03: Fix accumulators initialization in Combine that prevented CombineGlobally to work. Tue, 09 Jul, 13:00
echauc...@apache.org   [beam] 03/03: Add a test to check that CombineGlobally preserves windowing Tue, 09 Jul, 13:00
aromane...@apache.org [beam] branch master updated: [BEAM-6480] Adds AvroIO sink for generic records. (#9005) Tue, 09 Jul, 13:00
echauc...@apache.org [beam] branch spark-runner_structured-streaming updated (c6d2c52 -> a37817d) Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 01/45: Build fixup: enable batch Validates Runner tests for Structured Streaming Runner Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 02/45: Build fixup: Limit the number of partitions to make tests go 300% faster Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 03/45: Fixes ParDo not calling setup and not tearing down if exception on startBundle Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 04/45: Build fixup: enable UsesFailureMessage and UsesSchema categories on validatesRunner tests Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 05/45: Pass transform based doFnSchemaInformation in ParDo translation Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 06/45: Build fixup: hadoop-format is not mandataory to run ValidatesRunner tests Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 07/45: Consider null object case on RowHelpers, fixes empty side inputs tests. Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 08/45: Put back batch/simpleSourceTest.testBoundedSource Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 09/45: Update windowAssignTest Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 10/45: Add comment about checkpoint mark Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 11/45: Re-code GroupByKeyTranslatorBatch to conserve windowing instead of unwindowing/windowing(GlobalWindow): simplify code, use ReduceFnRunner to merge the windows Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 12/45: re-enable reduceFnRunner timers for output Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 13/45: Improve visibility of debug messages Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 14/45: Build fixup: enable UsesBoundedSplittableParDo category of tests Since the default overwrite is already in place and it is breaking only in one subcase Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 15/45: Add a test that GBK preserves windowing Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 16/45: Add TODO in Combine translations Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 17/45: Update KVHelpers.extractKey() to deal with WindowedValue and update GBK and CPK Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 18/45: Fix comment about schemas Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 19/45: Implement reduce part of CombineGlobally translation with windowing Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 20/45: Output data after combine Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 21/45: Implement merge accumulators part of CombineGlobally translation with windowing Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 22/45: Fix encoder in combine call Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 23/45: Revert extractKey while combinePerKey is not done (so that it compiles) Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 24/45: Apply a groupByKey avoids for some reason that the spark structured streaming fmwk casts data to Row which makes it impossible to deserialize without the coder shipped into the data. For performance reasons (avoid memory consumption and having to deserialize), we do not ship coder + data. Also add a mapparitions before GBK to avoid shuffling Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 25/45: Fix case when a window does not merge into any other window Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 26/45: Fix wrong encoder in combineGlobally GBK Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 27/45: Fix bug in the window merging logic Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 28/45: Remove the mapPartition that adds a key per partition because otherwise spark will reduce values per key instead of globally Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 29/45: Remove CombineGlobally translation because it is less performant than the beam sdk one (key + combinePerKey.withHotkeyFanout) Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 30/45: Now that there is only Combine.PerKey translation, make only one Aggregator Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 31/45: Clean no more needed KVHelpers Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 32/45: Clean not more needed RowHelpers Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 33/45: Clean not more needed WindowingHelpers Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 34/45: Fix javadoc of AggregatorCombiner Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 35/45: Fixed immutable list bug Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 36/45: add comment in combine globally test Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 37/45: Clean groupByKeyTest Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 38/45: Add a test that combine per key preserves windowing Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 39/45: Ignore for now not working test testCombineGlobally Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 40/45: Add metrics support in DoFn Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 41/45: Add missing dependencies to run Spark Structured Streaming Runner on Nexmark Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 42/45: Add setEnableSparkMetricSinks() method Tue, 09 Jul, 13:18
echauc...@apache.org   [beam] 43/45: Fix javadoc Tue, 09 Jul, 13:19
echauc...@apache.org   [beam] 44/45: Fix accumulators initialization in Combine that prevented CombineGlobally to work. Tue, 09 Jul, 13:19
echauc...@apache.org   [beam] 45/45: Add a test to check that CombineGlobally preserves windowing Tue, 09 Jul, 13:19
pabl...@apache.org [beam] branch master updated: unskip ReifyTest.test_window Tue, 09 Jul, 15:49
lc...@apache.org [beam] branch master updated (42ef04a -> 16e4fbc) Tue, 09 Jul, 17:05
lc...@apache.org   [beam] 01/01: [BEAM-6740] Add PTransformTranslator for Combine.Globally Tue, 09 Jul, 17:05
u...@apache.org [beam] branch master updated (16e4fbc -> db913ef) Tue, 09 Jul, 17:54
lc...@apache.org [beam] branch master updated (db913ef -> 600099a) Tue, 09 Jul, 18:08
lc...@apache.org   [beam] 01/01: [BEAM-7708] don't expect SQL shell bundled dependencies to be shadowed Tue, 09 Jul, 18:08
lc...@apache.org [beam] branch master updated: [SQL][Doc] fix broken gradle command. Tue, 09 Jul, 18:12
lc...@apache.org [beam] branch master updated (a2f8458 -> 66bd44f) Tue, 09 Jul, 18:13
lc...@apache.org [beam] branch release-2.14.0 updated (09ea2ca -> 524272b) Tue, 09 Jul, 18:16
lc...@apache.org   [beam] 01/01: Cherry pick #8954: Spotless config update to include java files only under src directory Tue, 09 Jul, 18:16
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Dec 2019109
Nov 2019299
Oct 2019545
Sep 2019348
Aug 2019351
Jul 2019387
Jun 2019332
May 2019464
Apr 2019336
Mar 2019259
Feb 2019367
Jan 2019518
Dec 2018368
Nov 2018448
Oct 20184197
Sep 20184689
Aug 20184453
Jul 20184320
Jun 20186163
May 20185547
Apr 20185962
Mar 20184479
Feb 20181955
Jan 20182670
Dec 20171428
Nov 20172364
Oct 20171972
Sep 20172095
Aug 20172291
Jul 20172998
Jun 20172879
May 20175577
Apr 20175171
Mar 20174068
Feb 20172908
Jan 20171848
Dec 20163374
Nov 20162900
Oct 20162712
Sep 20161298
Aug 20161500
Jul 20161550
Jun 20161725
May 20161092
Apr 20161731
Mar 20161158
Feb 2016294