spark-issues mailing list archives: October 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory Tue, 01 Oct, 02:27
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streamingļ¼šThe executor storage memory increasing over time Tue, 01 Oct, 02:27
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streamingļ¼šThe executor storage memory increasing over time Tue, 01 Oct, 03:17
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29301) Removing block is not reflected to the driver/executor's storage memory Tue, 01 Oct, 03:18
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-28074) [SS] Log warn message on possible correctness issue for multiple stateful operations in single query Tue, 01 Oct, 06:58
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-28074) [SS] Log warn message on possible correctness issue for multiple stateful operations in single query Tue, 01 Oct, 06:58
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-28094) Multiple left joins or aggregations in one query produce incorrect results Tue, 01 Oct, 08:22
Jungtaek Lim (Jira) [jira] [Comment Edited] (SPARK-28094) Multiple left joins or aggregations in one query produce incorrect results Tue, 01 Oct, 08:23
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29312) Inconsistent behavior on metrics when dropping rows in state between FlatMapGroupWithState and other stateful operators Tue, 01 Oct, 09:03
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29312) Inconsistent behavior on metrics when dropping rows in state between FlatMapGroupWithState and other stateful operators Tue, 01 Oct, 09:42
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29314) ProgressReporter.extractStateOperatorMetrics should not overwrite updated as 0 when it actually runs a batch even with no data Tue, 01 Oct, 09:53
Jungtaek Lim (Jira) [jira] [Comment Edited] (SPARK-28094) Multiple left joins or aggregations in one query produce incorrect results Tue, 01 Oct, 10:03
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-28094) Multiple left joins or aggregations in one query produce incorrect results Tue, 01 Oct, 10:03
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29055) Memory leak in Spark Tue, 01 Oct, 19:35
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29321) CLONE - Possible memory leak in Spark Tue, 01 Oct, 20:02
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29321) Possible memory leak in Spark Tue, 01 Oct, 20:02
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29321) Possible memory leak in Spark Tue, 01 Oct, 20:05
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29321) Possible memory leak in Spark Tue, 01 Oct, 20:05
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29321) CLONE - Possible memory leak in Spark Tue, 01 Oct, 20:05
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29321) Possible memory leak in Spark Tue, 01 Oct, 20:12
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29097) Spark driver memory exceeded the storage memory Tue, 01 Oct, 21:36
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 02:50
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 02:51
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 02:53
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 02:55
Jungtaek Lim (Jira) [jira] [Issue Comment Deleted] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 03:23
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 03:23
Jungtaek Lim (Jira) [jira] [Comment Edited] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 04:18
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 05:10
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 05:11
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 05:44
Jungtaek Lim (Jira) [jira] [Issue Comment Deleted] (SPARK-29322) History server is stuck reading incomplete event log file compressed with zstd Wed, 02 Oct, 05:45
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29361) Enable streaming source support on DSv1 Sat, 05 Oct, 04:49
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29361) Enable streaming source support on DSv1 Sat, 05 Oct, 05:02
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29361) Enable DataFrame with streaming source support on DSv1 Sat, 05 Oct, 05:24
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29361) Enable streaming source support on DSv1 Sat, 05 Oct, 05:24
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29139) Flaky test: org.apache.spark.SparkContextSuite.test gpu driver resource files and discovery under local-cluster mode Sun, 06 Oct, 23:17
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29139) Flaky test: org.apache.spark.SparkContextSuite.test gpu driver resource files and discovery under local-cluster mode Mon, 07 Oct, 05:05
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join Fri, 11 Oct, 13:11
Jungtaek Lim (Jira) [jira] [Comment Edited] (SPARK-29438) Failed to get state store in stream-stream join Fri, 11 Oct, 13:13
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join Fri, 11 Oct, 13:50
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29426) Watermark does not take effect Sat, 12 Oct, 03:45
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29450) [SS] In streaming aggregation, metric for output rows is not measured in append mode Sun, 13 Oct, 07:12
Jungtaek Lim (Jira) [jira] [Resolved] (SPARK-29129) Test failure: org.apache.spark.sql.hive.JavaDataFrameSuite (hadoop-2.7/JDK 11 combination) Sun, 13 Oct, 22:51
Jungtaek Lim (Jira) [jira] [Resolved] (SPARK-29361) Enable DataFrame with streaming source support on DSv1 Sun, 13 Oct, 23:10
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29461) Spark dataframe writer does not expose metrics for JDBC writer Mon, 14 Oct, 08:40
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join Thu, 17 Oct, 05:48
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29509) Deduplicate code blocks in Kafka data source Fri, 18 Oct, 13:12
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29503) MapObjects doesn't copy Unsafe data when nested under Safe data Sat, 19 Oct, 06:57
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29321) Possible memory leak in Spark Sun, 20 Oct, 13:56
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29321) Possible memory leak in Spark Sun, 20 Oct, 14:05
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29438) Failed to get state store in stream-stream join Mon, 21 Oct, 06:31
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29538) Flaky test: org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple joins Mon, 21 Oct, 14:34
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29538) Test failure: org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple joins Tue, 22 Oct, 02:16
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29538) Test failure: org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple joins Tue, 22 Oct, 02:17
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29538) Test failure: org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple joins Tue, 22 Oct, 02:32
Jungtaek Lim (Jira) [jira] [Resolved] (SPARK-29538) Test failure: org.apache.spark.sql.execution.adaptive.AdaptiveQueryExecSuite.multiple joins Wed, 23 Oct, 20:39
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-28870) Snapshot old event log files to support compaction Wed, 23 Oct, 22:27
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading Wed, 23 Oct, 22:27
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading Wed, 23 Oct, 22:28
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading Wed, 23 Oct, 22:29
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-28870) Snapshot event log files to support incremental reading Wed, 23 Oct, 22:32
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29111) Support snapshot/restore of KVStore Wed, 23 Oct, 22:34
Jungtaek Lim (Jira) [jira] [Updated] (SPARK-29261) Support recover live entities from KVStore for (SQL)AppStatusListener Wed, 23 Oct, 22:36
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29579) Guarantee compatibility of snapshot (live entities, KVstore entities) Wed, 23 Oct, 23:13
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29581) Enable cleanup old event log files Wed, 23 Oct, 23:27
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-28594) Allow event logs for running streaming apps to be rolled over. Wed, 23 Oct, 23:54
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set Fri, 25 Oct, 12:25
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set Fri, 25 Oct, 12:26
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29635) Deduplicate test suites between Kafka micro-batch sink and Kafka continuous sink Tue, 29 Oct, 09:00
Jungtaek Lim (Jira) [jira] [Created] (SPARK-29642) ContinuousMemoryStream throws error on String type Tue, 29 Oct, 22:11
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set Wed, 30 Oct, 12:58
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set Wed, 30 Oct, 22:21
Jungtaek Lim (Jira) [jira] [Commented] (SPARK-29604) SessionState is initialized with isolated classloader for Hive if spark.sql.hive.metastore.jars is being set Thu, 31 Oct, 07:46
Kangtian (Jira) [jira] [Updated] (SPARK-29267) rdd.countApprox should stop when 'timeout' Sat, 05 Oct, 04:38
Kangtian (Jira) [jira] [Updated] (SPARK-29267) rdd.countApprox should stop when 'timeout' Sat, 05 Oct, 04:39
Kangtian (Jira) [jira] [Updated] (SPARK-29267) rdd.countApprox should stop when 'timeout' Sat, 05 Oct, 04:39
Kangtian (Jira) [jira] [Commented] (SPARK-29267) rdd.countApprox should stop when 'timeout' Sat, 05 Oct, 04:43
Kangtian (Jira) [jira] [Commented] (SPARK-29267) rdd.countApprox should stop when 'timeout' Wed, 16 Oct, 02:52
Kangtian (Jira) [jira] [Commented] (SPARK-29267) rdd.countApprox should stop when 'timeout' Thu, 17 Oct, 09:42
Karuppayya (Jira) [jira] [Created] (SPARK-29324) saveAsTable with overwrite mode results in metadata loss Wed, 02 Oct, 04:55
Ke Jia (Jira) [jira] [Created] (SPARK-29544) Optimize skewed join at runtime with new Adaptive Execution Tue, 22 Oct, 06:52
Ke Jia (Jira) [jira] [Updated] (SPARK-29544) Optimize skewed join at runtime with new Adaptive Execution Tue, 22 Oct, 06:53
Ke Jia (Jira) [jira] [Commented] (SPARK-29544) Optimize skewed join at runtime with new Adaptive Execution Tue, 22 Oct, 06:55
Ke Jia (Jira) [jira] [Created] (SPARK-29552) Fix the flaky test failed in AdaptiveQueryExecSuite # multiple joins Tue, 22 Oct, 11:18
Ke Jia (Jira) [jira] [Updated] (SPARK-29552) Fix the flaky test failed in AdaptiveQueryExecSuite # multiple joins Tue, 22 Oct, 11:23
Ke Li (Jira) [jira] [Commented] (SPARK-28864) Add spark connector for Alibaba Log Service Sun, 20 Oct, 13:50
Kent Yao (Jira) [jira] [Created] (SPARK-29405) Alter table / Insert statements should not change a table's ownership Wed, 09 Oct, 08:18
Kent Yao (Jira) [jira] [Created] (SPARK-29425) Alter database statement erases hive database's ownership Thu, 10 Oct, 10:03
Kent Yao (Jira) [jira] [Updated] (SPARK-29425) Alter database statement erases hive database's ownership Thu, 10 Oct, 10:05
Kent Yao (Jira) [jira] [Created] (SPARK-29491) Add bit_count function support Wed, 16 Oct, 09:25
Kent Yao (Jira) [jira] [Commented] (SPARK-29498) CatalogTable to HiveTable should not change the table's ownership Thu, 17 Oct, 09:38
Kent Yao (Jira) [jira] [Commented] (SPARK-29498) CatalogTable to HiveTable should not change the table's ownership Thu, 17 Oct, 11:15
Kent Yao (Jira) [jira] [Commented] (SPARK-29498) CatalogTable to HiveTable should not change the table's ownership Thu, 17 Oct, 11:16
Kent Yao (Jira) [jira] [Commented] (SPARK-27879) Implement bitwise integer aggregates(BIT_AND and BIT_OR) Fri, 18 Oct, 03:44
Kent Yao (Jira) [jira] [Created] (SPARK-29507) Support ALTER TABLE SET OWNER command Fri, 18 Oct, 08:38
Kent Yao (Jira) [jira] [Commented] (SPARK-29507) Support ALTER TABLE SET OWNER command Fri, 18 Oct, 16:53
Kent Yao (Jira) [jira] [Created] (SPARK-29514) String function: string_to_array Fri, 18 Oct, 17:19
Kent Yao (Jira) [jira] [Commented] (SPARK-29541) Add missing modules in spark-parent pom file Tue, 22 Oct, 03:21
Kent Yao (Jira) [jira] [Created] (SPARK-29545) Implement bitwise integer aggregates bit_xor Tue, 22 Oct, 07:48
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Box list
Feb 20211997
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189