spark-issues mailing list archives: August 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
[jira] [Created] (SPARK-28768) Implement more text pattern operators
Yuming Wang (JIRA)   [jira] [Created] (SPARK-28768) Implement more text pattern operators Sun, 18 Aug, 10:57
[jira] [Commented] (SPARK-28542) Document Stages page
Pablo Langa Blanco (JIRA)   [jira] [Commented] (SPARK-28542) Document Stages page Sun, 18 Aug, 14:57
zhengruifeng (JIRA)   [jira] [Commented] (SPARK-28542) Document Stages page Mon, 19 Aug, 02:52
Sean Owen (Jira)   [jira] [Assigned] (SPARK-28542) Document Stages page Sat, 31 Aug, 18:35
Sean Owen (Jira)   [jira] [Updated] (SPARK-28542) Document Stages page Sat, 31 Aug, 18:35
Sean Owen (Jira)   [jira] [Resolved] (SPARK-28542) Document Stages page Sat, 31 Aug, 18:35
Sean Owen (Jira)   [jira] [Assigned] (SPARK-28542) Document Stages page Sat, 31 Aug, 18:35
[jira] [Commented] (SPARK-28413) sizeInByte is Not updated for parquet datasource on Next Insert.
Yuming Wang (JIRA)   [jira] [Commented] (SPARK-28413) sizeInByte is Not updated for parquet datasource on Next Insert. Sun, 18 Aug, 15:17
[jira] [Created] (SPARK-28769) Improve warning message in Barrier Execution Mode in case required slots > maximum slots
Kousuke Saruta (JIRA)   [jira] [Created] (SPARK-28769) Improve warning message in Barrier Execution Mode in case required slots > maximum slots Sun, 18 Aug, 17:30
Sean Owen (Jira)   [jira] [Assigned] (SPARK-28769) Improve warning message in Barrier Execution Mode in case required slots > maximum slots Thu, 22 Aug, 19:08
Sean Owen (Jira)   [jira] [Resolved] (SPARK-28769) Improve warning message in Barrier Execution Mode in case required slots > maximum slots Thu, 22 Aug, 19:08
[jira] [Resolved] (SPARK-25038) Accelerate Spark Plan generation when Spark SQL read large amount of data
Takeshi Yamamuro (JIRA)   [jira] [Resolved] (SPARK-25038) Accelerate Spark Plan generation when Spark SQL read large amount of data Mon, 19 Aug, 00:15
[jira] [Updated] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries Mon, 19 Aug, 01:26
Dongjoon Hyun (JIRA)   [jira] [Commented] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries Mon, 19 Aug, 01:28
[jira] [Commented] (SPARK-22390) Aggregate push down
Arun Khetarpal (JIRA)   [jira] [Commented] (SPARK-22390) Aggregate push down Mon, 19 Aug, 01:45
Huaxin Gao (Jira)   [jira] [Commented] (SPARK-22390) Aggregate push down Tue, 20 Aug, 00:15
[jira] [Created] (SPARK-28770) Test ReplayListenerSuite.End-to-end replay with compression failed
huangtianhua (JIRA)   [jira] [Created] (SPARK-28770) Test ReplayListenerSuite.End-to-end replay with compression failed Mon, 19 Aug, 02:30
zhao bo (Jira)   [jira] [Commented] (SPARK-28770) Test ReplayListenerSuite.End-to-end replay with compression failed Tue, 20 Aug, 07:50
Hyukjin Kwon (Jira)   [jira] [Updated] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Wed, 21 Aug, 01:35
zhao bo (Jira)   [jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Thu, 22 Aug, 00:24
Jungtaek Lim (Jira)   [jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Sat, 31 Aug, 00:44
Jungtaek Lim (Jira)   [jira] [Comment Edited] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Sat, 31 Aug, 00:45
zhao bo (Jira)   [jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Sat, 31 Aug, 04:08
Wing Yew Poon (Jira)   [jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Sat, 31 Aug, 20:47
Wing Yew Poon (Jira)   [jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed Sat, 31 Aug, 23:48
[jira] [Updated] (SPARK-27234) Continuous Streaming does not support python UDFs
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-27234) Continuous Streaming does not support python UDFs Mon, 19 Aug, 02:59
[jira] [Resolved] (SPARK-28418) Flaky Test: pyspark.sql.tests.test_dataframe: test_query_execution_listener_on_collect
Dongjoon Hyun (JIRA)   [jira] [Resolved] (SPARK-28418) Flaky Test: pyspark.sql.tests.test_dataframe: test_query_execution_listener_on_collect Mon, 19 Aug, 03:29
[jira] [Updated] (SPARK-28247) Flaky test: "query without test harness" in ContinuousSuite
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-28247) Flaky test: "query without test harness" in ContinuousSuite Mon, 19 Aug, 03:30
[jira] [Updated] (SPARK-27672) Add since info to string expressions
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-27672) Add since info to string expressions Mon, 19 Aug, 03:48
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-27672) Add since info to string expressions Mon, 19 Aug, 03:48
[jira] [Updated] (SPARK-27673) Add since info to random. regex, null expressions
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-27673) Add since info to random. regex, null expressions Mon, 19 Aug, 03:49
[jira] [Updated] (SPARK-26812) PushProjectionThroughUnion nullability issue
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-26812) PushProjectionThroughUnion nullability issue Mon, 19 Aug, 03:51
[jira] [Updated] (SPARK-27539) Fix inaccurate aggregate outputRows estimation with column containing null values
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-27539) Fix inaccurate aggregate outputRows estimation with column containing null values Mon, 19 Aug, 03:54
Dongjoon Hyun (JIRA)   [jira] [Updated] (SPARK-27539) Fix inaccurate aggregate outputRows estimation with column containing null values Mon, 19 Aug, 03:55
[jira] [Created] (SPARK-28772) Upgrade breeze to 1.0
Yuming Wang (Jira)   [jira] [Created] (SPARK-28772) Upgrade breeze to 1.0 Mon, 19 Aug, 15:30
[jira] [Created] (SPARK-28773) NULL Handling
Xiao Li (Jira)   [jira] [Created] (SPARK-28773) NULL Handling Mon, 19 Aug, 16:46
[jira] [Created] (SPARK-28774) ReusedExchangeExec cannot be columnar
Robert Joseph Evans (Jira)   [jira] [Created] (SPARK-28774) ReusedExchangeExec cannot be columnar Mon, 19 Aug, 16:55
Hyukjin Kwon (Jira)   [jira] [Updated] (SPARK-28774) ReusedExchangeExec cannot be columnar Tue, 20 Aug, 04:50
Hyukjin Kwon (Jira)   [jira] [Commented] (SPARK-28774) ReusedExchangeExec cannot be columnar Tue, 20 Aug, 04:51
Wenchen Fan (Jira)   [jira] [Assigned] (SPARK-28774) ReusedExchangeExec cannot be columnar Wed, 21 Aug, 10:13
Wenchen Fan (Jira)   [jira] [Resolved] (SPARK-28774) ReusedExchangeExec cannot be columnar Wed, 21 Aug, 10:14
[jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes
Marcelo Vanzin (Jira)   [jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes Mon, 19 Aug, 17:51
Marcelo Vanzin (Jira)   [jira] [Updated] (SPARK-25262) Support tmpfs for local dirs in k8s Mon, 19 Aug, 17:52
Marcelo Vanzin (Jira)   [jira] [Resolved] (SPARK-25262) Support tmpfs for local dirs in k8s Mon, 19 Aug, 17:53
[jira] [Updated] (SPARK-10892) Join with Data Frame returns wrong results
Nicholas Chammas (Jira)   [jira] [Updated] (SPARK-10892) Join with Data Frame returns wrong results Mon, 19 Aug, 19:03
[jira] [Updated] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access
Nicholas Chammas (Jira)   [jira] [Updated] (SPARK-18084) write.partitionBy() does not recognize nested columns that select() can access Mon, 19 Aug, 19:07
[jira] [Updated] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0
Nicholas Chammas (Jira)   [jira] [Updated] (SPARK-19248) Regex_replace works in 1.6 but not in 2.0 Mon, 19 Aug, 19:17
[jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming:The executor storage memory increasing over time
Puneet Loya (Jira)   [jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming:The executor storage memory increasing over time Mon, 19 Aug, 19:25
Jungtaek Lim (Jira)   [jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming:The executor storage memory increasing over time Mon, 19 Aug, 19:40
Puneet Loya (Jira)   [jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming:The executor storage memory increasing over time Tue, 20 Aug, 00:15
Jungtaek Lim (Jira)   [jira] [Commented] (SPARK-27648) In Spark2.4 Structured Streaming:The executor storage memory increasing over time Tue, 20 Aug, 00:26
[jira] [Updated] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results
Nicholas Chammas (Jira)   [jira] [Updated] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results Mon, 19 Aug, 19:38
Nicholas Chammas (Jira)   [jira] [Comment Edited] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results Mon, 19 Aug, 19:40
[jira] [Commented] (SPARK-25603) Generalize Nested Column Pruning
Nicholas Chammas (Jira)   [jira] [Commented] (SPARK-25603) Generalize Nested Column Pruning Mon, 19 Aug, 20:38
[jira] [Created] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018h or newer timezone database
Herman van Hovell (Jira)   [jira] [Created] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018h or newer timezone database Mon, 19 Aug, 21:05
Sean Owen (Jira)   [jira] [Updated] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database Mon, 19 Aug, 21:45
Herman van Hovell (Jira)   [jira] [Assigned] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database Mon, 19 Aug, 21:47
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database Mon, 19 Aug, 23:08
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database Mon, 19 Aug, 23:09
Dongjoon Hyun (Jira)   [jira] [Resolved] (SPARK-28775) DateTimeUtilsSuite fails for JDKs using the tzdata2018i or newer timezone database Tue, 20 Aug, 00:56
[jira] [Created] (SPARK-28776) SparkML MLWriter gets hadoop conf from spark context instead of session
Helen Yu (Jira)   [jira] [Created] (SPARK-28776) SparkML MLWriter gets hadoop conf from spark context instead of session Mon, 19 Aug, 21:22
Sean Owen (Jira)   [jira] [Resolved] (SPARK-28776) SparkML MLWriter gets hadoop conf from spark context instead of session Thu, 22 Aug, 14:28
Sean Owen (Jira)   [jira] [Assigned] (SPARK-28776) SparkML MLWriter gets hadoop conf from spark context instead of session Thu, 22 Aug, 14:28
[jira] [Created] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string
Darren Tirto (Jira)   [jira] [Created] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Mon, 19 Aug, 21:45
Darren Tirto (Jira)   [jira] [Updated] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Tue, 20 Aug, 00:20
Darren Tirto (Jira)   [jira] [Updated] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Tue, 20 Aug, 00:20
Darren Tirto (Jira)   [jira] [Commented] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Tue, 20 Aug, 00:26
Dongjoon Hyun (Jira)   [jira] [Commented] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Tue, 20 Aug, 01:23
Dongjoon Hyun (Jira)   [jira] [Resolved] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Tue, 20 Aug, 03:47
Dongjoon Hyun (Jira)   [jira] [Assigned] (SPARK-28777) Pyspark sql function "format_string" has the wrong parameters in doc string Tue, 20 Aug, 03:47
[jira] [Updated] (SPARK-28552) The URL prefix lowercase of MySQL is not necessary, but it is necessary in spark
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28552) The URL prefix lowercase of MySQL is not necessary, but it is necessary in spark Mon, 19 Aug, 22:08
[jira] [Updated] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28415) Add messageHandler to Kafka 10 direct stream API Mon, 19 Aug, 22:08
[jira] [Updated] (SPARK-28547) Make it work for wide (> 10K columns data)
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28547) Make it work for wide (> 10K columns data) Mon, 19 Aug, 22:08
[jira] [Updated] (SPARK-28771) Join partitioned dataframes on superset of partitioning columns without shuffle
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28771) Join partitioned dataframes on superset of partitioning columns without shuffle Mon, 19 Aug, 22:08
[jira] [Updated] (SPARK-28577) Ensure executorMemoryHead requested value not less than MEMORY_OFFHEAP_SIZE when MEMORY_OFFHEAP_ENABLED is true
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28577) Ensure executorMemoryHead requested value not less than MEMORY_OFFHEAP_SIZE when MEMORY_OFFHEAP_ENABLED is true Mon, 19 Aug, 22:08
Thomas Graves (Jira)   [jira] [Updated] (SPARK-28577) Ensure executorMemoryHead requested value not less than MEMORY_OFFHEAP_SIZE when MEMORY_OFFHEAP_ENABLED is true Thu, 22 Aug, 15:01
Thomas Graves (Jira)   [jira] [Updated] (SPARK-28577) Ensure executorMemoryHead requested value not less than MEMORY_OFFHEAP_SIZE when MEMORY_OFFHEAP_ENABLED is true Thu, 22 Aug, 15:02
[jira] [Updated] (SPARK-28573) Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28573) Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table Mon, 19 Aug, 22:08
[jira] [Updated] (SPARK-28560) Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28560) Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution Mon, 19 Aug, 22:08
[jira] [Updated] (SPARK-28466) FileSystem closed error when to call Hive.moveFile
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28466) FileSystem closed error when to call Hive.moveFile Mon, 19 Aug, 22:11
Dongjoon Hyun (Jira)   [jira] [Commented] (SPARK-28466) FileSystem closed error when to call Hive.moveFile Mon, 19 Aug, 22:13
angerszhu (Jira)   [jira] [Resolved] (SPARK-28466) FileSystem closed error when to call Hive.moveFile Tue, 20 Aug, 07:53
[jira] [Created] (SPARK-28778) [MESOS] Shuffle jobs fail due to incorrect advertised address when running in virtual network
Anton Kirillov (Jira)   [jira] [Created] (SPARK-28778) [MESOS] Shuffle jobs fail due to incorrect advertised address when running in virtual network Mon, 19 Aug, 22:31
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28778) Shuffle jobs fail due to incorrect advertised address when running in virtual network Mon, 19 Aug, 22:34
Dongjoon Hyun (Jira)   [jira] [Resolved] (SPARK-28778) Shuffle jobs fail due to incorrect advertised address when running in virtual network Sat, 24 Aug, 01:35
Dongjoon Hyun (Jira)   [jira] [Assigned] (SPARK-28778) Shuffle jobs fail due to incorrect advertised address when running in virtual network Sat, 24 Aug, 01:36
Dongjoon Hyun (Jira)   [jira] [Commented] (SPARK-28778) Shuffle jobs fail due to incorrect advertised address when running in virtual network Sat, 24 Aug, 01:37
Dongjoon Hyun (Jira)   [jira] [Updated] (SPARK-28778) Shuffle jobs fail due to incorrect advertised address when running in virtual network Sat, 31 Aug, 06:28
[jira] [Created] (SPARK-28779) CSV writer doesn't handle older Mac line endings
nicolas paris (Jira)   [jira] [Created] (SPARK-28779) CSV writer doesn't handle older Mac line endings Mon, 19 Aug, 22:42
Hyukjin Kwon (Jira)   [jira] [Resolved] (SPARK-28779) CSV writer doesn't handle older Mac line endings Wed, 21 Aug, 01:33
Hyukjin Kwon (Jira)   [jira] [Commented] (SPARK-28779) CSV writer doesn't handle older Mac line endings Wed, 21 Aug, 01:33
nicolas paris (Jira)   [jira] [Commented] (SPARK-28779) CSV writer doesn't handle older Mac line endings Wed, 21 Aug, 20:25
Hyukjin Kwon (Jira)   [jira] [Commented] (SPARK-28779) CSV writer doesn't handle older Mac line endings Thu, 22 Aug, 00:04
nicolas paris (Jira)   [jira] [Commented] (SPARK-28779) CSV writer doesn't handle older Mac line endings Thu, 22 Aug, 08:57
[jira] [Resolved] (SPARK-28224) Check overflow in decimal Sum aggregate
Takeshi Yamamuro (Jira)   [jira] [Resolved] (SPARK-28224) Check overflow in decimal Sum aggregate Tue, 20 Aug, 00:50
[jira] [Assigned] (SPARK-28483) Canceling a spark job using barrier mode but barrier tasks do not exit
Wenchen Fan (Jira)   [jira] [Assigned] (SPARK-28483) Canceling a spark job using barrier mode but barrier tasks do not exit Tue, 20 Aug, 06:25
Wenchen Fan (Jira)   [jira] [Resolved] (SPARK-28483) Canceling a spark job using barrier mode but barrier tasks do not exit Tue, 20 Aug, 06:27
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Jul 20212560
Jun 20213227
May 20212433
Apr 20212718
Mar 20213011
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189