spark-issues mailing list archives: October 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-24640) size(null) returns null Tue, 08 Oct, 11:58
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29372) Codegen grows beyond 64 KB for more columns in case of SupportsScanColumnarBatch Tue, 08 Oct, 12:35
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29358) Make unionByName optionally fill missing columns with nulls Tue, 08 Oct, 12:52
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls Tue, 08 Oct, 12:52
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29356) Stopping Spark doesn't shut down all network connections Tue, 08 Oct, 12:53
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql Tue, 08 Oct, 12:55
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql Tue, 08 Oct, 12:55
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation Tue, 08 Oct, 16:10
Hyukjin Kwon (Jira) [jira] [Created] (SPARK-29403) Uses Arrow R 0.14.1 in AppVeyor for now Wed, 09 Oct, 01:40
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running Wed, 09 Oct, 10:55
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29403) Uses Arrow R 0.14.1 in AppVeyor for now Thu, 10 Oct, 00:02
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29358) Make unionByName optionally fill missing columns with nulls Thu, 10 Oct, 01:09
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29367) pandas udf not working with latest pyarrow release (0.15.0) Fri, 11 Oct, 00:21
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29284) df.distinct.count throw NoSuchElementException when enabled daptive executor Fri, 11 Oct, 01:51
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe Fri, 11 Oct, 02:21
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29432) nullable flag of new column changes when persisting a pyspark dataframe Fri, 11 Oct, 02:22
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29423) leak on org.apache.spark.sql.execution.streaming.StreamingQueryListenerBus Fri, 11 Oct, 02:25
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29423) leak on org.apache.spark.sql.execution.streaming.StreamingQueryListenerBus Fri, 11 Oct, 02:26
Hyukjin Kwon (Jira) [jira] [Reopened] (SPARK-24266) Spark client terminates while driver is still running Fri, 11 Oct, 02:58
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running Fri, 11 Oct, 02:58
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running Fri, 11 Oct, 02:58
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29337) How to Cache Table and Pin it in Memory and should not Spill to Disk on Thrift Server Fri, 11 Oct, 03:03
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29335) Cost Based Optimizer stats are not used while evaluating query plans in Spark Sql Fri, 11 Oct, 03:04
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29222) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_parameter_convergence Fri, 11 Oct, 03:06
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29280) DataFrameReader should support a compression option Fri, 11 Oct, 03:08
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-28008) Default values & column comments in AVRO schema converters Fri, 11 Oct, 05:16
Hyukjin Kwon (Jira) [jira] [Comment Edited] (SPARK-28008) Default values & column comments in AVRO schema converters Fri, 11 Oct, 05:17
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-24540) Support for multiple character delimiter in Spark CSV read Fri, 11 Oct, 06:05
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-24540) Support for multiple character delimiter in Spark CSV read Fri, 11 Oct, 06:05
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29267) rdd.countApprox should stop when 'timeout' Fri, 11 Oct, 06:11
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29340) Spark Sql executions do not use thread local jobgroup Fri, 11 Oct, 06:13
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29078) Spark shell fails if read permission is not granted to hive warehouse directory Fri, 11 Oct, 06:18
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29041) Allow createDataFrame to accept bytes as binary type Fri, 11 Oct, 06:25
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29241) Show alternative names in the function description Fri, 11 Oct, 06:27
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-28653) Create table using DDL statement should not auto create the destination folder Fri, 11 Oct, 06:31
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29047) use spark-submit Not a file: hdfs:// Fri, 11 Oct, 06:38
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-28864) Add spark connector for Alibaba Log Service Fri, 11 Oct, 06:40
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-28864) Add spark connector for Alibaba Log Service Fri, 11 Oct, 06:40
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-28943) NoSuchMethodError: shaded.parquet.org.apache.thrift.EncodingUtils.setBit(BIZ)B Fri, 11 Oct, 06:42
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-28943) NoSuchMethodError: shaded.parquet.org.apache.thrift.EncodingUtils.setBit(BIZ)B Fri, 11 Oct, 06:42
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-16534) Kafka 0.10 Python support Fri, 11 Oct, 15:29
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-16534) Kafka 0.10 Python support Fri, 11 Oct, 15:30
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29423) leak on org.apache.spark.sql.execution.streaming.StreamingQueryListenerBus Fri, 11 Oct, 15:31
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-28547) Make it work for wide (> 10K columns data) Fri, 11 Oct, 15:35
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29473) move statement logical plans to a new file Tue, 15 Oct, 13:07
Hyukjin Kwon (Jira) [jira] [Reopened] (SPARK-15694) Implement ScriptTransformation in sql/core Thu, 17 Oct, 12:08
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29528) Upgrade scala-maven-plugin to 4.2.4 for Scala 2.13.1 Mon, 21 Oct, 10:06
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29528) Upgrade scala-maven-plugin to 4.2.4 for Scala 2.13.1 Mon, 21 Oct, 10:07
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29529) Remove unnecessary orc version and hive version in doc Mon, 21 Oct, 11:16
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29529) Remove unnecessary orc version and hive version in doc Mon, 21 Oct, 11:16
Hyukjin Kwon (Jira) [jira] [Created] (SPARK-29536) PySpark does not work with Python 3.8.0 Mon, 21 Oct, 12:39
Hyukjin Kwon (Jira) [jira] [Reopened] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility) Mon, 21 Oct, 13:21
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility) Mon, 21 Oct, 13:22
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility) Mon, 21 Oct, 16:58
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility) Tue, 22 Oct, 01:46
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-25923) SparkR UT Failure (checking CRAN incoming feasibility) Tue, 22 Oct, 01:46
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29533) Benchmark casting strings to intervals Tue, 22 Oct, 01:48
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29533) Benchmark casting strings to intervals Tue, 22 Oct, 01:48
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29518) Benchmark `date_part` for `INTERVAL` Tue, 22 Oct, 01:49
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29518) Benchmark `date_part` for `INTERVAL` Tue, 22 Oct, 01:49
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29108) Add window.sql - Part 2 Tue, 22 Oct, 01:51
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29108) Add window.sql - Part 2 Tue, 22 Oct, 01:51
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29329) maven incremental builds not working Tue, 22 Oct, 01:58
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29529) Remove unnecessary orc version and hive version in doc Tue, 22 Oct, 05:50
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29529) Remove unnecessary orc version and hive version in doc Tue, 22 Oct, 05:51
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29536) PySpark does not work with Python 3.8.0 Tue, 22 Oct, 07:19
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29536) PySpark does not work with Python 3.8.0 Tue, 22 Oct, 07:20
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23160) Port window.sql Wed, 23 Oct, 01:23
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-23160) Port window.sql Wed, 23 Oct, 01:23
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29107) Add window.sql - Part 1 Wed, 23 Oct, 01:25
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29324) saveAsTable with overwrite mode results in metadata loss Wed, 23 Oct, 07:26
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29569) doc build fails with `/api/scala/lib/jquery.js` doesn't exist Wed, 23 Oct, 11:28
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29569) doc build fails with `/api/scala/lib/jquery.js` doesn't exist Wed, 23 Oct, 11:29
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29542) [SQL][DOC] The descriptions of `spark.sql.files.*` are confused. Wed, 23 Oct, 11:33
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29542) [SQL][DOC] The descriptions of `spark.sql.files.*` are confused. Wed, 23 Oct, 11:33
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29569) doc build fails with `/api/scala/lib/jquery.js` doesn't exist Wed, 23 Oct, 11:43
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29569) doc build fails with `/api/scala/lib/jquery.js` doesn't exist Wed, 23 Oct, 11:43
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-16483) Unifying struct fields and columns Thu, 24 Oct, 03:13
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29571) Fix UT in AllExecutionsPageSuite class Thu, 24 Oct, 06:59
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29571) Fix UT in AllExecutionsPageSuite class Thu, 24 Oct, 06:59
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-29227) Track rule info in optimization phase Fri, 25 Oct, 01:04
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29227) Track rule info in optimization phase Fri, 25 Oct, 01:04
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29528) Upgrade scala-maven-plugin to 4.2.4 for Scala 2.13.1 Mon, 28 Oct, 11:49
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29528) Upgrade scala-maven-plugin to 4.2.4 for Scala 2.13.1 Mon, 28 Oct, 11:49
Hyukjin Kwon (Jira) [jira] [Reopened] (SPARK-29528) Upgrade scala-maven-plugin to 4.2.4 for Scala 2.13.1 Mon, 28 Oct, 11:49
Hyukjin Kwon (Jira) [jira] [Assigned] (SPARK-28158) Hive UDFs supports UDT type Mon, 28 Oct, 11:51
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-28158) Hive UDFs supports UDT type Mon, 28 Oct, 11:52
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29610) Keys with Null values are discarded when using to_json function Mon, 28 Oct, 12:24
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29601) JDBC ODBC Tab Statement column should be provided ellipsis for bigger SQL statement Mon, 28 Oct, 12:25
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-29602) How does the spark from_json json and dataframe transform ignore the case of the json key Mon, 28 Oct, 12:25
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29600) array_contains built in function is not backward compatible in 3.0 Mon, 28 Oct, 12:26
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29598) Support search option for statistics in JDBC/ODBC server page Mon, 28 Oct, 12:27
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29590) Support hiding table in JDBC/ODBC server page in WebUI Mon, 28 Oct, 12:28
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29573) Spark should work as PostgreSQL when using + Operator Mon, 28 Oct, 12:30
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29575) from_json can produce nulls for fields which are marked as non-nullable Mon, 28 Oct, 12:30
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29573) Spark should work as PostgreSQL when using + Operator Mon, 28 Oct, 12:31
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29561) Large Case Statement Code Generation OOM Mon, 28 Oct, 12:32
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29549) Union of DataSourceV2 datasources leads to duplicated results Mon, 28 Oct, 12:33
Hyukjin Kwon (Jira) [jira] [Updated] (SPARK-29510) JobGroup ID is not set for the job submitted from Spark-SQL and Spark -Shell Mon, 28 Oct, 12:37
Hyukjin Kwon (Jira) [jira] [Commented] (SPARK-29534) Hanging tasks in DiskBlockObjectWriter.commitAndGet while calling native FileDispatcherImpl.size0 Mon, 28 Oct, 12:37
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Box list
Feb 20212287
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189