spark-issues mailing list archives: July 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · Next »Thread · Author · Date
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28550) Unset SPARK_HOME environment variable in K8S integration preparation Mon, 29 Jul, 06:34
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28534) Update node affinity for DockerForDesktop backend in PVTestsSuite Mon, 29 Jul, 07:30
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28534) Update node affinity for DockerForDesktop backend in PVTestsSuite Mon, 29 Jul, 07:30
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28522) Pass dynamic parameters to custom file input format Mon, 29 Jul, 07:35
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28086) Adds `random()` sql function Mon, 29 Jul, 11:19
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28086) Adds `random()` sql function Mon, 29 Jul, 11:19
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28522) Pass dynamic parameters to custom file input format Mon, 29 Jul, 11:21
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28546) Why does the File Sink operation of Spark 2.4 Structured Streaming include double-level version validation? Mon, 29 Jul, 11:28
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28556) Error should also be sent to QueryExecutionListener.onFailure Tue, 30 Jul, 02:49
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28559) when execute "create table" on ThriftServer ,the hive table owner is wrong Tue, 30 Jul, 09:26
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-26175) PySpark cannot terminate worker process if user program reads from stdin Wed, 31 Jul, 00:12
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-26175) PySpark cannot terminate worker process if user program reads from stdin Wed, 31 Jul, 00:12
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28038) Add text.sql Wed, 31 Jul, 02:37
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28038) Add text.sql Wed, 31 Jul, 02:37
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-25382) Remove ImageSchema.readImages in 3.0 Wed, 31 Jul, 05:28
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-25382) Remove ImageSchema.readImages in 3.0 Wed, 31 Jul, 05:28
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28578) Improve Github pull request template Wed, 31 Jul, 06:25
Ido Michael (JIRA) [jira] [Commented] (SPARK-28155) do not leak SaveMode to file source v2 Mon, 29 Jul, 15:24
Ievgen Prokhorenko (JIRA) [jira] [Created] (SPARK-28434) Decision Tree model isn't equal after save and load Thu, 18 Jul, 03:50
Ievgen Prokhorenko (JIRA) [jira] [Updated] (SPARK-28434) Decision Tree model isn't equal after save and load Thu, 18 Jul, 04:10
Imran Rashid (JIRA) [jira] [Commented] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit. Tue, 16 Jul, 18:15
Imran Rashid (JIRA) [jira] [Assigned] (SPARK-26755) Optimize Spark Scheduler to dequeue speculative tasks more efficiently Tue, 30 Jul, 14:56
Imran Rashid (JIRA) [jira] [Resolved] (SPARK-26755) Optimize Spark Scheduler to dequeue speculative tasks more efficiently Tue, 30 Jul, 14:56
Iskender Unlu (JIRA) [jira] [Commented] (SPARK-28090) Spark hangs when an execution plan has many projections on nested structs Mon, 01 Jul, 12:18
Iskender Unlu (JIRA) [jira] [Issue Comment Deleted] (SPARK-28090) Spark hangs when an execution plan has many projections on nested structs Mon, 01 Jul, 12:28
Iskender Unlu (JIRA) [jira] [Commented] (SPARK-28090) Spark hangs when an execution plan has many projections on nested structs Mon, 01 Jul, 12:29
Iskender Unlu (JIRA) [jira] [Commented] (SPARK-28015) Invalid date formats should throw an exception Tue, 02 Jul, 19:52
Iskender Unlu (JIRA) [jira] [Commented] (SPARK-28015) Invalid date formats should throw an exception Wed, 10 Jul, 09:28
Ivan Tsukanov (JIRA) [jira] [Created] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result Tue, 23 Jul, 03:27
Ivan Tsukanov (JIRA) [jira] [Updated] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result Tue, 23 Jul, 03:27
Ivan Tsukanov (JIRA) [jira] [Updated] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result Tue, 23 Jul, 05:51
Ivan Tsukanov (JIRA) [jira] [Commented] (SPARK-28480) Types of input parameters of a UDF affect the ability to cache the result Tue, 23 Jul, 06:03
Jayadevan M (JIRA) [jira] [Created] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't quotes in columns Wed, 10 Jul, 13:58
Jayadevan M (JIRA) [jira] [Updated] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't quotes in data Wed, 10 Jul, 13:59
Jayadevan M (JIRA) [jira] [Updated] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data Wed, 10 Jul, 23:41
Jayadevan M (JIRA) [jira] [Updated] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data Wed, 10 Jul, 23:43
Jayadevan M (JIRA) [jira] [Commented] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data Thu, 11 Jul, 12:45
Jesse Cai (JIRA) [jira] [Created] (SPARK-28355) Use Spark conf for threshold at which UDF is compressed by broadcast Thu, 11 Jul, 22:20
Jiajia Li (JIRA) [jira] [Created] (SPARK-28347) Error loading glibc library when generatting data on HDFS in K8S Thu, 11 Jul, 07:57
John Zhuge (JIRA) [jira] [Updated] (SPARK-28565) DataSourceV2: DataFrameWriter.saveAsTable Tue, 30 Jul, 16:39
John Zhuge (JIRA) [jira] [Created] (SPARK-28565) DataSourceV2: DataFrameWriter.saveAsTable Tue, 30 Jul, 16:39
Jorge Machado (JIRA) [jira] [Commented] (SPARK-24615) SPIP: Accelerator-aware task scheduling for Spark Thu, 11 Jul, 06:56
Jose Luis Pedrosa (JIRA) [jira] [Created] (SPARK-28258) Incopatibility betweek spark docker image and hadoop 3.2 and azure tools Fri, 05 Jul, 10:19
Jose Luis Pedrosa (JIRA) [jira] [Updated] (SPARK-28258) Incopatibility betweek spark docker image and hadoop 3.2 and azure tools Fri, 05 Jul, 10:44
Jose Torres (JIRA) [jira] [Created] (SPARK-28223) stream-stream joins should fail unsupported checker in update mode Mon, 01 Jul, 22:28
Jose Torres (JIRA) [jira] [Resolved] (SPARK-28223) stream-stream joins should fail unsupported checker in update mode Tue, 02 Jul, 17:01
Joseph K. Bradley (JIRA) [jira] [Resolved] (SPARK-23758) MLlib 2.4 Roadmap Fri, 19 Jul, 23:25
Joseph K. Bradley (JIRA) [jira] [Commented] (SPARK-23758) MLlib 2.4 Roadmap Fri, 19 Jul, 23:25
Joseph K. Bradley (JIRA) [jira] [Updated] (SPARK-23758) MLlib 2.4 Roadmap Fri, 19 Jul, 23:25
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28266) data correctness issue: data duplication when `path` serde peroperty is present Sun, 07 Jul, 18:10
Josh Rosen (JIRA) [jira] [Reopened] (SPARK-11309) Clean up hacky use of MemoryManager inside of HashedRelation Tue, 09 Jul, 15:10
Josh Rosen (JIRA) [jira] [Commented] (SPARK-27570) java.io.EOFException Reached the end of stream - Reading Parquet from Swift Wed, 10 Jul, 00:21
Josh Rosen (JIRA) [jira] [Commented] (SPARK-25966) "EOF Reached the end of stream with bytes left to read" while reading/writing to Parquets Wed, 10 Jul, 00:22
Josh Rosen (JIRA) [jira] [Comment Edited] (SPARK-27570) java.io.EOFException Reached the end of stream - Reading Parquet from Swift Wed, 10 Jul, 00:23
Josh Rosen (JIRA) [jira] [Created] (SPARK-28340) Noisy exceptions when tasks are killed: "DiskBlockObjectWriter: Uncaught exception while reverting partial writes to file: java.nio.channels.ClosedByInterruptException" Thu, 11 Jul, 00:06
Josh Rosen (JIRA) [jira] [Commented] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches Thu, 11 Jul, 00:28
Josh Rosen (JIRA) [jira] [Comment Edited] (SPARK-27991) ShuffleBlockFetcherIterator should take Netty constant-factor overheads into account when limiting number of simultaneous block fetches Thu, 11 Jul, 00:29
Josh Rosen (JIRA) [jira] [Resolved] (SPARK-23992) ShuffleDependency does not need to be deserialized every time Sun, 14 Jul, 22:36
Josh Rosen (JIRA) [jira] [Resolved] (SPARK-24786) Executors not being released after all cached data is unpersisted Sun, 14 Jul, 22:43
Josh Rosen (JIRA) [jira] [Commented] (SPARK-28304) FileFormatWriter introduces an uncoditional sort, even when all attributes are constants Mon, 15 Jul, 01:29
Josh Rosen (JIRA) [jira] [Commented] (SPARK-24079) Update the nullability of Join output based on inferred predicates Mon, 15 Jul, 02:31
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule Mon, 15 Jul, 03:42
Josh Rosen (JIRA) [jira] [Commented] (SPARK-28375) Enforce idempotence on the PullupCorrelatedPredicates optimizer rule Mon, 15 Jul, 19:10
Josh Rosen (JIRA) [jira] [Commented] (SPARK-28340) Noisy exceptions when tasks are killed: "DiskBlockObjectWriter: Uncaught exception while reverting partial writes to file: java.nio.channels.ClosedByInterruptException" Mon, 15 Jul, 19:28
Josh Rosen (JIRA) [jira] [Commented] (SPARK-28340) Noisy exceptions when tasks are killed: "DiskBlockObjectWriter: Uncaught exception while reverting partial writes to file: java.nio.channels.ClosedByInterruptException" Mon, 15 Jul, 19:31
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28049) i want to a first ticket in zira Mon, 15 Jul, 22:11
Josh Rosen (JIRA) [jira] [Updated] (SPARK-10914) UnsafeRow serialization breaks when two machines have different Oops size Tue, 16 Jul, 22:49
Josh Rosen (JIRA) [jira] [Updated] (SPARK-27406) UnsafeArrayData serialization breaks when two machines have different Oops size Tue, 16 Jul, 22:51
Josh Rosen (JIRA) [jira] [Comment Edited] (SPARK-27406) UnsafeArrayData serialization breaks when two machines have different Oops size Tue, 16 Jul, 22:52
Josh Rosen (JIRA) [jira] [Commented] (SPARK-27416) UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines have different Oops size Tue, 16 Jul, 22:56
Josh Rosen (JIRA) [jira] [Comment Edited] (SPARK-27416) UnsafeMapData & UnsafeArrayData Kryo serialization breaks when two machines have different Oops size Tue, 16 Jul, 22:57
Josh Rosen (JIRA) [jira] [Updated] (SPARK-27134) array_distinct function does not work correctly with columns containing array of array Wed, 17 Jul, 00:45
Josh Rosen (JIRA) [jira] [Updated] (SPARK-26864) Query may return incorrect result when python udf is used as a join condition and the udf uses attributes from both legs of left semi join. Wed, 17 Jul, 00:57
Josh Rosen (JIRA) [jira] [Updated] (SPARK-26352) join reordering should not change the order of output attributes Wed, 17 Jul, 01:28
Josh Rosen (JIRA) [jira] [Updated] (SPARK-26021) -0.0 and 0.0 not treated consistently, doesn't match Hive Wed, 17 Jul, 01:30
Josh Rosen (JIRA) [jira] [Created] (SPARK-28427) Support more Postgres JSON functions Wed, 17 Jul, 17:22
Josh Rosen (JIRA) [jira] [Commented] (SPARK-27570) java.io.EOFException Reached the end of stream - Reading Parquet from Swift Wed, 17 Jul, 23:56
Josh Rosen (JIRA) [jira] [Created] (SPARK-28430) Some stage table rows render wrong number of columns if tasks are missing metrics Thu, 18 Jul, 00:04
Josh Rosen (JIRA) [jira] [Assigned] (SPARK-28430) Some stage table rows render wrong number of columns if tasks are missing metrics Thu, 18 Jul, 00:05
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28430) Some stage table rows render wrong number of columns if tasks are missing metrics Thu, 18 Jul, 00:05
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28430) Some stage table rows render wrong number of columns if tasks are missing metrics Thu, 18 Jul, 00:05
Josh Rosen (JIRA) [jira] [Comment Edited] (SPARK-27570) java.io.EOFException Reached the end of stream - Reading Parquet from Swift Thu, 18 Jul, 00:29
Josh Rosen (JIRA) [jira] [Created] (SPARK-28477) Rewrite `CASE WHEN cond THEN ifTrue OTHERWISE ifFalse` END into `IF(cond, ifTrue, ifFalse` Tue, 23 Jul, 01:59
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28477) Rewrite `CASE WHEN cond THEN ifTrue OTHERWISE ifFalse` END into `IF(cond, ifTrue, ifFalse)` Tue, 23 Jul, 01:59
Josh Rosen (JIRA) [jira] [Created] (SPARK-28478) Optimizer rule to remove unnecessary explicit null checks for null-intolerant expressions (e.g. if(x is null, x, f(x))) Tue, 23 Jul, 02:03
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28481) More expressions should extend NullIntolerant Tue, 23 Jul, 04:44
Josh Rosen (JIRA) [jira] [Created] (SPARK-28481) More expressions should extend NullIntolerant Tue, 23 Jul, 04:44
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28481) More expressions should extend NullIntolerant Tue, 23 Jul, 04:45
Josh Rosen (JIRA) [jira] [Updated] (SPARK-28481) More expressions should extend NullIntolerant Tue, 23 Jul, 04:45
Josh Rosen (JIRA) [jira] [Commented] (SPARK-24079) Update the nullability of Join output based on inferred predicates Tue, 23 Jul, 04:51
Josh Rosen (JIRA) [jira] [Updated] (SPARK-27282) Spark incorrect results when using UNION with GROUP BY clause Tue, 23 Jul, 04:53
Josh Rosen (JIRA) [jira] [Commented] (SPARK-16754) NPE when defining case class and searching Encoder in the same line Thu, 25 Jul, 20:38
Josh Rosen (JIRA) [jira] [Commented] (SPARK-28481) More expressions should extend NullIntolerant Mon, 29 Jul, 21:59
Josh Rosen (JIRA) [jira] [Comment Edited] (SPARK-28481) More expressions should extend NullIntolerant Mon, 29 Jul, 21:59
Jrex Ge (JIRA) [jira] [Created] (SPARK-28231) Adaptive execution should ignore RepartitionByExpression Tue, 02 Jul, 09:37
Jrex Ge (JIRA) [jira] [Updated] (SPARK-28231) Adaptive execution should ignore RepartitionByExpression Tue, 02 Jul, 09:40
Jrex Ge (JIRA) [jira] [Updated] (SPARK-28231) Adaptive execution should ignore RepartitionByExpression Mon, 08 Jul, 02:59
Juan Antonio (JIRA) [jira] [Commented] (SPARK-27689) Error to execute hive views with spark Thu, 11 Jul, 07:48
Juarez Rudsatz (JIRA) [jira] [Created] (SPARK-28505) Add data source option for omitting partitioned columns when saving to file Wed, 24 Jul, 16:54
Jungtaek Lim (JIRA) [jira] [Commented] (SPARK-28247) Flaky test: "query without test harness" in ContinuousSuite Thu, 04 Jul, 07:21
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · Next »Thread · Author · Date
Box list
Feb 20212082
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189