spark-issues mailing list archives: April 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · Next »Thread · Author · Date
StephenZou (JIRA) [jira] [Updated] (SPARK-24096) create table as select not using hive.default.fileformat Thu, 26 Apr, 07:28
Steve Loughran (JIRA) [jira] [Updated] (SPARK-23807) Add Hadoop 3 profile with relevant POM fix ups Tue, 03 Apr, 20:16
Steve Loughran (JIRA) [jira] [Commented] (SPARK-22919) Bump Apache httpclient versions Mon, 09 Apr, 20:47
Steve Loughran (JIRA) [jira] [Commented] (SPARK-23966) Refactoring all checkpoint file writing logic in a common interface Fri, 13 Apr, 11:27
Steve Loughran (JIRA) [jira] [Created] (SPARK-23977) Add committer binding to Hadoop 3.1 PathOutputCommitter Mechanism Fri, 13 Apr, 12:40
Steve Loughran (JIRA) [jira] [Updated] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism Fri, 13 Apr, 12:53
Steve Loughran (JIRA) [jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version Tue, 24 Apr, 13:39
Steve Loughran (JIRA) [jira] [Commented] (SPARK-24000) S3A: Create Table should fail on invalid AK/SK Tue, 24 Apr, 15:04
Steve Loughran (JIRA) [jira] [Updated] (SPARK-23654) Cut jets3t as a dependency of spark-core Tue, 24 Apr, 19:48
Steve Loughran (JIRA) [jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version Wed, 25 Apr, 12:51
Steve Loughran (JIRA) [jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version Wed, 25 Apr, 13:03
Steve Loughran (JIRA) [jira] [Commented] (SPARK-13446) Spark need to support reading data from Hive 2.0.0 metastore Thu, 26 Apr, 10:46
Steve Loughran (JIRA) [jira] [Commented] (SPARK-23151) Provide a distribution of Spark with Hadoop 3.0 Thu, 26 Apr, 13:09
Sunitha Kambhampati (JIRA) [jira] [Commented] (SPARK-23993) Support DESC FORMATTED table_name column_name Mon, 30 Apr, 18:10
Susan X. Huynh (JIRA) [jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs Mon, 02 Apr, 19:13
Susan X. Huynh (JIRA) [jira] [Commented] (SPARK-19320) Allow guaranteed amount of GPU to be used when launching jobs Tue, 03 Apr, 02:08
Susan X. Huynh (JIRA) [jira] [Commented] (SPARK-22342) refactor schedulerDriver registration Mon, 09 Apr, 02:09
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23839) consider bucket join in cost-based JoinReorder rule Mon, 02 Apr, 08:50
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark Mon, 02 Apr, 09:15
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23791) Sub-optimal generated code for sum aggregating Mon, 02 Apr, 09:44
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23791) Sub-optimal generated code for sum aggregating Mon, 02 Apr, 09:52
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23797) SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Mon, 02 Apr, 09:57
Takeshi Yamamuro (JIRA) [jira] [Reopened] (SPARK-21870) Split codegen'd aggregation code into small functions for the HotSpot Mon, 02 Apr, 10:11
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-21870) Split codegen'd aggregation code into small functions for the HotSpot Mon, 02 Apr, 10:17
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23791) Sub-optimal generated code for sum aggregating Mon, 02 Apr, 10:19
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23839) consider bucket join in cost-based JoinReorder rule Mon, 02 Apr, 12:13
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-21363) Prevent column name duplication in temporary view Mon, 02 Apr, 23:04
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23791) Sub-optimal generated code for sum aggregating Tue, 03 Apr, 00:14
Takeshi Yamamuro (JIRA) [jira] [Resolved] (SPARK-23791) Sub-optimal generated code for sum aggregating Tue, 03 Apr, 00:15
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23856) Spark jdbc setQueryTimeout option Tue, 03 Apr, 11:02
Takeshi Yamamuro (JIRA) [jira] [Comment Edited] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark Thu, 05 Apr, 00:30
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-19842) Informational Referential Integrity Constraints Support in Spark Thu, 05 Apr, 00:31
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23880) table cache should be lazy and don't trigger any jobs. Fri, 06 Apr, 06:39
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream Thu, 12 Apr, 06:59
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23711) Add fallback to interpreted execution logic Thu, 19 Apr, 05:21
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24025) Join of bucketed and non-bucketed tables can give two exchanges and sorts for non-bucketed side Thu, 19 Apr, 22:30
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24043) InterpretedPredicate.eval fails if expression tree contains Nondeterministic expressions Mon, 23 Apr, 06:21
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24030) SparkSQL percentile_approx function is too slow for over 1,060,000 records. Mon, 23 Apr, 06:36
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24043) InterpretedPredicate.eval fails if expression tree contains Nondeterministic expressions Tue, 24 Apr, 05:43
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24043) InterpretedPredicate.eval fails if expression tree contains Nondeterministic expressions Tue, 24 Apr, 07:38
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24070) TPC-DS Performance Tests for Parquet 1.10.0 Upgrade Tue, 24 Apr, 23:34
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24070) TPC-DS Performance Tests for Parquet 1.10.0 Upgrade Wed, 25 Apr, 00:58
Takeshi Yamamuro (JIRA) [jira] [Created] (SPARK-24079) Update the nullability of Join output based on inferred predicates Wed, 25 Apr, 04:26
Takeshi Yamamuro (JIRA) [jira] [Created] (SPARK-24080) Update the nullability of Filter output based on inferred predicates Wed, 25 Apr, 04:29
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24070) TPC-DS Performance Tests for Parquet 1.10.0 Upgrade Wed, 25 Apr, 23:54
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-23856) Spark jdbc setQueryTimeout option Thu, 26 Apr, 12:26
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL Thu, 26 Apr, 22:22
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL Fri, 27 Apr, 03:39
Takeshi Yamamuro (JIRA) [jira] [Commented] (SPARK-24109) Remove class SnappyOutputStreamWrapper Fri, 27 Apr, 06:45
Takeshi Yamamuro (JIRA) [jira] [Created] (SPARK-24111) Add TPCDS v2.7 (latest) queries in TPCDSQueryBenchmark Fri, 27 Apr, 07:09
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23918) High-order function: array_min(x) → x Tue, 17 Apr, 08:53
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23918) High-order function: array_min(x) → x Tue, 17 Apr, 08:57
Takuya Ueshin (JIRA) [jira] [Created] (SPARK-24007) EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen. Wed, 18 Apr, 05:12
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23926) High-order function: reverse(x) → array Wed, 18 Apr, 09:41
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23926) High-order function: reverse(x) → array Wed, 18 Apr, 09:43
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23919) High-order function: array_position(x, element) → bigint Thu, 19 Apr, 02:59
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23919) High-order function: array_position(x, element) → bigint Thu, 19 Apr, 03:00
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23924) High-order function: element_at Thu, 19 Apr, 12:00
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23924) High-order function: element_at Thu, 19 Apr, 12:01
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23736) High-order function: concat(array1, array2, ..., arrayN) → array Fri, 20 Apr, 05:58
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23736) High-order function: concat(array1, array2, ..., arrayN) → array Fri, 20 Apr, 05:59
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23821) High-order function: flatten(x) → array Wed, 25 Apr, 02:19
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23821) High-order function: flatten(x) → array Wed, 25 Apr, 02:20
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23902) Provide an option in months_between UDF to disable rounding-off Thu, 26 Apr, 03:16
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23902) Provide an option in months_between UDF to disable rounding-off Thu, 26 Apr, 03:20
Takuya Ueshin (JIRA) [jira] [Assigned] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar Thu, 26 Apr, 04:37
Takuya Ueshin (JIRA) [jira] [Resolved] (SPARK-23916) High-order function: array_join(x, delimiter, null_replacement) → varchar Thu, 26 Apr, 04:38
Tamilselvan Veeramani (JIRA) [jira] [Commented] (SPARK-21476) RandomForest classification model not using broadcast in transform Mon, 23 Apr, 04:10
Tamilselvan Veeramani (JIRA) [jira] [Comment Edited] (SPARK-21476) RandomForest classification model not using broadcast in transform Mon, 23 Apr, 04:11
Tamilselvan Veeramani (JIRA) [jira] [Comment Edited] (SPARK-21476) RandomForest classification model not using broadcast in transform Mon, 23 Apr, 04:11
Tamilselvan Veeramani (JIRA) [jira] [Created] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch Thu, 26 Apr, 19:58
Tamilselvan Veeramani (JIRA) [jira] [Commented] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch Thu, 26 Apr, 20:03
Tamilselvan Veeramani (JIRA) [jira] [Updated] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch Thu, 26 Apr, 20:11
Tamilselvan Veeramani (JIRA) [jira] [Updated] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch Thu, 26 Apr, 20:15
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-23099) Migrate foreach sink Tue, 03 Apr, 18:07
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-23099) Migrate foreach sink Tue, 03 Apr, 18:07
Tathagata Das (JIRA) [jira] [Created] (SPARK-23966) Refactoring all checkpoint file writing logic in a common interface Wed, 11 Apr, 22:45
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-23748) Support select from temp tables Fri, 13 Apr, 03:02
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-23966) Refactoring all checkpoint file writing logic in a common interface Fri, 13 Apr, 23:32
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-23687) Add MemoryStream Tue, 17 Apr, 09:03
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-23687) Add MemoryStream Tue, 17 Apr, 09:03
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-23747) Add EpochCoordinator unit tests Tue, 17 Apr, 11:14
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-23747) Add EpochCoordinator unit tests Tue, 17 Apr, 11:14
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 00:43
Tathagata Das (JIRA) [jira] [Commented] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 00:43
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 00:57
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:09
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:09
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:10
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:11
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:11
Tathagata Das (JIRA) [jira] [Comment Edited] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:17
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:17
Tathagata Das (JIRA) [jira] [Updated] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 01:44
Tathagata Das (JIRA) [jira] [Created] (SPARK-24050) StreamingQuery does not calculate input / processing rates in some cases Mon, 23 Apr, 05:40
Tathagata Das (JIRA) [jira] [Updated] (SPARK-24050) StreamingQuery does not calculate input / processing rates in some cases Mon, 23 Apr, 06:21
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-23004) Structured Streaming raise "llegalStateException: Cannot remove after already committed or aborted" Mon, 23 Apr, 20:22
Tathagata Das (JIRA) [jira] [Created] (SPARK-24056) Make consumer creation lazy in Kafka source for Structured streaming Mon, 23 Apr, 21:06
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-24056) Make consumer creation lazy in Kafka source for Structured streaming Tue, 24 Apr, 21:35
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-24038) refactor continuous write exec to its own class Wed, 25 Apr, 00:09
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · Next »Thread · Author · Date
Box list
Feb 20212353
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189