spark-issues mailing list archives: October 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · Next »Thread · Author · Date
Sean Owen (JIRA) [jira] [Commented] (SPARK-22242) streaming job failed to restart from checkpoint Fri, 13 Oct, 11:44
Steve Loughran (JIRA) [jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed Fri, 13 Oct, 12:35
Apache Spark (JIRA) [jira] [Commented] (SPARK-22228) Add support for Array<primitive_type> so from_json can parse Fri, 13 Oct, 12:45
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22228) Add support for Array<primitive_type> so from_json can parse Fri, 13 Oct, 12:45
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22228) Add support for Array<primitive_type> so from_json can parse Fri, 13 Oct, 12:45
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed Fri, 13 Oct, 14:04
Li Jin (JIRA) [jira] [Created] (SPARK-22274) Used-defined aggregation functions with pandas udf Fri, 13 Oct, 14:04
Li Jin (JIRA) [jira] [Updated] (SPARK-22274) Used-defined aggregation functions with pandas udf Fri, 13 Oct, 14:05
Apache Spark (JIRA) [jira] [Commented] (SPARK-22252) FileFormatWriter should respect the input query schema Fri, 13 Oct, 15:09
Wenchen Fan (JIRA) [jira] [Resolved] (SPARK-14387) Enable Hive-1.x ORC compatibility with spark.sql.hive.convertMetastoreOrc Fri, 13 Oct, 15:14
Wenchen Fan (JIRA) [jira] [Assigned] (SPARK-14387) Enable Hive-1.x ORC compatibility with spark.sql.hive.convertMetastoreOrc Fri, 13 Oct, 15:25
Wenchen Fan (JIRA) [jira] [Resolved] (SPARK-16628) OrcConversions should not convert an ORC table represented by MetastoreRelation to HadoopFsRelation if metastore schema does not match schema stored in ORC files Fri, 13 Oct, 15:26
Wenchen Fan (JIRA) [jira] [Assigned] (SPARK-16628) OrcConversions should not convert an ORC table represented by MetastoreRelation to HadoopFsRelation if metastore schema does not match schema stored in ORC files Fri, 13 Oct, 15:26
Wenchen Fan (JIRA) [jira] [Resolved] (SPARK-18355) Spark SQL fails to read data from a ORC hive table that has a new column added to it Fri, 13 Oct, 15:26
Wenchen Fan (JIRA) [jira] [Assigned] (SPARK-18355) Spark SQL fails to read data from a ORC hive table that has a new column added to it Fri, 13 Oct, 15:27
Steve Loughran (JIRA) [jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed Fri, 13 Oct, 15:33
Patrick Duin (JIRA) [jira] [Commented] (SPARK-22247) Hive partition filter very slow Fri, 13 Oct, 15:42
Apache Spark (JIRA) [jira] [Commented] (SPARK-22249) UnsupportedOperationException: empty.reduceLeft when caching a dataframe Fri, 13 Oct, 16:02
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22249) UnsupportedOperationException: empty.reduceLeft when caching a dataframe Fri, 13 Oct, 16:02
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22249) UnsupportedOperationException: empty.reduceLeft when caching a dataframe Fri, 13 Oct, 16:02
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed Fri, 13 Oct, 16:13
Sathiya Kumar (JIRA) [jira] [Updated] (SPARK-22181) ReplaceExceptWithNotFilter if one or both of the datasets are fully derived out of Filters from a same parent Fri, 13 Oct, 16:16
Sathiya Kumar (JIRA) [jira] [Updated] (SPARK-22181) ReplaceExceptWithFilter if one or both of the datasets are fully derived out of Filters from a same parent Fri, 13 Oct, 16:17
Marcelo Vanzin (JIRA) [jira] [Reopened] (SPARK-22269) Java style checks should be run in Jenkins Fri, 13 Oct, 16:35
Wenchen Fan (JIRA) [jira] [Resolved] (SPARK-21247) Type comparision should respect case-sensitive SQL conf Fri, 13 Oct, 16:37
Wenchen Fan (JIRA) [jira] [Assigned] (SPARK-21247) Type comparision should respect case-sensitive SQL conf Fri, 13 Oct, 16:38
Marcelo Vanzin (JIRA) [jira] [Created] (SPARK-22275) ReplayListenerSuite doesn't clean up properly after itself Fri, 13 Oct, 17:07
Sean Owen (JIRA) [jira] [Commented] (SPARK-22269) Java style checks should be run in Jenkins Fri, 13 Oct, 17:08
Marcelo Vanzin (JIRA) [jira] [Commented] (SPARK-22269) Java style checks should be run in Jenkins Fri, 13 Oct, 17:11
sam (JIRA) [jira] [Commented] (SPARK-17998) Reading Parquet files coalesces parts into too few in-memory partitions Fri, 13 Oct, 17:13
sam (JIRA) [jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data Fri, 13 Oct, 17:15
Marcelo Vanzin (JIRA) [jira] [Commented] (SPARK-22275) ReplayListenerSuite doesn't clean up properly after itself Fri, 13 Oct, 17:16
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-22275) SparkContext doesn't clean up after itself when "fatal" errors occur Fri, 13 Oct, 17:17
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-22275) SparkContext doesn't clean up after itself when "fatal" errors occur Fri, 13 Oct, 17:17
Sean Owen (JIRA) [jira] [Commented] (SPARK-22269) Java style checks should be run in Jenkins Fri, 13 Oct, 17:25
Steve Loughran (JIRA) [jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed Fri, 13 Oct, 18:12
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed Fri, 13 Oct, 18:47
Yuval Degani (JIRA) [jira] [Commented] (SPARK-22229) SPIP: RDMA Accelerated Shuffle Engine Fri, 13 Oct, 19:06
Fernando Pereira (JIRA) [jira] [Commented] (SPARK-22250) Be less restrictive on type checking Fri, 13 Oct, 19:26
Fernando Pereira (JIRA) [jira] [Comment Edited] (SPARK-22250) Be less restrictive on type checking Fri, 13 Oct, 19:29
Fernando Pereira (JIRA) [jira] [Created] (SPARK-22276) Unnecessary repartitioning Fri, 13 Oct, 19:43
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-22136) Implement stream-stream outer joins in append mode Fri, 13 Oct, 21:21
Cheburakshu (JIRA) [jira] [Created] (SPARK-22277) Chi Square selector garbling Vector content. Fri, 13 Oct, 21:31
Huaxin Gao (JIRA) [jira] [Commented] (SPARK-22271) Describe results in "null" for the value of "mean" of a numeric variable Fri, 13 Oct, 22:32
Huaxin Gao (JIRA) [jira] [Comment Edited] (SPARK-22271) Describe results in "null" for the value of "mean" of a numeric variable Fri, 13 Oct, 22:35
Bago Amirbekian (JIRA) [jira] [Updated] (SPARK-22232) Row objects in pyspark created using the `Row(**kwars)` syntax do not get serialized/deserialized properly Fri, 13 Oct, 23:30
rohit verma (JIRA) [jira] [Resolved] (SPARK-22262) Failed to recover Spark Structured Streaming job from checkpoint location Fri, 13 Oct, 23:33
Tathagata Das (JIRA) [jira] [Assigned] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null Sat, 14 Oct, 00:11
Tathagata Das (JIRA) [jira] [Created] (SPARK-22278) Expose current event time watermark and current processing time in GroupState Sat, 14 Oct, 00:16
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-11034) Launcher: add support for monitoring Mesos apps Sat, 14 Oct, 00:19
Apache Spark (JIRA) [jira] [Commented] (SPARK-22278) Expose current event time watermark and current processing time in GroupState Sat, 14 Oct, 00:20
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22278) Expose current event time watermark and current processing time in GroupState Sat, 14 Oct, 00:20
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22278) Expose current event time watermark and current processing time in GroupState Sat, 14 Oct, 00:20
Jayesh lalwani (JIRA) [jira] [Commented] (SPARK-20883) Improve StateStore APIs for efficiency Sat, 14 Oct, 01:37
Apache Spark (JIRA) [jira] [Commented] (SPARK-22271) Describe results in "null" for the value of "mean" of a numeric variable Sat, 14 Oct, 05:14
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22271) Describe results in "null" for the value of "mean" of a numeric variable Sat, 14 Oct, 05:14
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22271) Describe results in "null" for the value of "mean" of a numeric variable Sat, 14 Oct, 05:14
Xiao Li (JIRA) [jira] [Resolved] (SPARK-21762) FileFormatWriter/BasicWriteTaskStatsTracker metrics collection fails if a new file isn't yet visible Sat, 14 Oct, 06:09
Apache Spark (JIRA) [jira] [Commented] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs Sat, 14 Oct, 06:25
Xiao Li (JIRA) [jira] [Resolved] (SPARK-22273) Fix key/value schema field names in HashMapGenerators. Sat, 14 Oct, 06:27
Sean Owen (JIRA) [jira] [Resolved] (SPARK-22255) SPARK-22255 FileAppender InputStream Read timeout and blocking state Sat, 14 Oct, 08:22
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-22233) filter out empty InputSplit in HadoopRDD Sat, 14 Oct, 08:39
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-22233) filter out empty InputSplit in HadoopRDD Sat, 14 Oct, 08:40
Apache Spark (JIRA) [jira] [Commented] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform Sat, 14 Oct, 14:12
Apache Spark (JIRA) [jira] [Assigned] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform Sat, 14 Oct, 14:12
Apache Spark (JIRA) [jira] [Assigned] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform Sat, 14 Oct, 14:12
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-15731) orc writer directory permissions Sat, 14 Oct, 18:45
Dongjoon Hyun (JIRA) [jira] [Created] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default Sat, 14 Oct, 18:49
Apache Spark (JIRA) [jira] [Commented] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default Sat, 14 Oct, 18:53
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default Sat, 14 Oct, 18:53
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22279) Turn on spark.sql.hive.convertMetastoreOrc by default Sat, 14 Oct, 18:53
CasterKKK (JIRA) [jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12 Sat, 14 Oct, 23:51
Tathagata Das (JIRA) [jira] [Resolved] (SPARK-22238) EnsureStatefulOpPartitioning shouldn't ask for the child RDD before planning is completed Sun, 15 Oct, 00:40
Dongjoon Hyun (JIRA) [jira] [Created] (SPARK-22280) Improve StatisticsSuite to test `convertMetastoreXXX` properly Sun, 15 Oct, 03:36
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 03:40
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 03:40
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 03:40
Apache Spark (JIRA) [jira] [Commented] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 03:45
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 03:45
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 03:45
Liang-Chi Hsieh (JIRA) [jira] [Comment Edited] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures Sun, 15 Oct, 04:03
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:10
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:11
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:12
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:14
Saisai Shao (JIRA) [jira] [Commented] (SPARK-22242) streaming job failed to restart from checkpoint Sun, 15 Oct, 04:18
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:19
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:21
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:21
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly Sun, 15 Oct, 04:23
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22223) ObjectHashAggregate introduces unnecessary shuffle Sun, 15 Oct, 06:08
Apache Spark (JIRA) [jira] [Assigned] (SPARK-22223) ObjectHashAggregate introduces unnecessary shuffle Sun, 15 Oct, 06:08
Apache Spark (JIRA) [jira] [Commented] (SPARK-22223) ObjectHashAggregate introduces unnecessary shuffle Sun, 15 Oct, 06:08
Sean Owen (JIRA) [jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12 Sun, 15 Oct, 06:37
Sean Owen (JIRA) [jira] [Commented] (SPARK-22272) killing task may cause the executor progress hang because of the JVM bug Sun, 15 Oct, 07:47
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-22249) UnsupportedOperationException: empty.reduceLeft when caching a dataframe Sun, 15 Oct, 15:32
Sohum Sachdev (JIRA) [jira] [Commented] (SPARK-21459) Some aggregation functions change the case of nested field names Sun, 15 Oct, 16:00
Felix Cheung (JIRA) [jira] [Created] (SPARK-22281) Handle R method breaking signature changes Sun, 15 Oct, 21:37
Felix Cheung (JIRA) [jira] [Commented] (SPARK-22281) Handle R method breaking signature changes Sun, 15 Oct, 21:40
Dongjoon Hyun (JIRA) [jira] [Created] (SPARK-22282) Remove OrcRelation.ORC_COMPRESSION Mon, 16 Oct, 00:53
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · Next »Thread · Author · Date
Box list
Mar 2021797
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189