spark-issues mailing list archives: November 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · 28 · Next »Thread · Author · Date
DB Tsai (JIRA) [jira] [Resolved] (SPARK-25946) Upgrade ASM to 7.x to support JDK11 Tue, 06 Nov, 05:40
DB Tsai (JIRA) [jira] [Assigned] (SPARK-25946) Upgrade ASM to 7.x to support JDK11 Tue, 06 Nov, 05:40
Xiao Li (JIRA) [jira] [Updated] (SPARK-24561) User-defined window functions with pandas udf (bounded window) Tue, 06 Nov, 05:43
e (JIRA) [jira] [Created] (SPARK-25948) Spark load floating point number is automatically rounded to an integer Tue, 06 Nov, 06:17
DB Tsai (JIRA) [jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11 Tue, 06 Nov, 06:17
e (JIRA) [jira] [Updated] (SPARK-25948) Spark load floating point number is automatically rounded to an integer Tue, 06 Nov, 06:22
e (JIRA) [jira] [Updated] (SPARK-25948) Spark load floating point number is automatically rounded to an integer Tue, 06 Nov, 06:26
e (JIRA) [jira] [Updated] (SPARK-25948) Spark load floating point number is automatically rounded to an integer Tue, 06 Nov, 06:26
e (JIRA) [jira] [Updated] (SPARK-25948) Spark load floating point number is automatically rounded to an integer Tue, 06 Nov, 06:27
Jackey Lee (JIRA) [jira] [Commented] (SPARK-25937) Support user-defined schema in Kafka Source & Sink Tue, 06 Nov, 08:56
Yuming Wang (JIRA) [jira] [Resolved] (SPARK-20389) Upgrade kryo to fix NegativeArraySizeException Tue, 06 Nov, 10:28
Yuanjian Li (JIRA) [jira] [Created] (SPARK-25949) Add test for optimize rule PullOutPythonUDFInJoinCondition Tue, 06 Nov, 12:25
Yuanjian Li (JIRA) [jira] [Updated] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition Tue, 06 Nov, 12:30
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition Tue, 06 Nov, 12:37
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition Tue, 06 Nov, 12:37
Apache Spark (JIRA) [jira] [Commented] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition Tue, 06 Nov, 12:37
Apache Spark (JIRA) [jira] [Commented] (SPARK-25949) Add test for optimizer rule PullOutPythonUDFInJoinCondition Tue, 06 Nov, 12:37
Maxim Gekk (JIRA) [jira] [Created] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Tue, 06 Nov, 13:15
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Tue, 06 Nov, 13:23
Apache Spark (JIRA) [jira] [Commented] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Tue, 06 Nov, 13:23
Apache Spark (JIRA) [jira] [Commented] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Tue, 06 Nov, 13:23
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Tue, 06 Nov, 13:23
Thomas Graves (JIRA) [jira] [Resolved] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator Tue, 06 Nov, 14:26
Thomas Graves (JIRA) [jira] [Assigned] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled Tue, 06 Nov, 14:27
Thomas Graves (JIRA) [jira] [Resolved] (SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled Tue, 06 Nov, 14:27
Ohad Raviv (JIRA) [jira] [Created] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 14:54
Ohad Raviv (JIRA) [jira] [Updated] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 15:02
Wenchen Fan (JIRA) [jira] [Assigned] (SPARK-25866) Update KMeans formatVersion Tue, 06 Nov, 15:21
Wenchen Fan (JIRA) [jira] [Resolved] (SPARK-25866) Update KMeans formatVersion Tue, 06 Nov, 15:21
Ohad Raviv (JIRA) [jira] [Updated] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 15:57
Apache Spark (JIRA) [jira] [Commented] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 16:10
Apache Spark (JIRA) [jira] [Commented] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 16:10
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 16:10
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25951) Redundant shuffle if column is renamed Tue, 06 Nov, 16:10
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11 Tue, 06 Nov, 17:27
Maxim Gekk (JIRA) [jira] [Created] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema Tue, 06 Nov, 17:37
shane knapp (JIRA) [jira] [Created] (SPARK-25953) install jdk11 on jenkins workers Tue, 06 Nov, 17:46
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema Tue, 06 Nov, 17:47
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema Tue, 06 Nov, 17:47
Apache Spark (JIRA) [jira] [Commented] (SPARK-25952) from_json returns wrong result if corrupt record column is in the middle of schema Tue, 06 Nov, 17:47
shane knapp (JIRA) [jira] [Updated] (SPARK-25953) install jdk11 on jenkins workers Tue, 06 Nov, 17:50
Dongjoon Hyun (JIRA) [jira] [Created] (SPARK-25954) Upgrade to Kafka 2.1.0 Tue, 06 Nov, 18:12
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0 Tue, 06 Nov, 18:14
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25876) Simplify configuration types in k8s backend Tue, 06 Nov, 18:29
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25876) Simplify configuration types in k8s backend Tue, 06 Nov, 18:29
Apache Spark (JIRA) [jira] [Commented] (SPARK-25876) Simplify configuration types in k8s backend Tue, 06 Nov, 18:29
Apache Spark (JIRA) [jira] [Commented] (SPARK-25876) Simplify configuration types in k8s backend Tue, 06 Nov, 18:30
Ted Yu (JIRA) [jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0 Tue, 06 Nov, 18:42
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0 Tue, 06 Nov, 18:50
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-25871) Streaming WAL should not use hdfs erasure coding, regardless of FS defaults Tue, 06 Nov, 18:54
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-25871) Streaming WAL should not use hdfs erasure coding, regardless of FS defaults Tue, 06 Nov, 18:54
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status Tue, 06 Nov, 19:37
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-25222) Spark on Kubernetes Pod Watcher dumps raw container status Tue, 06 Nov, 19:37
Maxim Gekk (JIRA) [jira] [Created] (SPARK-25955) Porting JSON test for CSV functions Tue, 06 Nov, 20:22
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25955) Porting JSON test for CSV functions Tue, 06 Nov, 20:29
Apache Spark (JIRA) [jira] [Commented] (SPARK-25955) Porting JSON test for CSV functions Tue, 06 Nov, 20:29
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25955) Porting JSON test for CSV functions Tue, 06 Nov, 20:29
Yinan Li (JIRA) [jira] [Commented] (SPARK-25922) [K8] Spark Driver/Executor "spark-app-selector" label mismatch Tue, 06 Nov, 20:31
Sean Owen (JIRA) [jira] [Commented] (SPARK-24421) sun.misc.Unsafe in JDK9+ Tue, 06 Nov, 20:40
DB Tsai (JIRA) [jira] [Created] (SPARK-25956) Make Scala 2.12 as default Scala version in Spark 3.0 Tue, 06 Nov, 21:37
Reynold Xin (JIRA) [jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources Tue, 06 Nov, 23:41
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-25676) Refactor BenchmarkWideTable to use main method Tue, 06 Nov, 23:44
Nagaram Prasad Addepally (JIRA) [jira] [Created] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support Wed, 07 Nov, 00:08
Nagaram Prasad Addepally (JIRA) [jira] [Updated] (SPARK-25957) Skip building spark-r docker image if spark distribution does not have R support Wed, 07 Nov, 00:09
DB Tsai (JIRA) [jira] [Updated] (SPARK-24422) Add JDK11 in our Jenkins' build servers Wed, 07 Nov, 00:11
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24771) Upgrade AVRO version from 1.7.7 to 1.8.2 Wed, 07 Nov, 00:26
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-17166) CTAS lost table properties after conversion to data source tables. Wed, 07 Nov, 00:37
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources Wed, 07 Nov, 01:08
Ruslan Dautkhanov (JIRA) [jira] [Created] (SPARK-25958) error: [Errno 97] Address family not supported by protocol in dataframe.take() Wed, 07 Nov, 01:09
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources Wed, 07 Nov, 01:10
Apache Spark (JIRA) [jira] [Commented] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns Wed, 07 Nov, 01:48
Apache Spark (JIRA) [jira] [Commented] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns Wed, 07 Nov, 01:48
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns Wed, 07 Nov, 01:48
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25947) Reduce memory usage in ShuffleExchangeExec by selecting only the sort columns Wed, 07 Nov, 01:48
Suraj Nayak (JIRA) [jira] [Created] (SPARK-25959) Difference in featureImportances results on computed vs saved models Wed, 07 Nov, 02:59
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Wed, 07 Nov, 03:27
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-25950) from_csv should respect to spark.sql.columnNameOfCorruptRecord Wed, 07 Nov, 03:27
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25098) Trim the string when cast stringToTimestamp and stringToDate Wed, 07 Nov, 05:31
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-25098) ‘Cast’ will return NULL when input string starts/ends with special character(s) Wed, 07 Nov, 05:31
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions Wed, 07 Nov, 06:23
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions Wed, 07 Nov, 06:25
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions Wed, 07 Nov, 06:40
Dongjoon Hyun (JIRA) [jira] [Closed] (SPARK-18466) Missing withFilter method causes warnings when using for comprehensions Wed, 07 Nov, 06:40
shahid (JIRA) [jira] [Commented] (SPARK-25959) Difference in featureImportances results on computed vs saved models Wed, 07 Nov, 06:43
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions Wed, 07 Nov, 06:47
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions in Scala 2.12 Wed, 07 Nov, 06:47
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions in Scala 2.12 Wed, 07 Nov, 06:48
Timothy Chen (JIRA) [jira] [Created] (SPARK-25960) Support subpath mounting with Kubernetes Wed, 07 Nov, 07:46
zengxl (JIRA) [jira] [Created] (SPARK-25961) 处理数据倾斜时使用随机数不支持 Wed, 07 Nov, 09:51
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext Wed, 07 Nov, 10:08
Apache Spark (JIRA) [jira] [Commented] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext Wed, 07 Nov, 10:08
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext Wed, 07 Nov, 10:08
Apache Spark (JIRA) [jira] [Commented] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext Wed, 07 Nov, 10:09
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-25962) Specify minimum versions for both pydocstyle and flake8 in 'lint-python' script Wed, 07 Nov, 10:47
Apache Spark (JIRA) [jira] [Commented] (SPARK-25962) Specify minimum versions for both pydocstyle and flake8 in 'lint-python' script Wed, 07 Nov, 10:55
Apache Spark (JIRA) [jira] [Commented] (SPARK-25962) Specify minimum versions for both pydocstyle and flake8 in 'lint-python' script Wed, 07 Nov, 10:55
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25962) Specify minimum versions for both pydocstyle and flake8 in 'lint-python' script Wed, 07 Nov, 10:55
Apache Spark (JIRA) [jira] [Assigned] (SPARK-25962) Specify minimum versions for both pydocstyle and flake8 in 'lint-python' script Wed, 07 Nov, 10:55
Imran Rashid (JIRA) [jira] [Assigned] (SPARK-25904) Avoid allocating arrays too large for JVMs Wed, 07 Nov, 12:20
Imran Rashid (JIRA) [jira] [Resolved] (SPARK-25904) Avoid allocating arrays too large for JVMs Wed, 07 Nov, 12:20
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · 28 · Next »Thread · Author · Date
Box list
Mar 202112
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189