spark-issues mailing list archives: October 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23536) Update each Data frame row with a random value Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23655) Add support for type aclitem (PostgresDialect) Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22911) Migrate structured streaming sources to new DataSourceV2 APIs Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24469) Support collations in Spark SQL Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24731) java.io.IOException: s3n://bucketname: 400 : Bad Request Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22204) Explain output for SQL with commands shows no optimization Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23227) Add user guide entry for collecting sub models for cross-validation classes Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23563) make the size fo cache in CodeGenerator configable Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23745) Remove the directories of the “hive.downloaded.resources.dir” when HiveThriftServer2 stopped Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24512) SparkSQL ThriftServer port (ie 10015) supports TLSv1.0 Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22887) ML test for StructuredStreaming: spark.ml.fpm Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23255) Add user guide and examples for DataFrame image reading functions Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24354) Adding support for quoteMode in Spark's build in CSV DataFrameWriter Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22723) Add support for other data types and add mode info to ImageSchema Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24640) size(null) returns null Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24390) confusion of columns in projection after WITH ROLLUP Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23994) Add Host To Blacklist If Shuffle Cannot Complete Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24904) Join with broadcasted dataframe causes shuffle of redundant data Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25377) spark sql dataframe cache is invalid Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23258) Should not split Arrow record batches based on row count Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-16707) TransportClientFactory.createClient may throw NPE Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23981) ShuffleBlockFetcherIterator - Spamming Logs Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25361) Support for Kinesis Client Library 2.0 Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24474) Cores are left idle when there are a lot of tasks to run Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24560) Fix some getTimeAsMs as getTimeAsSeconds Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-15882) Discuss distributed linear algebra in spark.ml package Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-16534) Kafka 0.10 Python support Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24095) Spark Streaming performance drastically drops when when saving dataframes with withColumn Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21624) Optimize communication cost of RF/GBT/DT Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23442) Reading from partitioned and bucketed table uses only bucketSpec.numBuckets partitions in all cases Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-14585) Provide accessor methods for Pipeline stages Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22105) Dataframe has poor performance when computing on many columns with codegen Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25230) Upper behavior incorrect for string contains "ß" Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25215) Make PipelineModel public Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23073) Fix incorrect R doc page header for generated sql functions Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22943) OneHotEncoder supports manual specification of categorySizes Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23571) Delete auxiliary Kubernetes resources upon application completion Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24946) PySpark - Allow np.Arrays and pd.Series in df.approxQuantile Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24440) When use constant as column we may get wrong answer versus impala Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24059) When blacklist disable always hash to a bad local directory may cause job failure Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24986) OOM in BufferHolder during writes to a stream Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25329) Support passing Kerberos configuration information Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22461) Move Spark ML model summaries into a dedicated package Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22823) Race Condition when reading Broadcast shuffle input. Failed to get broadcast piece Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24830) Problem with logging on Glassfish Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24074) Maven package resolver downloads javadoc instead of jar Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17877) Can not checkpoint connectedComponents resulting graph Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23485) Kubernetes should support node blacklist Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21972) Allow users to control input data persistence in ML Estimators via a handlePersistence ml.Param Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24202) Separate SQLContext dependency from SparkSession.implicits Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25059) Exception while executing an action on DataFrame that read Json Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23058) Show create table can't show non printable field delim Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-3723) DecisionTree, RandomForest: Add more instrumentation Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24210) incorrect handling of boolean expressions when using column in expressions in pyspark.sql.DataFrame filter function Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25480) Dynamic partitioning + saveAsTable with multiple partition columns create empty directory Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-10413) ML models should support prediction on single instances Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20598) Iterative checkpoints do not get removed from HDFS Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23612) Specify formats for individual DateType and TimestampType columns in schemas Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24200) Read subdirectories with out asterisks Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24406) Exposing custom spark scala ml transformers in pyspark Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25024) Update mesos documentation to be clear about security supported Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25244) [Python] Setting `spark.sql.session.timeZone` only partially respected Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24608) report number of iteration/progress for ML training Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22868) 64KB JVM bytecode limit problem with aggregation Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25125) Spark SQL percentile_approx takes longer than Hive version for large datasets Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22055) Port release scripts Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-7206) Gaussian Mixture Model (GMM) improvements Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25165) Cannot parse Hive Struct Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17129) Support statistics collection and cardinality estimation for partitioned tables Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24265) lintr checks not failing PR build Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25232) Support Full-Text Search in Spark SQL Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24568) Code refactoring for DataType equalsXXX methods Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23322) Launcher handles can miss application updates if application finishes too quickly Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22054) Allow release managers to inject their keys Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23452) Extend test coverage to all ORC readers Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23632) sparkR.session() error with spark packages - JVM is not ready after 10 seconds Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24461) Snapshot Cache Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21812) PySpark ML Models should not depend transfering params from Java Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-12449) Pushing down arbitrary logical plans to data sources Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-8696) Streaming API for Online LDA Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24650) GroupingSet Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24862) Spark Encoder is not consistent to scala case class semantic for multiple argument lists Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24597) Spark ML Pipeline Should support non-linear models => DAGPipeline Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-15694) Implement ScriptTransformation in sql/core Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24845) spark distribution generate exception while locally worked correctly Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22658) SPIP: TeansorFlowOnSpark as a Scalable Deep Learning Lib of Apache Spark Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24623) Hadoop - Spark Cluster - Python XGBoost - Not working in distributed mode Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-19498) Discussion: Making MLlib APIs extensible for 3rd party libraries Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17602) PySpark - Performance Optimization Large Size of Broadcast Variable Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24016) Yarn does not update node blacklist in static allocation Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23068) Jekyll doc build error does not fail build Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24106) Spark Structure Streaming with RF model taking long time in processing probability for each mini batch Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22780) make insert commands have real children to fix UI issues Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-8767) Abstractions for InputColParam, OutputColParam Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20885) JDBC predicate pushdown uses hardcoded date format Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20782) Dataset's isCached operator Tue, 08 Oct, 05:45
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24640) size(null) returns null Tue, 08 Oct, 11:58
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Box list
Mar 2021470
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189