spark-issues mailing list archives: October 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24122) Allow automatic driver restarts on K8s Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23686) Make better usage of org.apache.spark.ml.util.Instrumentation Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24617) Spark driver not requesting another executor once original executor exits due to 'lost worker' Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24585) Adding ability to audit file system before and after test to ensure all files are cleaned up. Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24750) HiveCaseSensitiveInferenceMode with INFER_AND_SAVE will show WRITE permission denied even if select table operation Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-18245) Improving support for bucketed table Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25107) Spark 2.2.0 Upgrade Issue : Throwing TreeNodeException: makeCopy, tree: CatalogRelation Errors Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-15516) Schema merging in driver fails for parquet when merging LongType and IntegerType Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-15691) Refactor and improve Hive support Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24266) Spark client terminates while driver is still running Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25219) KMeans Clustering - Text Data - Results are incorrect Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-15777) Catalog federation Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24550) Add support for Kubernetes specific metrics Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24114) improve instrumentation for spark.ml.recommendation Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20618) Support Custom Partitioners in PySpark Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24357) createDataFrame in Python infers large integers as long type and then fails silently when converting them Tue, 08 Oct, 05:42
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21016) Improve code fault tolerance for converting string to number Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24118) Support lineSep format independent from encoding Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22964) don't allow task restarts for continuous processing Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100) Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23498) Accuracy problem in comparison with string and integer Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24051) Incorrect results for certain queries using Java and Python APIs on Spark 2.3.0 Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22963) Make failure recovery global and automatic for continuous processing. Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21122) Address starvation issues when dynamic allocation is enabled Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20624) Add better handling for node shutdown Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24733) Dataframe saved to parquet can have different metadata then the resulting parquet file Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24426) Unexpected combination of cache and join on DataFrame Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20691) Difference between Storage Memory as seen internally and in web UI Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24448) File not found on the address SparkFiles.get returns on standalone cluster Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25459) Add viewOriginalText back to CatalogTable Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21927) scalastyle 1.0.0 generates SBT warnings Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24306) Sort a Dataset with a lambda (like RDD.sortBy) Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23210) Introduce the concept of default value to schema Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-13127) Upgrade Parquet to 1.9 (Fixes parquet sorting) Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-3727) Trees and ensembles: More prediction functionality Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17248) Add native Scala enum support to Dataset Encoders Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24258) SPIP: Improve PySpark support for ML Matrix and Vector types Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25263) Add scheduler integration test for SPARK-24909 Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23689) Spark 2.3.0/2.2.1 Some changes cause org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24011) Cache rdd's immediate parent ShuffleDependencies to accelerate getShuffleDependencies() Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-18649) sc.textFile(my_file).collect() raises socket.timeout on large files Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24866) Artifactual ROC scores when scaling up Random Forest classifier Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22440) Add Calinski-Harabasz index to ClusteringEvaluator Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22391) add `MetadataCreationSupport` trait to separate data and metadata handling at write path Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24218) Allow Configuration of DynamoDbEndpointUrl in KinesisReceiver Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25193) insert overwrite doesn't throw exception when drop old data fails Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-16217) Support SELECT INTO statement Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25198) org.apache.spark.sql.catalyst.parser.ParseException: DataType json is not supported. Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23705) dataframe.groupBy() may inadvertently receive sequence of non-distinct strings Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-13346) Using DataFrames iteratively leads to slow query planning Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20174) Analyzer gives mysterious AnalysisException when posexplode used in withColumn Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-19536) Improve capability to merge SQL data types Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21068) SparkR error message when passed an R object rather than Java object could be more informative Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24735) Improve exception when mixing up pandas_udf types Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24618) Allow ability to consume driver memory on worker hosts not master (option for clustermode to wait for returncode?) Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24362) SUM function precision issue Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20915) lpad/rpad with empty pad string different from MySQL Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22925) ml model persistence creates a lot of small files Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23954) Converting spark dataframe containing int64 fields to R dataframes leads to impredictable errors. Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-5362) Gradient and Optimizer to support generic output (instead of label) and data batches Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25242) Suggestion to make sql config setting fluent Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21722) Enable timezone-aware timestamp type when creating Pandas DataFrame. Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23742) Filter out redundant AssociationRules Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22743) Consolidate logic for handling spark.driver.memoryOverhead and spark.executor.memoryOverhead Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22926) Respect table-level conf compression codec `Compression` in multiple scenarios Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24841) Memory leak in converting spark dataframe to pandas dataframe Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17265) EdgeRDD Difference throws an exception Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23982) NoSuchMethodException: There is no startCredentialUpdater method in the object YarnSparkHadoopUtil Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23673) PySpark dayofweek does not conform with ISO 8601 Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22632) Fix the behavior of timestamp values for R's DataFrame to respect session timezone Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25070) BlockFetchingListener#onBlockFetchSuccess throw "java.util.NoSuchElementException: key not found: shuffle_8_68_113" on ShuffleBlockFetcherIterator caused stage hang long time Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23952) remove type parameter in DataReaderFactory Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23350) [SS]Exception when stopping continuous processing application Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-2620) case class cannot be used as key for reduce Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25316) Spark error - ERROR ContextCleaner: Error cleaning broadcast 22, Exception thrown in awaitResult: Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24693) Row order preservation for operations on MLlib IndexedRowMatrix Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-13998) HashingTF should extend UnaryTransformer Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24554) Add MapType Support for Arrow in PySpark Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24826) Self-Join not working in Apache Spark 2.2.2 Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23968) allow reading JSON that is composed of pure maps Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24084) Add job group id for query through spark-sql Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23056) parse_url regression when switched to using java.net.URI instead of java.net.URL Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24430) CREATE VIEW with UNION statement: Failed to recognize predicate 'UNION'. Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24298) PCAModel Memory in Pipeline Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17181) [Spark2.0 web ui]The status of the certain jobs is still displayed as running even if all the stages of this job have already finished Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24651) Add ability to write null values while writing JSON Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23171) Reduce the time costs of the rule runs that do not change the plans Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22869) 64KB JVM bytecode limit problem with filter Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23995) initial job has not accept any resources and executor keep exit Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-9140) Replace TimeTracker by Stopwatch Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-10795) FileNotFoundException while deploying pyspark job on cluster Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22004) CrossValidator, TrainValidationSplit dump sub models to disk when fitting: Scala API Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23681) Switch OrcFileFormat to newer hadoop.mapreduce output classes Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24844) spark REST API need to add ipFilter Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23337) withWatermark raises an exception on struct objects Tue, 08 Oct, 05:43
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Box list
Mar 2021466
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189