spark-issues mailing list archives: October 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23543) Automatic Module creation fails in Java 9 Tue, 08 Oct, 05:43
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23531) When explain, plan's output should include attribute type info Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22741) Add global aggregate for typed aggregation Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-7424) spark.ml classification, regression abstractions should add metadata to output column Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-19680) Offsets out of range with no configured reset policy for partitions Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24088) only HadoopRDD leverage HDFS Cache as preferred location Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23369) HiveClientSuites fails with unresolved dependency Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22035) the value of statistical logicalPlan.stats.sizeInBytes which is not expected Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24162) Support aliased literal values for Pivot "IN" clause Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24842) self-join query fails on different letter case for same field Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-14834) Force adding doc for new api in pyspark with @since annotation Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21389) ALS recommendForAll optimization uses Native BLAS Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24827) Some memory waste in History Server by strings in AccumulableInfo objects Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25593) JDBC write Impala, `truncate` true option in Overwrite mode for JDBC DataFrameWriter is dropping and creating the table instead of truncating. Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24524) Improve aggregateMetrics: less memory usage and loops Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23575) ERROR RetryingHMSHandler:159 - AlreadyExistsException(message: Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-9120) Add multivariate regression (or prediction) interface Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24264) [Structured Streaming] Remove 'mergeSchema' option from Parquet source configuration Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-18082) Locality Sensitive Hashing (LSH) - SignRandomProjection Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21707) Improvement a special case for non-deterministic filters in optimizer Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24269) Infer nullability rather than declaring all columns as nullable Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-19903) Watermark metadata is lost when using resolved attributes Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-16483) Unifying struct fields and columns Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23833) Incorrect primitive type check for input arguments of udf Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25008) Add memory mode info to showMemoryUsage in TaskMemoryManager Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23832) Adding possibility to set timestamp into KafkaRowWriter Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25397) SparkSession.conf fails when given default value with Python 3 Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21302) history server WebUI show HTTP ERROR 500 Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23074) Dataframe-ified zipwithindex Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-16203) regexp_extract to return an ArrayType(StringType()) Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23221) Fix KafkaContinuousSourceStressForDontFailOnDataLossSuite to run with enough cores Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24922) Iterative rdd union + reduceByKey operations on small dataset leads to "No space left on device" error on account of lot of shuffle spill. Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22202) Release tgz content differences for python and R Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24447) Pyspark RowMatrix.columnSimilarities() loses spark context Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20592) Alter table concatenate is not working as expected. Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-11136) Warm-start support for ML estimator Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20819) Enhance ColumnVector to keep UnsafeArrayData for other types Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20153) Support Multiple aws credentials in order to access multiple Hive on S3 table in spark application Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17694) convert DataFrame to DataSet should check columns match Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24410) Missing optimization for Union on bucketed tables Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24604) upgrade to spark 2.3.0 makes MPC model training slower Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23704) PySpark access of individual trees in random forest is slow Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24756) Incorrect Statistics Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-20074) Make buffer size in unsafe external sorter configurable Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24587) RDD.takeOrdered uses reduce, pulling all partition data to the driver Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24457) Performance improvement while converting stringToTimestamp in DateTimeUtils Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24382) Spark Structured Streaming aggregation on old timestamp data Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25340) Pushes down Sample beneath deterministic Project Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24616) Need to retreive free memory on command prompt on DSE cluster Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24358) createDataFrame in Python 3 should be able to infer bytes type as Binary type Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21166) Automated ML persistence Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24442) Add configuration parameter to adjust the numbers of records and the characters per row before truncation when a user runs.show() Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23790) proxy-user failed connecting to a kerberos configured metastore Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23983) Disable X-Frame-Options from Spark UI response headers if explicitly configured Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21443) Very long planning duration for queries with lots of operations Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24180) Using another dynamodb endpoint for kinesis Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22005) CrossValidator, TrainValidationSplit dump sub models to disk when fitting: Python API Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22132) Document the Dispatcher REST API Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24463) Add catalyst rule to reorder TypedFilters separated by Filters to reduce serde operations Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22954) ANALYZE TABLE fails with NoSuchTableException for temporary tables (but should have reported "not supported on views") Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24405) parameter for python worker timeout Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24456) Spark submit - server environment variables are overwritten by client environment variables Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24260) Support for multi-statement SQL in SparkSession.sql API Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24784) Retraining (each document as separate file) creates OOME Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-9775) Query Mesos for number of CPUs to set default parallelism Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24394) Nodes in decision tree sometimes have negative impurity values Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25537) spark.pyspark.driver.python when set in code doesnt work Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21730) Consider officially dropping PyPy pre-2.5 support Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-25109) spark python should retry reading another datanode if the first one fails to connect Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23777) Missing DAG arrows between stages Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-21405) Add LBFGS solver for GeneralizedLinearRegression Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-18492) GeneratedIterator grows beyond 64 KB Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24342) Large Task prior scheduling to Reduce overall execution time Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-17570) Avoid Hash and Exchange in Sort Merge join if bucketing factor is multiple for tables Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23650) Slow SparkR udf (dapply) Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23744) Memory leak in ReadableChannelFileRegion Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24144) monotonically_increasing_id on streaming dataFrames Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24838) Support uncorrelated IN/EXISTS subqueries for more operators Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23002) SparkUI inconsistent driver hostname compare with other executors Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23536) Update each Data frame row with a random value Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23655) Add support for type aclitem (PostgresDialect) Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22911) Migrate structured streaming sources to new DataSourceV2 APIs Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24469) Support collations in Spark SQL Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24731) java.io.IOException: s3n://bucketname: 400 : Bad Request Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22204) Explain output for SQL with commands shows no optimization Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23227) Add user guide entry for collecting sub models for cross-validation classes Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23563) make the size fo cache in CodeGenerator configable Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23745) Remove the directories of the “hive.downloaded.resources.dir” when HiveThriftServer2 stopped Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24512) SparkSQL ThriftServer port (ie 10015) supports TLSv1.0 Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22887) ML test for StructuredStreaming: spark.ml.fpm Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-23255) Add user guide and examples for DataFrame image reading functions Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24354) Adding support for quoteMode in Spark's build in CSV DataFrameWriter Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-22723) Add support for other data types and add mode info to ImageSchema Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24640) size(null) returns null Tue, 08 Oct, 05:44
Hyukjin Kwon (Jira) [jira] [Resolved] (SPARK-24390) confusion of columns in projection after WITH ROLLUP Tue, 08 Oct, 05:44
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · Next »Thread · Author · Date
Box list
Mar 2021106
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189