spark-issues mailing list archives: July 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · Next »Thread · Author · Date
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25634) New Metrics in External Shuffle Service to help identify abusing application Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26373) Spark UI 'environment' tab - column to indicate default vs overridden values Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27669) Refactor DataFrameWriter to resolve datasources in a command Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28069) Switch log directory from Spark UI without restarting history server Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-20901) Feature parity for ORC with Parquet Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25239) Spark Streaming for Kafka should allow uniform batch size per partition for streaming RDD Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-23967) Description add native sql show in SQL page. Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25937) Support user-defined schema in Kafka Source & Sink Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24780) DataFrame.column_name should resolve to a distinct ref Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25963) Optimize generate followed by window Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25894) Include a count of the number of physical columns read for a columnar data source in the metadata of FileSourceScanExec Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27753) Support SQL expressions for interval parameter in Structured Streaming Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24148) Adding Ability to Specify SQL Type of Empty Arrays Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27171) Support Full-Partiton limit in the first scan Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25034) possible triple memory consumption in fetchBlockSync() Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27583) Optimize strongly connected components Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26769) partition prunning in inner join Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28158) Hive UDFs supports UDT type Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27790) Support SQL INTERVAL types Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27679) Improve queries with LIKE expression Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28227) Spark can’t support TRANSFORM with aggregation Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28050) DataFrameWriter support insertInto a specific table partition Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25513) Read zipped CSV and JSON files Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25236) Investigate using a logging library inside of PySpark on the workers instead of print Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27232) Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26439) Introduce WorkerOffer reservation mechanism for Barrier TaskSet Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28360) The serviceAccountName configuration item does not take effect in client mode. Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27388) expression encoder for avro objects Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28239) Allow TCP connections created by shuffle service auto close on YARN NodeManagers Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24914) totalSize is not a good estimate for broadcast joins Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27670) Add High available for Spark Hive thrift server. Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27841) Improve UTF8String fromString()/toString()/numChars() performance when strings are ASCII Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26302) retainedBatches configuration can eat up memory on driver Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27865) Spark SQL support 1:N sort merge bucket join without shuffle Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24528) Missing optimization for Aggregations/Windowing on a bucketed table Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24513) Attribute support in UnaryTransformer Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27561) Support "lateral column alias references" to allow column aliases to be used within SELECT clauses Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24443) comparison should accept structurally-equal types Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27929) make sql percentile function be able to receive double frq Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26912) Allow setting permission for event_log Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27799) Allow SerializerManager.canUseKryo whitelist to be extended via a configuration Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27789) Use stopEarly in codegen of ColumnarBatchScan Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27808) Ability to ignore existing files for structured streaming Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26173) Prior regularization for Logistic Regression Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26594) DataSourceOptions.asMap should return CaseInsensitiveMap Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28070) writeType and writeObject in SparkR should be handled by S3 methods Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27702) Allow using some alternatives for service accounts Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24611) Clean up OutputCommitCoordinator Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27734) Add memory based thresholds for shuffle spill Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27562) Complete the verification mechanism for shuffle transmitted data Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27568) readLock leaked when method take() called on a cached rdd Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-23676) Support left join codegen in SortMergeJoinExec Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24625) put all the backward compatible behavior change configs under spark.sql.legacy.* Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27962) Propagate subprocess stdout when subprocess exits with nonzero status in deploy.RRunner Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25121) Support multi-part column name for hint resolution Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24432) Add support for dynamic resource allocation Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26268) Decouple shuffle data from Spark deployment Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25569) Failing a Spark job when an accumulator cannot be updated Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26138) Cross join requires push LocalLimit in LimitPushDown rule Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25555) Generic constructs for windowing and support for custom windows Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24184) Allow escape comma in spark files Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26756) Support session conf for thriftserver Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27506) Function `from_avro` doesn't allow deserialization of data using other compatible schemas Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25083) remove the type erasure hack in data source scan Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25166) Reduce the number of write operations for shuffle write. Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-25355) Support --proxy-user for Spark on K8s Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-24994) When the data type of the field is converted to other types, it can also support pushdown to parquet Tue, 16 Jul, 16:42
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28182) Spark fails to download Hive 2.2+ jars from maven Tue, 16 Jul, 17:07
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27485) EnsureRequirements.reorder should handle duplicate expressions gracefully Tue, 16 Jul, 20:01
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28182) Spark fails to download Hive 2.2 and 2.3 jars from maven Tue, 16 Jul, 20:48
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-28182) Spark fails to download Hive 2.2 and 2.3 jars from maven Tue, 16 Jul, 21:26
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-18299) Allow more aggregations on KeyValueGroupedDataset Tue, 16 Jul, 23:37
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27485) EnsureRequirements.reorder should handle duplicate expressions gracefully Wed, 17 Jul, 01:02
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL Wed, 17 Jul, 22:12
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-28097) Map ByteType to SMALLINT when using JDBC with PostgreSQL Wed, 17 Jul, 22:12
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28138) Add timestamp.sql Thu, 18 Jul, 15:51
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-28138) Add timestamp.sql Thu, 18 Jul, 15:51
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28388) Port select_implicit.sql Thu, 18 Jul, 15:59
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-28388) Port select_implicit.sql Thu, 18 Jul, 15:59
Dongjoon Hyun (JIRA) [jira] [Created] (SPARK-28440) Use TestingUtils to compare floating point values Thu, 18 Jul, 18:36
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28440) Use TestingUtils to compare floating point values Thu, 18 Jul, 18:37
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument Thu, 18 Jul, 20:00
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28439) pyspark.sql.functions.array_repeat should support Column as count argument Thu, 18 Jul, 20:00
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28430) Some stage table rows render wrong number of columns if tasks are missing metrics Thu, 18 Jul, 20:17
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28312) Add numeric.sql Thu, 18 Jul, 20:51
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-28312) Add numeric.sql Thu, 18 Jul, 20:51
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-27707) Performance issue using explode Fri, 19 Jul, 06:34
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-27707) Performance issue using explode Fri, 19 Jul, 06:34
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-27707) Prune unnecessary nested fields from Generate Fri, 19 Jul, 06:34
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28440) Use TestingUtils to compare floating point values Fri, 19 Jul, 06:55
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-23758) MLlib 2.4 Roadmap Fri, 19 Jul, 08:02
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-23443) Spark with Glue as external catalog Fri, 19 Jul, 08:15
Dongjoon Hyun (JIRA) [jira] [Assigned] (SPARK-28440) Use TestingUtils to compare floating point values Fri, 19 Jul, 15:34
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0 Fri, 19 Jul, 15:47
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0 Fri, 19 Jul, 15:49
Dongjoon Hyun (JIRA) [jira] [Resolved] (SPARK-28433) Incorrect assertion in scala test for aarch64 platform Sat, 20 Jul, 00:00
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-28433) Incorrect assertion in scala test for aarch64 platform Sat, 20 Jul, 00:07
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-28433) Incorrect assertion in scala test for aarch64 platform Sat, 20 Jul, 00:08
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · Next »Thread · Author · Date
Box list
Feb 20212139
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189