spark-issues mailing list archives: February 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-25194) Kubernetes - Define cpu and memory limit to init container Tue, 12 Feb, 19:54
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24903) Allow driver container name to be configurable in k8 spark Tue, 12 Feb, 19:56
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-24793) Make spark-submit more useful with k8s Tue, 12 Feb, 19:58
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system Tue, 12 Feb, 19:58
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24751) [k8s] Relaunch failed executor pods Tue, 12 Feb, 19:59
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24249) Spark on kubernetes, pods crashes with spark sql job. Tue, 12 Feb, 20:09
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24247) [K8S] currentNodeToLocalTaskCount is unused in KubernetesClusterSchedulerBackend Tue, 12 Feb, 20:10
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24105) Spark 2.3.0 on kubernetes Tue, 12 Feb, 20:14
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions” Tue, 12 Feb, 20:35
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-13829) Spark submit with keytab can't submit to a non-HDFS yarn cluster Tue, 12 Feb, 20:38
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-13232) YARN executor node label expressions Tue, 12 Feb, 20:41
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-12516) Properly handle NM failure situation for Spark on Yarn Tue, 12 Feb, 20:44
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-11662) Call startExecutorDelegationTokenRenewer() ahead of client app submission Tue, 12 Feb, 20:45
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-11323) Add History Service Provider to service application histories from YARN timeline server Tue, 12 Feb, 20:45
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-11315) Add YARN extension service to publish Spark events to YARN timeline service Tue, 12 Feb, 20:46
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-11182) HDFS Delegation Token will be expired when calling "UserGroupInformation.getCurrentUser.addCredentials" in HA mode Tue, 12 Feb, 20:47
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-10766) Add some configurations for the client process in yarn-cluster mode. Tue, 12 Feb, 20:48
Marcelo Vanzin (JIRA) [jira] [Comment Edited] (SPARK-10766) Add some configurations for the client process in yarn-cluster mode. Tue, 12 Feb, 20:50
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-10288) Add a rest client for Spark on Yarn Tue, 12 Feb, 20:52
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-10288) Add a rest client for Spark on Yarn Tue, 12 Feb, 20:52
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-9468) Avoid scheduling tasks on preemption executors Tue, 12 Feb, 20:53
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-7941) Cache Cleanup Failure when job is killed by Spark Tue, 12 Feb, 20:55
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-7007) Add metrics source for ExecutorAllocationManager to expose internal status Tue, 12 Feb, 20:56
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-2624) Datanucleus jars not accessible in yarn-cluster mode Tue, 12 Feb, 20:57
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-26650) Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' Tue, 12 Feb, 21:02
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-26650) Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' Tue, 12 Feb, 21:02
Marcelo Vanzin (JIRA) [jira] [Commented] (SPARK-26650) Yarn Client throws 'ClassNotFoundException: org.apache.hadoop.hbase.HBaseConfiguration' Tue, 12 Feb, 21:02
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-26101) Spark Pipe() executes the external app by yarn username not the current username Tue, 12 Feb, 21:05
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-25869) Spark on YARN: the original diagnostics is missing when job failed maxAppAttempts times Tue, 12 Feb, 21:06
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-25869) Spark on YARN: the original diagnostics is missing when job failed maxAppAttempts times Tue, 12 Feb, 21:06
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24700) AM shutdown terminates streaming application but marks it as successful Tue, 12 Feb, 21:14
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-24205) java.util.concurrent.locks.LockSupport.parkNanos Tue, 12 Feb, 21:16
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-23497) Sparklyr Applications doesn't disconnect spark driver in client mode Tue, 12 Feb, 21:17
Maziyar PANAHI (JIRA) [jira] [Commented] (SPARK-26101) Spark Pipe() executes the external app by yarn username not the current username Tue, 12 Feb, 21:19
Sean Owen (JIRA) [jira] [Updated] (SPARK-23408) Flaky test: StreamingOuterJoinSuite.left outer early state exclusion on right Tue, 12 Feb, 21:20
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-22760) where driver is stopping, and some executors lost because of YarnSchedulerBackend.stop, then there is a problem. Tue, 12 Feb, 21:21
Marcelo Vanzin (JIRA) [jira] [Commented] (SPARK-26101) Spark Pipe() executes the external app by yarn username not the current username Tue, 12 Feb, 21:22
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-22341) [2.3.0] cannot run Spark on Yarn when Yarn impersonation is turned off Tue, 12 Feb, 21:23
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-22199) Spark Job on YARN fails with executors "Slave registration failed" Tue, 12 Feb, 21:24
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-21933) Spark Streaming request more executors than excepted without DynamicAllocation Tue, 12 Feb, 21:25
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-19941) Spark should not schedule tasks on executors on decommissioning YARN nodes Tue, 12 Feb, 21:29
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-19894) Tasks entirely assigned to one executor on Yarn-cluster mode for default-rack Tue, 12 Feb, 21:32
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-19649) Spark YARN client throws exception if job succeeds and max-completed-applications=0 Tue, 12 Feb, 21:33
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-15955) Failed Spark application returns with exitcode equals to zero Tue, 12 Feb, 21:35
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-17667) Make locking fine grained in YarnAllocator#enqueueGetLossReasonRequest Tue, 12 Feb, 21:36
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-18898) Exception not failing Scala applications (in yarn) Tue, 12 Feb, 21:36
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-17209) Support manual credential updating in the run-time for Spark on YARN Tue, 12 Feb, 21:37
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-17209) Support manual credential updating in the run-time for Spark on YARN Tue, 12 Feb, 21:37
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-15974) Create a socket on YARN AM start-up Tue, 12 Feb, 21:39
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-13852) handle the InterruptedException caused by YARN HA switch Tue, 12 Feb, 21:40
Dongjoon Hyun (JIRA) [jira] [Updated] (SPARK-26859) Reading ORC files with explicit schema can result in wrong data Tue, 12 Feb, 21:40
Dongjoon Hyun (JIRA) [jira] [Commented] (SPARK-26859) Reading ORC files with explicit schema can result in wrong data Tue, 12 Feb, 21:43
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-1537) Add integration with Yarn's Application Timeline Server Tue, 12 Feb, 21:43
Dongjoon Hyun (JIRA) [jira] [Comment Edited] (SPARK-26859) Reading ORC files with explicit schema can result in wrong data Tue, 12 Feb, 21:44
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-1502) Spark on Yarn: add config option to not include yarn/mapred cluster classpath Tue, 12 Feb, 21:45
Marcelo Vanzin (JIRA) [jira] [Assigned] (SPARK-1502) Spark on Yarn: add config option to not include yarn/mapred cluster classpath Tue, 12 Feb, 21:45
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-1502) Spark on Yarn: add config option to not include yarn/mapred cluster classpath Tue, 12 Feb, 21:46
t oo (JIRA) [jira] [Commented] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Tue, 12 Feb, 22:10
Marcelo Vanzin (JIRA) [jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build Tue, 12 Feb, 22:14
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26769) partition prunning in inner join Tue, 12 Feb, 22:16
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26800) JDBC - MySQL nullable option is ignored Tue, 12 Feb, 22:16
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26770) Misleading/unhelpful error message when wrapping a null in an Option Tue, 12 Feb, 22:16
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26631) Issue while reading Parquet data from Hadoop Archive files (.har) Tue, 12 Feb, 22:18
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26589) proper `median` method for spark dataframe Tue, 12 Feb, 22:18
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26560) Repeating select on udf function throws analysis exception - function not registered Tue, 12 Feb, 22:19
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26436) Dataframe resulting from a GroupByKey and flatMapGroups operation throws java.lang.UnsupportedException when groupByKey is applied on it. Tue, 12 Feb, 22:20
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26509) Parquet DELTA_BYTE_ARRAY is not supported in Spark 2.x's Vectorized Reader Tue, 12 Feb, 22:20
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-26417) Make comments for states available for logging Tue, 12 Feb, 22:22
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26320) udf with multiple arrays as input Tue, 12 Feb, 22:24
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-26279) Remove unused method in Logging Tue, 12 Feb, 22:24
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26325) Interpret timestamp fields in Spark while reading json (timestampFormat) Tue, 12 Feb, 22:24
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26240) [pyspark] Updating illegal column names with withColumnRenamed does not change schema changes, causing pyspark.sql.utils.AnalysisException Tue, 12 Feb, 22:25
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-26150) __spark_conf__XXX.zip doesn't exist Tue, 12 Feb, 22:27
Marcelo Vanzin (JIRA) [jira] [Updated] (SPARK-25987) StackOverflowError when executing many operations on a table with many columns Tue, 12 Feb, 22:28
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-25917) Spark UI's executors page loads forever when memoryMetrics in None. Fix is to JSON ignore memorymetrics when it is None. Tue, 12 Feb, 22:30
Marcelo Vanzin (JIRA) [jira] [Commented] (SPARK-26395) Spark Thrift server memory leak Tue, 12 Feb, 22:47
Xiangrui Meng (JIRA) [jira] [Commented] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark Tue, 12 Feb, 22:54
Xiangrui Meng (JIRA) [jira] [Comment Edited] (SPARK-24374) SPIP: Support Barrier Execution Mode in Apache Spark Tue, 12 Feb, 22:55
Marcelo Vanzin (JIRA) [jira] [Resolved] (SPARK-26588) Idle executor should properly be killed when no job is submitted Tue, 12 Feb, 22:58
t oo (JIRA) [jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0 Tue, 12 Feb, 23:32
Bruce Robbins (JIRA) [jira] [Updated] (SPARK-26851) CachedRDDBuilder only partially implements double-checked locking Tue, 12 Feb, 23:35
Tao Luo (JIRA) [jira] [Commented] (SPARK-21492) Memory leak in SortMergeJoin Wed, 13 Feb, 00:05
Nan Zhu (JIRA) [jira] [Resolved] (SPARK-26862) assertion failed in ParquetRowConverter Wed, 13 Feb, 00:30
Yuri Budilov (JIRA) [jira] [Commented] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Wed, 13 Feb, 00:45
Dilip Biswal (JIRA) [jira] [Created] (SPARK-26864) Query may return incorrect result when python udf is used as a join condition and the udf uses attributes from both legs of left semi join. Wed, 13 Feb, 01:13
Apache Spark (JIRA) [jira] [Assigned] (SPARK-26864) Query may return incorrect result when python udf is used as a join condition and the udf uses attributes from both legs of left semi join. Wed, 13 Feb, 01:20
Apache Spark (JIRA) [jira] [Assigned] (SPARK-26864) Query may return incorrect result when python udf is used as a join condition and the udf uses attributes from both legs of left semi join. Wed, 13 Feb, 01:20
Takeshi Yamamuro (JIRA) [jira] [Resolved] (SPARK-26857) Return UnsafeArrayData for date/timestamp type in ColumnarArray.copy() Wed, 13 Feb, 01:29
Jungtaek Lim (JIRA) [jira] [Commented] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Wed, 13 Feb, 01:55
Jungtaek Lim (JIRA) [jira] [Comment Edited] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Wed, 13 Feb, 01:57
Jungtaek Lim (JIRA) [jira] [Comment Edited] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Wed, 13 Feb, 02:13
Jungtaek Lim (JIRA) [jira] [Comment Edited] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Wed, 13 Feb, 02:14
zhoukang (JIRA) [jira] [Commented] (SPARK-26703) Hive record writer will always depends on parquet-1.6 writer should fix it Wed, 13 Feb, 02:36
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-26320) udf with multiple arrays as input Wed, 13 Feb, 02:41
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call Wed, 13 Feb, 02:45
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-26777) SQL worked in 2.3.2 and fails in 2.4.0 Wed, 13 Feb, 02:54
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-26860) RangeBetween docs appear to be wrong Wed, 13 Feb, 02:58
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-23534) Spark run on Hadoop 3.0.0 Wed, 13 Feb, 03:01
Wenchen Fan (JIRA) [jira] [Created] (SPARK-26865) ORC filter pushdown should be case insensitive by default Wed, 13 Feb, 03:04
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-26240) [pyspark] Updating illegal column names with withColumnRenamed does not change schema changes, causing pyspark.sql.utils.AnalysisException Wed, 13 Feb, 03:04
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Box list
Mar 2021410
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189