spark-issues mailing list archives: December 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · 28 · 29 · Next »Thread · Author · Date
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2381) streaming receiver crashed,but seems nothing happened Thu, 11 Dec, 21:12
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2368) Improve io.netty related handlers and clients in network.netty Thu, 11 Dec, 21:20
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2402) DiskBlockObjectWriter should update the initial position when reusing this object Thu, 11 Dec, 21:33
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2542) Exit Code Class should be renamed and placed package properly Thu, 11 Dec, 21:49
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2671) BlockObjectWriter should create parent directory when the directory doesn't exist Thu, 11 Dec, 21:53
Sean Owen (JIRA) [jira] [Commented] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement Thu, 11 Dec, 21:59
Sean Owen (JIRA) [jira] [Commented] (SPARK-2770) Rename spark-ganglia-lgpl to ganglia-lgpl Thu, 11 Dec, 22:12
Sean Owen (JIRA) [jira] [Commented] (SPARK-2750) Add Https support for Web UI Thu, 11 Dec, 22:16
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2715) ExternalAppendOnlyMap adds max limit of times and max limit of disk bytes written for spilling Thu, 11 Dec, 22:23
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard-coded case class) Thu, 11 Dec, 22:24
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2896) Remove redundant error notification by results.put() when fetching from remote Thu, 11 Dec, 22:47
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2872) Fix conflict between code and doc in YarnClientSchedulerBackend Thu, 11 Dec, 22:50
Sean Owen (JIRA) [jira] [Resolved] (SPARK-2947) DAGScheduler resubmit the stage into an infinite loop Thu, 11 Dec, 22:58
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3099) Staging Directory is never deleted when we run job with YARN Client Mode Thu, 11 Dec, 23:06
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3038) delete history server logs when there are too many logs Thu, 11 Dec, 23:28
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3124) Jar version conflict in the assembly package Fri, 12 Dec, 00:24
Sean Owen (JIRA) [jira] [Commented] (SPARK-3358) PySpark worker fork()ing performance regression in m3.* / PVM instances Fri, 12 Dec, 00:28
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3352) Rename Flume Polling stream to Pull Based stream Fri, 12 Dec, 00:29
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3229) spark.shuffle.safetyFraction and spark.storage.safetyFraction is not documented Fri, 12 Dec, 00:32
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3201) Yarn Client do not support the "-X" java opts Fri, 12 Dec, 00:35
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3548) Display cache hit ratio on WebUI Fri, 12 Dec, 00:44
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3433) Mima false-positives with @DeveloperAPI and @Experimental annotations Fri, 12 Dec, 00:47
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3719) Spark UI: "complete/failed stages" is better to show the total number of stages Fri, 12 Dec, 00:50
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3712) add a new UpdateDStream to update a rdd dynamically Fri, 12 Dec, 00:51
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3689) FileLogger should create new instance of FileSystem regardless of it's scheme Fri, 12 Dec, 00:52
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3663) Document SPARK_LOG_DIR and SPARK_PID_DIR Fri, 12 Dec, 00:54
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3636) It is not friendly to interrupt a Job when user passes different storageLevels to a RDD Fri, 12 Dec, 01:13
Sean Owen (JIRA) [jira] [Commented] (SPARK-4817) [streaming]Print the specified number of data and handle all of the elements in RDD Fri, 12 Dec, 12:21
Sean Owen (JIRA) [jira] [Resolved] (SPARK-3989) Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command Fri, 12 Dec, 12:26
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4187) External shuffle service should not use Java serializer Fri, 12 Dec, 12:41
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4168) Completed Stages Number are misleading webUI when stages are more than 1000 Fri, 12 Dec, 12:43
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4103) Clean up SessionState in HiveContext Fri, 12 Dec, 12:47
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4074) No exception for drop nonexistent table Fri, 12 Dec, 12:49
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4009) HiveTableScan should use makeRDDForTable instead of makeRDDForPartitionedTable for partitioned table when partitionPruningPred is None Fri, 12 Dec, 12:50
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4354) 14/11/12 09:39:00 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, HYD-RNDNW-VFRCO-RCORE2): java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy Fri, 12 Dec, 12:53
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4260) Httpbroadcast should set connection timeout. Fri, 12 Dec, 12:56
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4530) GradientDescent get a wrong gradient value according to the gradient formula, which is caused by the miniBatchSize parameter. Fri, 12 Dec, 12:59
Sean Owen (JIRA) [jira] [Updated] (SPARK-4422) In some cases, Vectors.fromBreeze get wrong results. Fri, 12 Dec, 13:03
Sean Owen (JIRA) [jira] [Commented] (SPARK-4838) StackOverflowError when serialization task Sat, 13 Dec, 11:29
Sean Owen (JIRA) [jira] [Commented] (SPARK-4840) Incorrect documentation of master url on Running Spark on Mesos page Sat, 13 Dec, 14:16
Sean Owen (JIRA) [jira] [Commented] (SPARK-4845) Adding a parallelismRatio to control the partitions num of shuffledRDD Mon, 15 Dec, 13:57
Sean Owen (JIRA) [jira] [Commented] (SPARK-4844) SGD should support custom sampling. Mon, 15 Dec, 13:58
Sean Owen (JIRA) [jira] [Commented] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield "OutOfMemoryError: Requested array size exceeds VM limit" Mon, 15 Dec, 14:12
Sean Owen (JIRA) [jira] [Commented] (SPARK-4846) When the vocabulary size is large, Word2Vec may yield "OutOfMemoryError: Requested array size exceeds VM limit" Mon, 15 Dec, 15:22
Sean Owen (JIRA) [jira] [Commented] (SPARK-4844) SGD should support custom sampling. Mon, 15 Dec, 15:42
Sean Owen (JIRA) [jira] [Commented] (SPARK-4838) StackOverflowError when serialization task Tue, 16 Dec, 03:09
Sean Owen (JIRA) [jira] [Commented] (SPARK-2709) Add a tool for certifying Spark API compatiblity Tue, 16 Dec, 11:47
Sean Owen (JIRA) [jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl Tue, 16 Dec, 11:49
Sean Owen (JIRA) [jira] [Commented] (SPARK-4777) Some block memory after unrollSafely not count into used memory(memoryStore.entrys or unrollMemory) Tue, 16 Dec, 11:51
Sean Owen (JIRA) [jira] [Commented] (SPARK-2709) Add a tool for certifying Spark API compatiblity Tue, 16 Dec, 12:22
Sean Owen (JIRA) [jira] [Commented] (SPARK-1148) Suggestions for exception handling (avoid potential bugs) Tue, 16 Dec, 21:11
Sean Owen (JIRA) [jira] [Resolved] (SPARK-1148) Suggestions for exception handling (avoid potential bugs) Tue, 16 Dec, 22:10
Sean Owen (JIRA) [jira] [Commented] (SPARK-4872) Provide sample format of training/test data in MLlib programming guide Wed, 17 Dec, 09:42
Sean Owen (JIRA) [jira] [Commented] (SPARK-4872) Provide sample format of training/test data in MLlib programming guide Thu, 18 Dec, 10:01
Sean Owen (JIRA) [jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution Thu, 18 Dec, 11:17
Sean Owen (JIRA) [jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution Thu, 18 Dec, 12:13
Sean Owen (JIRA) [jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution Thu, 18 Dec, 20:32
Sean Owen (JIRA) [jira] [Commented] (SPARK-4872) Provide sample format of training/test data in MLlib programming guide Fri, 19 Dec, 09:22
Sean Owen (JIRA) [jira] [Commented] (SPARK-4094) checkpoint should still be available after rdd actions Fri, 19 Dec, 09:46
Sean Owen (JIRA) [jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution Fri, 19 Dec, 10:06
Sean Owen (JIRA) [jira] [Commented] (SPARK-4910) build failed Sat, 20 Dec, 18:36
Sean Owen (JIRA) [jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution Sun, 21 Dec, 10:42
Sean Owen (JIRA) [jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution Mon, 22 Dec, 10:13
Sean Owen (JIRA) [jira] [Commented] (SPARK-4919) Can Spark SQL thrift server UI provide JOB kill operate or any REST API? Mon, 22 Dec, 12:52
Sean Owen (JIRA) [jira] [Commented] (SPARK-4920) current spark version in UI is not striking Mon, 22 Dec, 15:51
Sean Owen (JIRA) [jira] [Commented] (SPARK-4907) Inconsistent loss and gradient in LeastSquaresGradient compared with R Mon, 22 Dec, 17:27
Sean Owen (JIRA) [jira] [Commented] (SPARK-4926) Spark manipulate Hbase Tue, 23 Dec, 08:51
Sean Owen (JIRA) [jira] [Commented] (SPARK-4936) Please support Named Vector so as to maintain the record ID in clustering etc. Tue, 23 Dec, 14:08
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4938) Adding optimization to simplify the filter condition Tue, 23 Dec, 15:06
Sean Owen (JIRA) [jira] [Commented] (SPARK-4956) Vector Initialization error when initialize a Sparse Vector by calling Vectors.sparse(size, indices, values) Wed, 24 Dec, 12:55
Sean Owen (JIRA) [jira] [Commented] (SPARK-4971) fix typo in BlockGenerator Fri, 26 Dec, 08:51
Sean Owen (JIRA) [jira] [Commented] (SPARK-4971) fix typo in BlockGenerator Fri, 26 Dec, 09:00
Sean Owen (JIRA) [jira] [Commented] (SPARK-4787) Resource unreleased during failure in SparkContext initialization Fri, 26 Dec, 09:27
Sean Owen (JIRA) [jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem Sat, 27 Dec, 09:52
Sean Owen (JIRA) [jira] [Commented] (SPARK-2722) Mechanism for escaping spark configs is not consistent Sat, 27 Dec, 19:05
Sean Owen (JIRA) [jira] [Commented] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times Sat, 27 Dec, 19:13
Sean Owen (JIRA) [jira] [Commented] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries Sun, 28 Dec, 09:06
Sean Owen (JIRA) [jira] [Resolved] (SPARK-4978) Core dump when running any example with prebuilt Hadoop 2.4 binaries Sun, 28 Dec, 20:40
Sean Owen (JIRA) [jira] [Commented] (SPARK-4962) Put TaskScheduler.start back in SparkContext to shorten cluster resources occupation period Sun, 28 Dec, 20:58
Sean Owen (JIRA) [jira] [Commented] (SPARK-4990) Search SPARK_CONF_DIR first when --properties-file is not specified Mon, 29 Dec, 09:16
Sean Owen (JIRA) [jira] [Commented] (SPARK-4992) Prominent Python example has bad, beginner style Mon, 29 Dec, 10:53
Sean Owen (JIRA) [jira] [Updated] (SPARK-4992) Prominent Python example has bad, beginner style Mon, 29 Dec, 11:10
Sean Owen (JIRA) [jira] [Commented] (SPARK-4996) Memory leak? Mon, 29 Dec, 16:17
Sean Owen (JIRA) [jira] [Updated] (SPARK-4992) Prominent Python example has bad, beginner style Mon, 29 Dec, 16:31
Sean Owen (JIRA) [jira] [Updated] (SPARK-4992) Prominent Python example has bad, beginner style Mon, 29 Dec, 16:31
Sean Owen (JIRA) [jira] [Commented] (SPARK-2757) Add Mima test for Spark Sink after 1.10 is released Mon, 29 Dec, 17:19
Sean Owen (JIRA) [jira] [Commented] (SPARK-1272) Don't fail job if some local directories are buggy Mon, 29 Dec, 17:21
Sean Owen (JIRA) [jira] [Commented] (SPARK-4992) Prominent Python example has bad, beginner style Tue, 30 Dec, 09:35
Sean Owen (JIRA) [jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0 Tue, 30 Dec, 09:57
Sean Owen (JIRA) [jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0 Tue, 30 Dec, 10:49
Sean Owen (JIRA) [jira] [Commented] (SPARK-5001) BlockRDD removed unreasonablly in streaming Tue, 30 Dec, 10:51
Sean Owen (JIRA) [jira] [Commented] (SPARK-4997) Check if Spark's conf needs to be put ahead of Hadoop's (for log4j purposes) Tue, 30 Dec, 11:10
Sean Owen (JIRA) [jira] [Commented] (SPARK-5005) Failed to start spark-shell when using yarn-client mode with the Spark1.2.0 Tue, 30 Dec, 11:29
Sean Owen (JIRA) [jira] [Commented] (SPARK-4923) Maven build should keep publishing spark-repl Tue, 30 Dec, 16:04
Sean Owen (JIRA) [jira] [Commented] (SPARK-5033) Spark 1.1.0/1.1.1/1.2.0 can't run well in HDP on Windows Wed, 31 Dec, 09:18
Sean Owen (JIRA) [jira] [Commented] (SPARK-5034) Spark on Yarn within HDInsight on Windows Wed, 31 Dec, 09:22
Shekhar Bansal (JIRA) [jira] [Created] (SPARK-4968) [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used Thu, 25 Dec, 16:21
Shekhar Bansal (JIRA) [jira] [Updated] (SPARK-4968) [SparkSQL] java.lang.UnsupportedOperationException when hive partition doesn't exist and order by and limit are used Thu, 25 Dec, 16:22
Shenghua Wan (JIRA) [jira] [Created] (SPARK-4854) Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI Mon, 15 Dec, 19:27
Shenghua Wan (JIRA) [jira] [Commented] (SPARK-4854) Custom UDTF with Lateral View throws ClassNotFound exception in Spark SQL CLI Mon, 15 Dec, 19:29
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · 27 · 28 · 29 · Next »Thread · Author · Date
Box list
Mar 2021166
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189