spark-user mailing list archives: May 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Ted Yu Re: spark 1.6.1 build failure of : scala-maven-plugin Tue, 03 May, 02:43
Ted Yu Re: spark 1.6.1 build failure of : scala-maven-plugin Tue, 03 May, 03:21
Ted Yu Re: spark 1.6.1 build failure of : scala-maven-plugin Wed, 04 May, 01:34
Ted Yu Re: Spark Select Statement Wed, 04 May, 13:44
Ted Yu Re: restrict my spark app to run on specific machines Wed, 04 May, 14:42
Ted Yu Re: IS spark have CapacityScheduler? Wed, 04 May, 17:15
Ted Yu Re: Performance with Insert overwrite into Hive Table. Wed, 04 May, 17:29
Ted Yu Re: SqlContext parquet read OutOfMemoryError: Requested array size exceeds VM limit error Wed, 04 May, 22:01
Ted Yu Re: DeepSpark: where to start Thu, 05 May, 03:05
Ted Yu Re: [Spark 1.5.2 ]-how to set and get Storage level for Dataframe Fri, 06 May, 03:16
Ted Yu Re: Updating Values Inside Foreach Rdd loop Fri, 06 May, 13:39
Ted Yu Re: getting NullPointerException while doing left outer join Fri, 06 May, 14:40
Ted Yu Re: Adhoc queries on Spark 2.0 with Structured Streaming Fri, 06 May, 21:11
Ted Yu Re: Updating Values Inside Foreach Rdd loop Sat, 07 May, 03:28
Ted Yu Re: How to verify if spark is using kryo serializer for shuffle Sat, 07 May, 18:58
Ted Yu Re: Is it a bug? Sun, 08 May, 13:17
Ted Yu Re: How to verify if spark is using kryo serializer for shuffle Sun, 08 May, 13:39
Ted Yu Re: How to verify if spark is using kryo serializer for shuffle Sun, 08 May, 16:33
Ted Yu Re: java.lang.NoClassDefFoundError: kafka/api/TopicMetadataRequest Mon, 09 May, 11:12
Ted Yu Re: Is it a bug? Mon, 09 May, 11:46
Ted Yu Re: Accessing Cassandra data from Spark Shell Tue, 10 May, 04:27
Ted Yu Re: Save DataFrame to HBase Tue, 10 May, 22:11
Ted Yu Re: Will the HiveContext cause memory leak ? Wed, 11 May, 03:50
Ted Yu Re: java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration cannot be cast to [B Wed, 11 May, 11:58
Ted Yu Re: dataframe udf functioin will be executed twice when filter on new column created by withColumn Wed, 11 May, 14:49
Ted Yu Re: Save DataFrame to HBase Wed, 11 May, 17:20
Ted Yu Re: Datasets is extremely slow in comparison to RDD in standalone mode WordCount examlpe Wed, 11 May, 18:02
Ted Yu Re: kryo Wed, 11 May, 21:32
Ted Yu Re: kryo Thu, 12 May, 19:48
Ted Yu Re: How to get and save core dump of native library in executors Thu, 12 May, 21:40
Ted Yu Re: Will the HiveContext cause memory leak ? Fri, 13 May, 01:59
Ted Yu Re: Spark 2.0.0-snapshot: IllegalArgumentException: requirement failed: chunks must be non-empty Fri, 13 May, 16:17
Ted Yu Re: Tracking / estimating job progress Fri, 13 May, 17:10
Ted Yu Re: Executor memory requirement for reduceByKey Fri, 13 May, 19:20
Ted Yu Re: strange behavior when I chain data frame transformations Fri, 13 May, 19:38
Ted Yu Re: System memory 186646528 must be at least 4.718592E8. Fri, 13 May, 19:51
Ted Yu Re: Executors and Cores Sun, 15 May, 14:30
Ted Yu Re: orgin of error Sun, 15 May, 15:50
Ted Yu Re: orgin of error Sun, 15 May, 16:42
Ted Yu Re: spark udf can not change a json string to a map Sun, 15 May, 16:44
Ted Yu Re: pyspark.zip and py4j-0.9-src.zip Sun, 15 May, 20:14
Ted Yu Re: Debug spark core and streaming programs in scala Mon, 16 May, 12:54
Ted Yu Re: sbt for Spark build with Scala 2.11 Mon, 16 May, 21:55
Ted Yu Re: Why spark 1.6.1 master can not monitor and start a auto stop worker? Tue, 17 May, 01:58
Ted Yu Re: Why spark 1.6.1 master can not monitor and start a auto stop worker? Tue, 17 May, 02:22
Ted Yu Re: Will spark swap memory out to disk if the memory is not enough? Tue, 17 May, 04:00
Ted Yu Re: Code Example of Structured Streaming of 2.0 Tue, 17 May, 08:16
Ted Yu Re: How to change output mode to Update Wed, 18 May, 04:10
Ted Yu Re: File not found exception while reading from folder using textFileStream Wed, 18 May, 12:32
Ted Yu Re: SPARK - DataFrame for BulkLoad Wed, 18 May, 12:36
Ted Yu Re: Managed memory leak detected.SPARK-11293 ? Wed, 18 May, 13:41
Ted Yu Re: spark udf can not change a json string to a map Wed, 18 May, 13:48
Ted Yu Re: Managed memory leak detected.SPARK-11293 ? Wed, 18 May, 14:31
Ted Yu Re: Can Pyspark access Scala API? Wed, 18 May, 19:53
Ted Yu Re: Can Pyspark access Scala API? Wed, 18 May, 20:38
Ted Yu Re: Is there a way to run a jar built for scala 2.11 on spark 1.6.1 (which is using 2.10?) Wed, 18 May, 22:37
Ted Yu Re: Latency experiment without losing executors Thu, 19 May, 08:23
Ted Yu Re: Spark Streaming Application run on yarn-clustor mode Thu, 19 May, 14:36
Ted Yu Re: Latency experiment without losing executors Thu, 19 May, 17:53
Ted Yu Re: Tar File: On Spark Thu, 19 May, 22:42
Ted Yu Re: Can not set spark dynamic resource allocation Fri, 20 May, 19:01
Ted Yu Re: Can not set spark dynamic resource allocation Fri, 20 May, 19:34
Ted Yu Re: Spark Streaming S3 Error Sat, 21 May, 11:18
Ted Yu Re: set spark 1.6 with Hive 0.14 ? Sat, 21 May, 15:19
Ted Yu Re: How to set the degree of parallelism in Spark SQL? Sun, 22 May, 03:41
Ted Yu Re: Handling Empty RDD Sun, 22 May, 14:29
Ted Yu Re: Spark job is failing with kerberos error while creating hive context in yarn-cluster mode (through spark-submit) Mon, 23 May, 14:28
Ted Yu Re: How does Spark set task indexes? Tue, 24 May, 22:13
Ted Yu Re: Using Java in Spark shell Wed, 25 May, 10:28
Ted Yu Re: save RDD of Avro GenericRecord as parquet throws UnsupportedOperationException Thu, 26 May, 16:01
Ted Yu Re: Subtract two DataFrames is not working Thu, 26 May, 17:05
Ted Yu Re: Spark Job Execution halts during shuffle... Fri, 27 May, 03:17
Ted Yu Re: Pros and Cons Fri, 27 May, 15:39
Ted Yu Re: I'm pretty sure this is a Dataset bug Fri, 27 May, 16:15
Ted Yu Re: I'm pretty sure this is a Dataset bug Fri, 27 May, 17:26
Ted Yu Re: Undocumented left join constraint? Fri, 27 May, 20:41
Ted Yu Re: local Vs Standalonecluster production deployment Sat, 28 May, 16:41
Ted Yu Re: join function in a loop Sat, 28 May, 22:48
Ted Yu Re: join function in a loop Sun, 29 May, 00:53
Ted Yu Re: Bulk loading Serialized RDD into Hbase throws KryoException - IndexOutOfBoundsException Sun, 29 May, 23:46
Ted Yu Re: Accessing s3a files from Spark Sun, 29 May, 23:49
Ted Yu Re: Bulk loading Serialized RDD into Hbase throws KryoException - IndexOutOfBoundsException Mon, 30 May, 00:06
Ted Yu Re: G1 GC takes too much time Mon, 30 May, 01:47
Ted Yu Re: 答复: G1 GC takes too much time Mon, 30 May, 03:39
Ted Yu Re: Splitting RDD to exact number of partitions Tue, 31 May, 14:02
Ted Yu Re: Splitting RDD to exact number of partitions Tue, 31 May, 14:30
Telmo Rodrigues Spark 1.6 Catalyst optimizer Wed, 11 May, 00:57
Telmo Rodrigues Re: Spark 1.6 Catalyst optimizer Wed, 11 May, 11:26
Telmo Rodrigues Re: Spark 1.6 Catalyst optimizer Thu, 12 May, 01:04
Telmo Rodrigues Re: Spark 1.6 Catalyst optimizer Fri, 13 May, 01:30
Teng Qiu Re: Spark on AWS Sun, 01 May, 23:54
Teng Qiu Re: Pros and Cons Fri, 27 May, 12:05
Teng Qiu Re: Pros and Cons Fri, 27 May, 14:44
Teng Qiu Re: Pros and Cons Fri, 27 May, 15:58
Teng Qiu Re: Pros and Cons Fri, 27 May, 21:35
Tenghuan He Submit job to spark cluster Error ErrorMonitor dropping message... Tue, 03 May, 06:51
Terry Hoo ArrayIndexOutOfBoundsException in model selection via cross-validation sample with spark 1.6.1 Thu, 05 May, 03:48
Tigran Avanesov kafka direct streaming python API fromOffsets Mon, 02 May, 10:54
Tigran Avanesov Re: kafka direct streaming python API fromOffsets Tue, 03 May, 08:11
Tim Gautier Dataset Set Operations Tue, 24 May, 22:46
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Nov 201953
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137