spark-user mailing list archives: August 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Sree Eedupuganti How to convert List<Row> into json object / json Array Tue, 30 Aug, 08:55
Sreekanth Jella Flattening XML in a DataFrame Sat, 13 Aug, 00:33
Sreekanth Jella Re: Flattening XML in a DataFrame Sun, 14 Aug, 15:45
Sreekanth Jella RE: Flattening XML in a DataFrame Tue, 16 Aug, 22:22
Sri Re: sql to spark scala rdd Mon, 01 Aug, 06:04
Sri Re: sql to spark scala rdd Mon, 01 Aug, 07:07
Sri Re: sql to spark scala rdd Tue, 02 Aug, 12:39
Srikanth Re: Rebalancing when adding kafka partitions Fri, 12 Aug, 19:47
Srikanth Re: Rebalancing when adding kafka partitions Tue, 16 Aug, 19:17
Srikanth Spark 2.0 with Kafka 0.10 exception Tue, 23 Aug, 20:44
Srikanth Re: Spark 2.0 with Kafka 0.10 exception Wed, 24 Aug, 18:13
Stefan Panayotov RE: How to output RDD to one file with specific name? Thu, 25 Aug, 17:55
Stephen Fletcher DataFrame equivalent to RDD.partionByKey Tue, 09 Aug, 16:36
Steve Loughran Re: Role-based S3 access outside of EMR Sun, 14 Aug, 20:15
Steve Loughran Re: Accessing HBase through Spark with Security enabled Mon, 15 Aug, 11:23
Steve Loughran Re: Spark Streaming application failing with Token issue Tue, 23 Aug, 09:51
Steve Loughran Re: Spark Streaming application failing with Token issue Wed, 24 Aug, 09:28
Steve Loughran Re: Is "spark streaming" streaming or mini-batch? Wed, 24 Aug, 09:40
Steve Loughran Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 15:04
Steve Loughran Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 09:50
Steve Loughran Re: What do I loose if I run spark without using HDFS or Zookeeper? Fri, 26 Aug, 16:50
Steve Loughran Re: S3A + EMR failure when writing Parquet? Tue, 30 Aug, 18:49
Steve Loughran Re: Spark 2.0.0 - What all access is needed to save model to S3? Tue, 30 Aug, 19:01
Steve Rowe Re: Writing custom Transformers and Estimators like Tokenizer in spark ML Tue, 02 Aug, 00:25
Strange, Nick RE: Symbol HasInputCol is inaccesible from this place Mon, 08 Aug, 12:02
Subhajit Purkayastha Getting error, when I do df.show() Mon, 01 Aug, 08:22
Subhajit Purkayastha Spark 2.0 - Join statement compile error Mon, 22 Aug, 21:00
Subhajit Purkayastha DataFrame Data Manipulation - Based on a timestamp column Not Working Tue, 23 Aug, 22:46
Subhajit Purkayastha Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 16:53
Subhajit Purkayastha RE: Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 20:29
Subhajit Purkayastha RE: Spark 2.0 - Insert/Update to a DataFrame Fri, 26 Aug, 21:45
Sudhanshu Janghel UNSUBSCRIBE Wed, 10 Aug, 14:34
Sudhanshu Janghel Unsubscribe Sun, 21 Aug, 16:19
Sudhir Babu Pothineni Re: Zero Data Loss in Spark with Kafka Tue, 23 Aug, 15:45
Suman Somasundar Log messages for shuffle phase Fri, 12 Aug, 01:28
Sumit Khanna Re: multiple spark streaming contexts Mon, 01 Aug, 06:39
Sumit Khanna Re: multiple spark streaming contexts Mon, 01 Aug, 07:41
Sumit Khanna Re: how to debug spark app? Thu, 04 Aug, 01:19
Sumit Khanna spark df schema to hive schema converter func Sun, 07 Aug, 05:03
Sumit Khanna Re: spark df schema to hive schema converter func Sun, 07 Aug, 05:05
Sumit Khanna silence the spark debug logs Mon, 08 Aug, 04:09
Sumit Khanna hdfs persist rollbacks when spark job is killed Mon, 08 Aug, 06:35
Sumit Khanna Re: java.lang.UnsupportedOperationException: Cannot evaluate expression: fun_nm(input[0, string, true]) Tue, 16 Aug, 08:57
Sun Rui Re: Application not showing in Spark History Tue, 02 Aug, 09:26
Sun Rui Re: [2.0.0] mapPartitions on DataFrame unable to find encoder Wed, 03 Aug, 01:58
Sun Rui Re: How to partition a SparkDataFrame using all distinct column values in sparkR Wed, 03 Aug, 10:04
Sun Rui Re: Executors assigned to STS and number of workers in Stand Alone Mode Thu, 04 Aug, 04:34
Sun Rui Re: how to run local[k] threads on a single core Thu, 04 Aug, 06:51
Sun Rui Re: SparkR error when repartition is called Tue, 09 Aug, 06:52
Sun Rui Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:09
Sun Rui Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 14:17
Sun Rui Re: Can we redirect Spark shuffle spill data to HDFS or Alluxio? Wed, 24 Aug, 15:16
Takeshi Yamamuro Re: Sqoop On Spark Tue, 02 Aug, 04:59
Takeshi Yamamuro Re: [Thriftserver2] Controlling number of tasks Wed, 03 Aug, 16:30
Takeshi Yamamuro Re: SparkSession for RDBMS Wed, 03 Aug, 16:43
Takeshi Yamamuro Re: [Spark 2.0] Problem with Spark Thrift Server show NULL instead of showing BIGINT value Thu, 04 Aug, 10:59
Takeshi Yamamuro Re: Spark SQL and number of task Thu, 04 Aug, 11:25
Takeshi Yamamuro Re: Spark SQL and number of task Thu, 04 Aug, 12:18
Takeshi Yamamuro Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 11:56
Takeshi Yamamuro Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 12:20
Takeshi Yamamuro Re: Caching broadcasted DataFrames? Thu, 25 Aug, 19:38
Takeshi Yamamuro Re: broadcast fails on join Tue, 30 Aug, 13:56
Tal Grynbaum Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 05:40
Tal Grynbaum Re: spark 2.0.0 - when saving a model to S3 spark creates temporary files. Why? Thu, 25 Aug, 12:16
Tal Grynbaum Re: Please assist: Building Docker image containing spark 2.0 Fri, 26 Aug, 21:23
Tal Grynbaum Suggestions for calculating MAU/WAU/DAU Sun, 28 Aug, 18:48
Taotao.Li Does Spark SQL support indexes? Sun, 14 Aug, 03:03
Taotao.Li Re: [Community] Python support added to Spark Job Server Sun, 21 Aug, 03:37
Taotao.Li How to persist SparkContext? Sun, 28 Aug, 03:32
Taotao.Li Hi, guys, does anyone use Spark in finance market? Tue, 30 Aug, 13:13
Taras Lehinevych Re: Linear regression, weights constraint Tue, 16 Aug, 09:08
Tathagata Das Re: Spark streaming 2, giving error ClassNotFoundException: scala.collection.GenTraversableOnce$class Fri, 19 Aug, 19:19
Ted Yu Re: JettyUtils.createServletHandler Method not Found? Mon, 01 Aug, 10:38
Ted Yu Re: ERROR Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages. Mon, 01 Aug, 10:55
Ted Yu Re: Job can not terminated in Spark 2.0 on Yarn Tue, 02 Aug, 18:01
Ted Yu Re: Extracting key word from a textual column Tue, 02 Aug, 22:10
Ted Yu Re: [2.0.0] mapPartitions on DataFrame unable to find encoder Tue, 02 Aug, 23:50
Ted Yu Re: Managed memory leak detected + OutOfMemoryError: Unable to acquire X bytes of memory, got 0 Wed, 03 Aug, 13:52
Ted Yu Re: Managed memory leak detected + OutOfMemoryError: Unable to acquire X bytes of memory, got 0 Wed, 03 Aug, 16:10
Ted Yu Re: Managed memory leak detected + OutOfMemoryError: Unable to acquire X bytes of memory, got 0 Wed, 03 Aug, 16:20
Ted Yu Re: java.net.URISyntaxException: Relative path in absolute URI: Wed, 03 Aug, 18:07
Ted Yu Re: how to debug spark app? Thu, 04 Aug, 01:16
Ted Yu Re: source code for org.spark-project.hive Thu, 04 Aug, 13:46
Ted Yu Re: What is "Developer API " in spark documentation? Fri, 05 Aug, 10:11
Ted Yu Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 16:58
Ted Yu Re: ClassNotFoundException org.apache.spark.Logging Fri, 05 Aug, 17:11
Ted Yu Re: Symbol HasInputCol is inaccesible from this place Sat, 06 Aug, 17:07
Ted Yu Re: Symbol HasInputCol is inaccesible from this place Sat, 06 Aug, 20:56
Ted Yu Re: submitting spark job with kerberized Hadoop issue Mon, 08 Aug, 04:34
Ted Yu Re: Multiple Sources Found for Parquet Mon, 08 Aug, 10:38
Ted Yu Re: Getting a TreeNode Exception while saving into Hadoop Mon, 08 Aug, 19:11
Ted Yu Re: Getting a TreeNode Exception while saving into Hadoop Mon, 08 Aug, 19:41
Ted Yu Re: Single point of failure with Driver host crashing Thu, 11 Aug, 19:58
Ted Yu Re: Why I can't use broadcast var defined in a global object? Sun, 14 Aug, 03:59
Ted Yu Re: Spark 2.0.0 JaninoRuntimeException Sun, 14 Aug, 21:18
Ted Yu Re: class not found exception Logging while running JavaKMeansExample Mon, 15 Aug, 16:50
Ted Yu Re: Spark 2.0.0 JaninoRuntimeException Tue, 16 Aug, 11:17
Ted Yu Re: class not found exception Logging while running JavaKMeansExample Tue, 16 Aug, 11:37
Ted Yu Re: long lineage Tue, 16 Aug, 13:12
Ted Yu Re: Spark 2.0.0 JaninoRuntimeException Tue, 16 Aug, 15:56
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Sep 202177
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137