spark-user mailing list archives: August 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Rabin Banerjee Re: DataSet creation not working Spark 1.6.0 , populating wrong data CDH 5.7.1 Thu, 03 Aug, 17:10
Raghavendra Pandey Re: Spark Streaming: Async action scheduling inside foreachRDD Fri, 04 Aug, 13:54
Raghavendra Pandey Multiple queries on same stream Wed, 09 Aug, 05:05
Ramesh Krishnan Re: Tue, 08 Aug, 11:20
Ramesh Krishnan unsubscribe Tue, 08 Aug, 15:48
Ravi Gurram Spark streaming - Processing time keeps on increasing under following scenario Thu, 10 Aug, 14:20
Ravindra Re: Reparitioning Hive tables - Container killed by YARN for exceeding memory limits Wed, 02 Aug, 16:11
Reynold Xin Re: SQL specific documentation for recent Spark releases Fri, 11 Aug, 18:30
Riccardo Ferrari PySpark Streaming S3 checkpointing Wed, 02 Aug, 09:34
Riccardo Ferrari Re: PySpark Streaming S3 checkpointing Thu, 03 Aug, 21:52
Riccardo Ferrari PySpark Streaming keeps dying Sat, 05 Aug, 07:55
Riccardo Ferrari Re: Spark Streaming job statistics Tue, 08 Aug, 18:47
Riccardo Ferrari Re: Is there an operation to create multi record for every element in a RDD? Wed, 09 Aug, 08:54
Riccardo Ferrari Re: PySpark, Structured Streaming and Kafka Wed, 23 Aug, 22:45
Rick Moritz Re: [StructuredStreaming] multiple queries of the socket source: only one query works. Sat, 12 Aug, 05:59
Rohit Damkondwar Hive Metastore open connections even after closing Spark context and session Tue, 15 Aug, 20:53
Russell Spitzer Re: Does Spark SQL uses Calcite? Sat, 12 Aug, 13:07
Ryan Re: Is there an operation to create multi record for every element in a RDD? Wed, 09 Aug, 08:44
Ryan Re: Re: Is there an operation to create multi record for every element in a RDD? Wed, 09 Aug, 09:32
Ryan Re: How can I tell if a Spark job is successful or not? Fri, 11 Aug, 02:04
Ryan Re: Does Spark SQL uses Calcite? Fri, 11 Aug, 07:53
Ryan Blue Re: Reparitioning Hive tables - Container killed by YARN for exceeding memory limits Wed, 02 Aug, 17:13
SRK Issues when trying to recover a textFileStream from checkpoint in Spark streaming Fri, 11 Aug, 00:04
SRK How to force Spark Kafka Direct to start from the latest offset when the lag is huge in kafka 10? Tue, 15 Aug, 18:18
SRK ReduceByKeyAndWindow checkpoint recovery issues in Spark Streaming Wed, 23 Aug, 19:26
SRK Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Fri, 25 Aug, 19:19
Saisai Shao Re: Spark Web UI SSL Encryption Mon, 21 Aug, 14:27
Saisai Shao Re: Livy with Spark package Thu, 24 Aug, 02:01
Sam Elamin Re: from_json() Mon, 28 Aug, 18:14
Sathish Kumaran Vairavelu Re: Spark Streaming: Async action scheduling inside foreachRDD Fri, 04 Aug, 15:25
Sathish Kumaran Vairavelu Re: Does Spark SQL uses Calcite? Thu, 10 Aug, 20:30
Sathish Kumaran Vairavelu Re: Does Spark SQL uses Calcite? Thu, 10 Aug, 21:24
Sathish Kumaran Vairavelu Re: spark.write.csv is not able write files to specified path, but is writing to unintended subfolder _temporary/0/task_xxx folder on worker nodes Fri, 11 Aug, 18:46
Sea aj Re: SPARK Issue in Standalone cluster Tue, 22 Aug, 08:56
Sea aj Re: UI for spark machine learning. Tue, 22 Aug, 10:58
Sea aj Re: UI for spark machine learning. Tue, 22 Aug, 11:28
Sea aj Training A ML Model on a Huge Dataframe Wed, 23 Aug, 12:27
Sea aj Re: Training A ML Model on a Huge Dataframe Wed, 23 Aug, 16:22
Shiv Onkar Kumar pyspark on windows (Upgrade from 1.6 to 2.0.2): sqlContext.read.format fails Sat, 26 Aug, 04:13
Shixiong(Ryan) Zhu Re: [StructuredStreaming] multiple queries of the socket source: only one query works. Sat, 12 Aug, 23:22
Shixiong(Ryan) Zhu Re: Structured streaming (Kafka) error with Union Tue, 22 Aug, 19:59
Shixiong(Ryan) Zhu Re: PySpark, Structured Streaming and Kafka Wed, 23 Aug, 22:51
Shixiong(Ryan) Zhu Re: [Structured Streaming]Data processing and output trigger should be decoupled Wed, 30 Aug, 17:59
Shmuel Blitz Spark 2.1 table loaded from Hive Metastore has null values Mon, 07 Aug, 10:05
Silvio Fiorito Re: [StructuredStreaming] multiple queries of the socket source: only one query works. Mon, 14 Aug, 00:55
Simone Pallotta different behaviour linux/Unix vs windows when load spark context in scala method called from R function using rscala package Sun, 27 Aug, 07:46
Stephen Boesch SQL specific documentation for recent Spark releases Thu, 10 Aug, 20:46
Stephen Boesch Re: SQL specific documentation for recent Spark releases Fri, 11 Aug, 02:46
Steve Loughran Re: SPARK Issue in Standalone cluster Wed, 02 Aug, 15:59
Steve Loughran Re: PySpark Streaming S3 checkpointing Wed, 02 Aug, 16:04
Steve Loughran Re: SPARK Issue in Standalone cluster Thu, 03 Aug, 09:09
Steve Loughran Re: SPARK Issue in Standalone cluster Fri, 04 Aug, 10:50
Steve Loughran Re: spark.write.csv is not able write files to specified path, but is writing to unintended subfolder _temporary/0/task_xxx folder on worker nodes Fri, 11 Aug, 18:16
Steve Loughran Re: How to authenticate to ADLS from within spark job on the fly Sat, 19 Aug, 14:04
Sumit Saraswat [No Subject] Mon, 07 Aug, 09:27
Sumit Saraswat Unsubscribe Tue, 08 Aug, 17:03
Sun, Keith A bug in spark or hadoop RPC with kerberos authentication? Tue, 22 Aug, 15:48
Sun, Keith RE: A bug in spark or hadoop RPC with kerberos authentication? Wed, 23 Aug, 11:01
Sun, Keith RE: A bug in spark or hadoop RPC with kerberos authentication? Wed, 23 Aug, 11:12
Sunita Arvind Chaining Spark Streaming Jobs Mon, 21 Aug, 18:02
Suzen, Mehmet Re: How can i remove the need for calling cache Wed, 02 Aug, 23:20
Suzen, Mehmet Re: How can i remove the need for calling cache Thu, 03 Aug, 01:08
Suzen, Mehmet Re: Training A ML Model on a Huge Dataframe Wed, 23 Aug, 12:59
Suzen, Mehmet Re: Training A ML Model on a Huge Dataframe Wed, 23 Aug, 23:07
Swapnil Shinde Inconsistent results with combineByKey API Thu, 31 Aug, 16:27
Takeshi Yamamuro Re: Reading CSV with multiLine option invalidates encoding option. Wed, 16 Aug, 06:09
Tathagata Das Re: KafkaUtils.createRDD , How do I read all the data from kafka in a batch program for a given topic? Tue, 08 Aug, 01:11
Tathagata Das Re: KafkaUtils.createRDD , How do I read all the data from kafka in a batch program for a given topic? Tue, 08 Aug, 03:59
Tathagata Das Re: [Structured Streaming] Recommended way of joining streams Wed, 09 Aug, 09:21
Tathagata Das Re: Multiple queries on same stream Wed, 09 Aug, 09:34
Tathagata Das Re: Reusing dataframes for streaming (spark 1.6) Wed, 09 Aug, 09:37
Tathagata Das Re: Spark 2.2 streaming with append mode: empty output Mon, 14 Aug, 23:55
Tathagata Das Re: Restart streaming query spark 2.1 structured streaming Tue, 15 Aug, 20:44
Tathagata Das Re: Restart streaming query spark 2.1 structured streaming Tue, 15 Aug, 22:35
Tathagata Das Re: Structured Streaming: multiple sinks Fri, 25 Aug, 06:03
Tathagata Das Re: Structured streaming (Kafka) error with Union Fri, 25 Aug, 07:12
Tathagata Das Re: Structured Streaming: multiple sinks Fri, 25 Aug, 08:59
Tathagata Das Re: Terminating Structured Streaming Applications on Source Failure Tue, 29 Aug, 09:21
Tathagata Das Re: How to select the entire row that has max timestamp for every key in Spark Structured Streaming 2.1.1? Tue, 29 Aug, 20:38
Tathagata Das Re: How to select the entire row that has max timestamp for every key in Spark Structured Streaming 2.1.1? Wed, 30 Aug, 00:18
Tathagata Das Re: How to select the entire row that has max timestamp for every key in Spark Structured Streaming 2.1.1? Wed, 30 Aug, 04:50
Tathagata Das Re: Time window on Processing Time Wed, 30 Aug, 05:14
Tathagata Das Re: Why do checkpoints work the way they do? Wed, 30 Aug, 05:19
Tathagata Das Re: Python UDF to convert timestamps (performance question) Wed, 30 Aug, 19:34
Tathagata Das Re: How to select the entire row that has max timestamp for every key in Spark Structured Streaming 2.1.1? Wed, 30 Aug, 23:09
Tathagata Das Re: Different watermark for different kafka partitions in Structured Streaming Thu, 31 Aug, 01:13
Tushar Sudake 'Premature end of Content-Length' using S3A to read huge data Mon, 21 Aug, 21:24
U..@Moosheimer.com Re: Spark submit OutOfMemory Error in local mode Tue, 22 Aug, 19:26
Vadim Semenov Re: How can i remove the need for calling cache Tue, 01 Aug, 19:05
Vadim Semenov Re: How can i remove the need for calling cache Thu, 03 Aug, 00:46
Vadim Semenov Re: How can i remove the need for calling cache Thu, 03 Aug, 00:50
Vadim Semenov Re: How can i remove the need for calling cache Thu, 03 Aug, 01:00
Vadim Semenov Re: How can i remove the need for calling cache Thu, 03 Aug, 01:24
Vadim Semenov Re: count exceed int.MaxValue Tue, 08 Aug, 18:36
Vadim Semenov Re: [Spark Core] Is it possible to insert a function directly into the Logical Plan? Mon, 14 Aug, 18:48
Vadim Semenov Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 18:52
Vadim Semenov Re: Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Mon, 28 Aug, 21:18
Vadim Semenov Re: Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Tue, 29 Aug, 15:49
Vasu Gourabathina Design aspects of Data partitioning for Window functions Wed, 30 Aug, 19:33
Viacheslav Krot java.io.OptionalDataException during task deserialization Tue, 01 Aug, 11:29
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Box list
Sep 202180
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137