spark-user mailing list archives: June 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
shyla deshpande Spark sql with Zeppelin, Task not serializable error when I try to cache the spark sql table Thu, 01 Jun, 04:37
Mahesh Sawaiker RE: Spark sql with Zeppelin, Task not serializable error when I try to cache the spark sql table Thu, 01 Jun, 04:53
Mahesh Sawaiker RE: The following Error seems to happen once in every ten minutes (Spark Structured Streaming)? Thu, 01 Jun, 04:56
Sidney Feiner RE: Message getting lost in Kafka + Spark Streaming Thu, 01 Jun, 05:54
Vikash Pareek Re: Message getting lost in Kafka + Spark Streaming Thu, 01 Jun, 06:19
Jörn Franke Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 07:21
Mich Talebzadeh Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 07:47
vincent gromakowski Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 07:55
Mich Talebzadeh Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 08:23
vincent gromakowski Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 08:27
Mich Talebzadeh Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 08:45
Vikash Pareek Number Of Partitions in RDD Thu, 01 Jun, 10:28
Michael Mior Re: Number Of Partitions in RDD Thu, 01 Jun, 14:33
Anubhav Agarwal Re: Creating Dataframe by querying Impala Thu, 01 Jun, 16:34
morfious902002 Re: Creating Dataframe by querying Impala Thu, 01 Jun, 17:18
David Rosenstrauch statefulStreaming checkpointing too often Thu, 01 Jun, 21:54
neil90 Re: Number Of Partitions in RDD Fri, 02 Jun, 02:54
nancy henry command to get list oin spark 2.0 scala of all persisted rdd's in spark 2.0 scala shell Fri, 02 Jun, 05:59
Vikash Pareek Re: Number Of Partitions in RDD Fri, 02 Jun, 06:10
Aseem Bansal Spark 2.1 - Infering schema of dataframe after reading json files not during Fri, 02 Jun, 14:11
neil90 Re: Number Of Partitions in RDD Fri, 02 Jun, 14:28
yohann jardin Spark SQL, formatting timezone in UTC Fri, 02 Jun, 17:10
Alonso Isidoro Roman Re: Spark 2.1 - Infering schema of dataframe after reading json files not during Fri, 02 Jun, 17:25
Gene Pang Re: An Architecture question on the use of virtualised clusters Fri, 02 Jun, 18:09
vaquar khan Re: Spark 2.1 - Infering schema of dataframe after reading json files not during Fri, 02 Jun, 18:10
Tathagata Das Re: statefulStreaming checkpointing too often Sat, 03 Jun, 00:26
Mike Wheeler Parquet Read Speed: Spark SQL vs Parquet MR Sat, 03 Jun, 16:31
kant kodali Is there a way to do conditional group by in spark 2.1.1? Sat, 03 Jun, 22:00
upendra 1991 Re: Is there a way to do conditional group by in spark 2.1.1? Sat, 03 Jun, 22:22
Bryan Jeffrey Re: Is there a way to do conditional group by in spark 2.1.1? Sun, 04 Jun, 00:16
Mohammad Tariq SparkAppHandle.Listener.infoChanged behaviour Sun, 04 Jun, 02:16
kant kodali Is there a way to do partial sort in update mode in Spark Structured Streaming? Sun, 04 Jun, 04:23
kant kodali What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 06:29
Sandeep Nemuri Re: What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 07:23
kant kodali Re: What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 08:25
Abdulfattah Safa Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 04 Jun, 11:46
Abdulfattah Safa Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 04 Jun, 11:51
khwunchai jaengsawang Re: Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 04 Jun, 12:59
Guy Cohen Re: Is there a way to do conditional group by in spark 2.1.1? Sun, 04 Jun, 14:32
Sandeep Nemuri Re: What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 19:30
Muthu Jayakumar Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 01:38
Marcelo Vanzin Re: SparkAppHandle.Listener.infoChanged behaviour Mon, 05 Jun, 01:54
kant kodali Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 05:33
Muthu Jayakumar Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 06:52
kant kodali Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 09:14
Muthu Jayakumar Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 13:04
Mich Talebzadeh Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:11
John Leach Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:19
Mich Talebzadeh Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:27
John Leach Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:46
Nipun Arora Kafka + Spark Streaming consumer API offsets Mon, 05 Jun, 14:59
ALunar Beach Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Mon, 05 Jun, 18:14
anbucheeralan Fwd: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Mon, 05 Jun, 18:16
Mohammad Tariq Re: SparkAppHandle.Listener.infoChanged behaviour Mon, 05 Jun, 19:06
verbamour Incorrect CAST to TIMESTAMP in Hive compatibility Mon, 05 Jun, 19:42
Anton Okolnychyi Re: Incorrect CAST to TIMESTAMP in Hive compatibility Mon, 05 Jun, 19:59
Ashok Kumar Edge Node in Spark Mon, 05 Jun, 20:45
upendra 1991 Adding header to an rdd before saving to text file Mon, 05 Jun, 21:15
Mich Talebzadeh Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 21:16
Jain, Nishit Spark Streaming Job Stuck Mon, 05 Jun, 21:51
Erik Erlandson Spark on Kubernetes: Birds-of-a-Feather Session 12:50pm 6/6 @ Spark Summit Tue, 06 Jun, 00:30
颜发才(Yan Facai) Re: Adding header to an rdd before saving to text file Tue, 06 Jun, 05:38
Tathagata Das Re: Spark Streaming Job Stuck Tue, 06 Jun, 08:26
Tathagata Das Re: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Tue, 06 Jun, 08:30
Jonnas Li(Contractor) Java SPI jar reload in Spark Tue, 06 Jun, 09:35
Jörn Franke Re: Java SPI jar reload in Spark Tue, 06 Jun, 09:55
Biplob Biswas [Spark Structured Streaming] Exception while using watermark with type of timestamp Tue, 06 Jun, 10:03
Biplob Biswas [Spark Structured Streaming] Exception while using watermark with type of timestamp Tue, 06 Jun, 10:06
Jonnas Li(Contractor) Re: Java SPI jar reload in Spark Tue, 06 Jun, 10:14
Alonso Isidoro Roman Re: Java SPI jar reload in Spark Tue, 06 Jun, 10:21
Jonnas Li(Contractor) Re: Java SPI jar reload in Spark Tue, 06 Jun, 10:30
萝卜丝炒饭 a stage can belong to more than one job please? Tue, 06 Jun, 12:04
ALunar Beach Re: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Tue, 06 Jun, 12:55
Irving Duran Re: Edge Node in Spark Tue, 06 Jun, 13:11
Tathagata Das Re: [Spark Structured Streaming] Exception while using watermark with type of timestamp Tue, 06 Jun, 14:05
Tathagata Das Re: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Tue, 06 Jun, 14:11
Curtis Burkhalter problem initiating spark context with pyspark Tue, 06 Jun, 14:45
Jain, Nishit Re: Spark Streaming Job Stuck Tue, 06 Jun, 14:54
Richard Moorhead Re: Spark Streaming Job Stuck Tue, 06 Jun, 15:09
Mark Hamstra Re: a stage can belong to more than one job please? Tue, 06 Jun, 15:27
satishjohn Performance issue when running Spark-1.6.1 in yarn-client mode with Hadoop 2.6.0 Tue, 06 Jun, 16:02
Ashok Kumar Re: Edge Node in Spark Tue, 06 Jun, 16:48
SRK Exception which using ReduceByKeyAndWindow in Spark Streaming. Tue, 06 Jun, 18:30
Irving Duran Re: Edge Node in Spark Tue, 06 Jun, 19:48
Irving Duran Re: Adding header to an rdd before saving to text file Tue, 06 Jun, 20:12
ayan guha Re: Edge Node in Spark Tue, 06 Jun, 21:42
Tathagata Das Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Tue, 06 Jun, 22:36
David Rosenstrauch How to perform clean-up after stateful streaming processes an RDD? Tue, 06 Jun, 23:08
Gerard Maas Re: How to perform clean-up after stateful streaming processes an RDD? Tue, 06 Jun, 23:31
swetha kasireddy Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Tue, 06 Jun, 23:50
萝卜丝炒饭 Re: a stage can belong to more than one job please? Wed, 07 Jun, 01:06
David Rosenstrauch Re: How to perform clean-up after stateful streaming processes an RDD? Wed, 07 Jun, 02:29
David Rosenstrauch Re: How to perform clean-up after stateful streaming processes an RDD? Wed, 07 Jun, 02:40
Tathagata Das Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Wed, 07 Jun, 03:22
aravias StructuredStreaming : org.apache.spark.sql.streaming.StreamingQueryException Wed, 07 Jun, 03:40
Jörn Franke Re: Performance issue when running Spark-1.6.1 in yarn-client mode with Hadoop 2.6.0 Wed, 07 Jun, 05:46
Mich Talebzadeh Re: Edge Node in Spark Wed, 07 Jun, 07:04
Jonnas Li(Contractor) Re: Java SPI jar reload in Spark Wed, 07 Jun, 08:55
kundan kumar Convert the feature vector to raw data Wed, 07 Jun, 09:00
Patrik Medvedev [No Subject] Wed, 07 Jun, 09:07
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Aug 2019118
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137