spark-user mailing list archives: June 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
shyla deshpande Spark sql with Zeppelin, Task not serializable error when I try to cache the spark sql table Thu, 01 Jun, 04:37
Mahesh Sawaiker   RE: Spark sql with Zeppelin, Task not serializable error when I try to cache the spark sql table Thu, 01 Jun, 04:53
RE: The following Error seems to happen once in every ten minutes (Spark Structured Streaming)?
Mahesh Sawaiker   RE: The following Error seems to happen once in every ten minutes (Spark Structured Streaming)? Thu, 01 Jun, 04:56
RE: Message getting lost in Kafka + Spark Streaming
Sidney Feiner   RE: Message getting lost in Kafka + Spark Streaming Thu, 01 Jun, 05:54
Vikash Pareek     Re: Message getting lost in Kafka + Spark Streaming Thu, 01 Jun, 06:19
Re: An Architecture question on the use of virtualised clusters
Jörn Franke   Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 07:21
Mich Talebzadeh     Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 07:47
vincent gromakowski       Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 07:55
Mich Talebzadeh         Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 08:23
vincent gromakowski           Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 08:27
Mich Talebzadeh             Re: An Architecture question on the use of virtualised clusters Thu, 01 Jun, 08:45
Gene Pang               Re: An Architecture question on the use of virtualised clusters Fri, 02 Jun, 18:09
Mich Talebzadeh                 Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:11
John Leach                   Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:19
Mich Talebzadeh                     Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:27
John Leach                       Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 14:46
Mich Talebzadeh                         Re: An Architecture question on the use of virtualised clusters Mon, 05 Jun, 21:16
Vikash Pareek Number Of Partitions in RDD Thu, 01 Jun, 10:28
Michael Mior   Re: Number Of Partitions in RDD Thu, 01 Jun, 14:33
neil90   Re: Number Of Partitions in RDD Fri, 02 Jun, 02:54
Vikash Pareek     Re: Number Of Partitions in RDD Fri, 02 Jun, 06:10
neil90       Re: Number Of Partitions in RDD Fri, 02 Jun, 14:28
Vikash Pareek         Re: Number Of Partitions in RDD Fri, 23 Jun, 07:52
Re: Creating Dataframe by querying Impala
Anubhav Agarwal   Re: Creating Dataframe by querying Impala Thu, 01 Jun, 16:34
morfious902002   Re: Creating Dataframe by querying Impala Thu, 01 Jun, 17:18
David Rosenstrauch statefulStreaming checkpointing too often Thu, 01 Jun, 21:54
Tathagata Das   Re: statefulStreaming checkpointing too often Sat, 03 Jun, 00:26
nancy henry command to get list oin spark 2.0 scala of all persisted rdd's in spark 2.0 scala shell Fri, 02 Jun, 05:59
Aseem Bansal Spark 2.1 - Infering schema of dataframe after reading json files not during Fri, 02 Jun, 14:11
Alonso Isidoro Roman   Re: Spark 2.1 - Infering schema of dataframe after reading json files not during Fri, 02 Jun, 17:25
vaquar khan     Re: Spark 2.1 - Infering schema of dataframe after reading json files not during Fri, 02 Jun, 18:10
yohann jardin Spark SQL, formatting timezone in UTC Fri, 02 Jun, 17:10
Mike Wheeler Parquet Read Speed: Spark SQL vs Parquet MR Sat, 03 Jun, 16:31
kant kodali Is there a way to do conditional group by in spark 2.1.1? Sat, 03 Jun, 22:00
upendra 1991   Re: Is there a way to do conditional group by in spark 2.1.1? Sat, 03 Jun, 22:22
Bryan Jeffrey     Re: Is there a way to do conditional group by in spark 2.1.1? Sun, 04 Jun, 00:16
Guy Cohen       Re: Is there a way to do conditional group by in spark 2.1.1? Sun, 04 Jun, 14:32
vaquar khan         Re: Is there a way to do conditional group by in spark 2.1.1? Sun, 11 Jun, 00:06
Mohammad Tariq SparkAppHandle.Listener.infoChanged behaviour Sun, 04 Jun, 02:16
Marcelo Vanzin   Re: SparkAppHandle.Listener.infoChanged behaviour Mon, 05 Jun, 01:54
Mohammad Tariq     Re: SparkAppHandle.Listener.infoChanged behaviour Mon, 05 Jun, 19:06
kant kodali Is there a way to do partial sort in update mode in Spark Structured Streaming? Sun, 04 Jun, 04:23
kant kodali What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 06:29
Sandeep Nemuri   Re: What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 07:23
kant kodali     Re: What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 08:25
Sandeep Nemuri       Re: What is the easiest way for an application to Query parquet data on HDFS? Sun, 04 Jun, 19:30
Muthu Jayakumar         Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 01:38
kant kodali           Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 05:33
Muthu Jayakumar             Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 06:52
kant kodali               Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 09:14
Muthu Jayakumar                 Re: What is the easiest way for an application to Query parquet data on HDFS? Mon, 05 Jun, 13:04
Abdulfattah Safa Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 04 Jun, 11:46
Abdulfattah Safa   Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 04 Jun, 11:51
khwunchai jaengsawang     Re: Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 04 Jun, 12:59
vaquar khan   Re: Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 11 Jun, 00:02
Rastogi, Pankaj     Re: [E] Re: Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Mon, 12 Jun, 16:30
Mich Talebzadeh       Re: [E] Re: Spark Job is stuck at SUBMITTED when set Driver Memory > Executor Memory Sun, 25 Jun, 20:29
Nipun Arora Kafka + Spark Streaming consumer API offsets Mon, 05 Jun, 14:59
ALunar Beach Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Mon, 05 Jun, 18:14
anbucheeralan Fwd: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Mon, 05 Jun, 18:16
Tathagata Das   Re: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Tue, 06 Jun, 08:30
ALunar Beach     Re: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Tue, 06 Jun, 12:55
Tathagata Das       Re: Spark Streaming Checkpoint and Exactly Once Guarantee on Kafka Direct Stream Tue, 06 Jun, 14:11
verbamour Incorrect CAST to TIMESTAMP in Hive compatibility Mon, 05 Jun, 19:42
Anton Okolnychyi   Re: Incorrect CAST to TIMESTAMP in Hive compatibility Mon, 05 Jun, 19:59
Edge Node in Spark
Ashok Kumar   Edge Node in Spark Mon, 05 Jun, 20:45
Irving Duran     Re: Edge Node in Spark Tue, 06 Jun, 13:11
Ashok Kumar       Re: Edge Node in Spark Tue, 06 Jun, 16:48
Irving Duran         Re: Edge Node in Spark Tue, 06 Jun, 19:48
ayan guha           Re: Edge Node in Spark Tue, 06 Jun, 21:42
Mich Talebzadeh             Re: Edge Node in Spark Wed, 07 Jun, 07:04
Adding header to an rdd before saving to text file
upendra 1991   Adding header to an rdd before saving to text file Mon, 05 Jun, 21:15
颜发才(Yan Facai)     Re: Adding header to an rdd before saving to text file Tue, 06 Jun, 05:38
Irving Duran       Re: Adding header to an rdd before saving to text file Tue, 06 Jun, 20:12
Jain, Nishit Spark Streaming Job Stuck Mon, 05 Jun, 21:51
Tathagata Das   Re: Spark Streaming Job Stuck Tue, 06 Jun, 08:26
Jain, Nishit     Re: Spark Streaming Job Stuck Tue, 06 Jun, 14:54
Richard Moorhead       Re: Spark Streaming Job Stuck Tue, 06 Jun, 15:09
Erik Erlandson Spark on Kubernetes: Birds-of-a-Feather Session 12:50pm 6/6 @ Spark Summit Tue, 06 Jun, 00:30
Jonnas Li(Contractor) Java SPI jar reload in Spark Tue, 06 Jun, 09:35
Jörn Franke   Re: Java SPI jar reload in Spark Tue, 06 Jun, 09:55
Jonnas Li(Contractor)     Re: Java SPI jar reload in Spark Tue, 06 Jun, 10:14
Alonso Isidoro Roman       Re: Java SPI jar reload in Spark Tue, 06 Jun, 10:21
Jonnas Li(Contractor)         Re: Java SPI jar reload in Spark Tue, 06 Jun, 10:30
Jonnas Li(Contractor)           Re: Java SPI jar reload in Spark Wed, 07 Jun, 08:55
Ryan             Re: Java SPI jar reload in Spark Thu, 08 Jun, 03:05
[Spark Structured Streaming] Exception while using watermark with type of timestamp
Biplob Biswas   [Spark Structured Streaming] Exception while using watermark with type of timestamp Tue, 06 Jun, 10:03
Biplob Biswas   [Spark Structured Streaming] Exception while using watermark with type of timestamp Tue, 06 Jun, 10:06
Tathagata Das     Re: [Spark Structured Streaming] Exception while using watermark with type of timestamp Tue, 06 Jun, 14:05
萝卜丝炒饭 a stage can belong to more than one job please? Tue, 06 Jun, 12:04
Mark Hamstra   Re: a stage can belong to more than one job please? Tue, 06 Jun, 15:27
萝卜丝炒饭     Re: a stage can belong to more than one job please? Wed, 07 Jun, 01:06
Curtis Burkhalter problem initiating spark context with pyspark Tue, 06 Jun, 14:45
Doc Dwarf   Re: problem initiating spark context with pyspark Wed, 07 Jun, 13:51
Curtis Burkhalter     Re: problem initiating spark context with pyspark Wed, 07 Jun, 14:46
Marco Mistroni       Re: problem initiating spark context with pyspark Thu, 08 Jun, 19:38
Gourav Sengupta         Re: problem initiating spark context with pyspark Sat, 10 Jun, 17:36
Marco Mistroni           Re: problem initiating spark context with pyspark Sat, 10 Jun, 18:27
Felix Cheung     Re: problem initiating spark context with pyspark Sat, 10 Jun, 22:29
Gourav Sengupta       Re: problem initiating spark context with pyspark Sun, 11 Jun, 08:06
satishjohn Performance issue when running Spark-1.6.1 in yarn-client mode with Hadoop 2.6.0 Tue, 06 Jun, 16:02
Jörn Franke   Re: Performance issue when running Spark-1.6.1 in yarn-client mode with Hadoop 2.6.0 Wed, 07 Jun, 05:46
Satish John Bosco     Re: Performance issue when running Spark-1.6.1 in yarn-client mode with Hadoop 2.6.0 Thu, 08 Jun, 09:17
SRK Exception which using ReduceByKeyAndWindow in Spark Streaming. Tue, 06 Jun, 18:30
Tathagata Das   Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Tue, 06 Jun, 22:36
swetha kasireddy     Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Tue, 06 Jun, 23:50
Tathagata Das       Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Wed, 07 Jun, 03:22
swetha kasireddy         Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Wed, 07 Jun, 15:43
swetha kasireddy           Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Thu, 22 Jun, 23:07
Tathagata Das             Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Thu, 22 Jun, 23:16
N B             Re: Exception which using ReduceByKeyAndWindow in Spark Streaming. Mon, 26 Jun, 18:41
David Rosenstrauch How to perform clean-up after stateful streaming processes an RDD? Tue, 06 Jun, 23:08
Gerard Maas   Re: How to perform clean-up after stateful streaming processes an RDD? Tue, 06 Jun, 23:31
David Rosenstrauch     Re: How to perform clean-up after stateful streaming processes an RDD? Wed, 07 Jun, 02:29
David Rosenstrauch     Re: How to perform clean-up after stateful streaming processes an RDD? Wed, 07 Jun, 02:40
aravias StructuredStreaming : org.apache.spark.sql.streaming.StreamingQueryException Wed, 07 Jun, 03:40
aravias   Re: StructuredStreaming : StreamingQueryException Fri, 09 Jun, 15:21
aravias     Re: StructuredStreaming : StreamingQueryException Fri, 09 Jun, 15:26
kundan kumar Convert the feature vector to raw data Wed, 07 Jun, 09:00
颜发才(Yan Facai)   Re: Convert the feature vector to raw data Wed, 07 Jun, 09:23
kundan kumar     Re: Convert the feature vector to raw data Wed, 07 Jun, 10:14
Ryan       Re: Convert the feature vector to raw data Thu, 08 Jun, 03:01
Patrik Medvedev [No Subject] Wed, 07 Jun, 09:07
Patrik Medvedev [Spark JDBC] Does spark support read from remote Hive server via JDBC Wed, 07 Jun, 09:15
Jean Georges Perrin   Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Wed, 07 Jun, 13:41
Patrik Medvedev     Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Wed, 07 Jun, 13:43
Patrik Medvedev       Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Thu, 08 Jun, 07:53
vaquar khan         Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Sat, 10 Jun, 23:55
Jörn Franke           Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Sun, 11 Jun, 11:24
Patrik Medvedev             Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Mon, 12 Jun, 07:31
Thakrar, Jayesh               Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Mon, 12 Jun, 20:01
Patrik Medvedev                 Re: [Spark JDBC] Does spark support read from remote Hive server via JDBC Tue, 13 Jun, 06:50
Mich Talebzadeh Scala, Python or Java for Spark programming Wed, 07 Jun, 15:20
Jörn Franke   Re: Scala, Python or Java for Spark programming Wed, 07 Jun, 16:51
Bryan Jeffrey     Re: Scala, Python or Java for Spark programming Wed, 07 Jun, 19:39
Matt Tenenbaum       Re: Scala, Python or Java for Spark programming Wed, 07 Jun, 23:11
Mich Talebzadeh         Re: Scala, Python or Java for Spark programming Thu, 08 Jun, 06:20
Jörn Franke           Re: Scala, Python or Java for Spark programming Thu, 08 Jun, 06:44
JB Data             Re: Scala, Python or Java for Spark programming Thu, 08 Jun, 10:17
vaquar khan               Re: Scala, Python or Java for Spark programming Sat, 10 Jun, 23:43
Irving Duran                 Re: Scala, Python or Java for Spark programming Tue, 13 Jun, 15:35
Chanh Le [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Wed, 07 Jun, 15:50
Jörn Franke   Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Wed, 07 Jun, 16:45
Takeshi Yamamuro     Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Wed, 07 Jun, 17:48
Chanh Le       Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Thu, 08 Jun, 01:04
Jörn Franke         Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Thu, 08 Jun, 05:10
Chanh Le           Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Thu, 08 Jun, 06:35
Jörn Franke             Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Thu, 08 Jun, 07:47
Chanh Le               Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Thu, 08 Jun, 08:27
Takeshi Yamamuro                 Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Thu, 08 Jun, 16:05
Chanh Le                   Re: [CSV] If number of columns of one row bigger than maxcolumns it stop the whole parsing process. Fri, 09 Jun, 12:26
user-unsubscribe@spark.apache.org
williamtellme...@gmail.com   user-unsubscribe@spark.apache.org Wed, 07 Jun, 16:17
williamtellme...@gmail.com   user-unsubscribe@spark.apache.org Wed, 07 Jun, 16:18
williamtellme...@gmail.com   user-unsubscribe@spark.apache.org Wed, 07 Jun, 16:18
Re: Question about mllib.recommendation.ALS
Ryan   Re: Question about mllib.recommendation.ALS Thu, 08 Jun, 03:17
Sahib Aulakh [Search] ­     Re: Question about mllib.recommendation.ALS Thu, 08 Jun, 15:17
Nick Pentreath       Re: Question about mllib.recommendation.ALS Thu, 08 Jun, 15:41
Sahib Aulakh [Search] ­         Re: Question about mllib.recommendation.ALS Thu, 08 Jun, 15:42
Re: good http sync client to be used with spark
Ryan   Re: good http sync client to be used with spark Thu, 08 Jun, 03:21
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
May 2019209
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137