spark-user mailing list archives: December 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
kant kodali Given a Avro Schema object is there a way to get StructType in Java? Sat, 16 Dec, 06:32
Esa Heikkinen Windows10 + pyspark + ipython + csv file loading with timestamps Sat, 16 Dec, 10:04
Szuromi Tamás   Re: Windows10 + pyspark + ipython + csv file loading with timestamps Mon, 18 Dec, 11:03
Sandip Mehta Stateful Aggregation Using flatMapGroupsWithState Sat, 16 Dec, 11:09
Jacek Laskowski How to...UNION ALL of two SELECTs over different data sources in parallel? Sat, 16 Dec, 11:40
Silvio Fiorito   Re: How to...UNION ALL of two SELECTs over different data sources in parallel? Sat, 16 Dec, 18:12
Jacek Laskowski     Re: How to...UNION ALL of two SELECTs over different data sources in parallel? Sun, 17 Dec, 20:30
Junaid Nasir Lucene Index with Spark Cassandra Sun, 17 Dec, 10:02
Kali.tumm...@gmail.com spark + SalesForce SSL HandShake Issue Sun, 17 Dec, 16:21
Debasish Das ECOS Spark Integration Mon, 18 Dec, 01:25
Hajira Jabeen SANSA 0.3 (Scalable Semantic Analytics Stack) Released Mon, 18 Dec, 09:21
Timur Shenkao   Re: SANSA 0.3 (Scalable Semantic Analytics Stack) Released Mon, 18 Dec, 09:54
Hajira Jabeen     Re: SANSA 0.3 (Scalable Semantic Analytics Stack) Released Mon, 18 Dec, 15:05
Sudha KS Spark - Livy - Hive Table User Mon, 18 Dec, 09:59
Liana Napalkova How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 14:45
Silvio Fiorito   Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:00
Liana Napalkova     Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:07
Timur Shenkao       Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:11
Silvio Fiorito       Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:20
Cody Koeninger         Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:26
Liana Napalkova       Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:25
Liana Napalkova       Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:27
OBones Getting multiple regression metrics at once Mon, 18 Dec, 16:35
Sandeep Nemuri Mapping words to vector sparkml CountVectorizerModel Mon, 18 Dec, 19:43
Mihai Iacob /tmp fills up to 100GB when using a window function Mon, 18 Dec, 20:10
Vadim Semenov   Re: /tmp fills up to 100GB when using a window function Tue, 19 Dec, 14:45
Mihai Iacob     Re: /tmp fills up to 100GB when using a window function Tue, 19 Dec, 15:08
Vadim Semenov       Re: /tmp fills up to 100GB when using a window function Tue, 19 Dec, 15:35
Gourav Sengupta   Re: /tmp fills up to 100GB when using a window function Wed, 20 Dec, 19:58
Vadim Semenov     Re: /tmp fills up to 100GB when using a window function Wed, 20 Dec, 20:04
Sunitha Chennareddy Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 03:55
Deepak Sharma   Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 04:12
Sunitha Chennareddy     Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 06:16
Jörn Franke       Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 06:55
Sunitha Chennareddy         Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 07:20
Weichen Xu       Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 07:50
Sunitha Chennareddy         Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Thu, 21 Dec, 03:57
Naresh Dulam           Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Sat, 23 Dec, 03:15
Gaurav1809 What does Blockchain technology mean for Big Data? And how Hadoop/Spark will play role with it? Tue, 19 Dec, 04:56
KhajaAsmath Mohammed   Re: What does Blockchain technology mean for Big Data? And how Hadoop/Spark will play role with it? Tue, 19 Dec, 04:59
Vadim Semenov     Re: What does Blockchain technology mean for Big Data? And how Hadoop/Spark will play role with it? Tue, 19 Dec, 14:29
Ryan C. Kleck     Re: What does Blockchain technology mean for Big Data? And how Hadoop/Spark will play role with it? Tue, 19 Dec, 15:20
Anurag Sharma NullPointerException while reading a column from the row Tue, 19 Dec, 09:23
Vadim Semenov   Re: NullPointerException while reading a column from the row Tue, 19 Dec, 14:26
satyajit vegesna Spark error while trying to spark.read.json() Wed, 20 Dec, 01:42
Michael Armbrust   Re: Spark error while trying to spark.read.json() Wed, 20 Dec, 01:53
chopinxb Can spark shuffle leverage Alluxio to abtain higher stability? Wed, 20 Dec, 09:46
vincent gromakowski   Re: Can spark shuffle leverage Alluxio to abtain higher stability? Wed, 20 Dec, 09:53
chopinxb     Re: Can spark shuffle leverage Alluxio to abtain higher stability? Wed, 20 Dec, 10:23
vincent gromakowski       Re: Can spark shuffle leverage Alluxio to abtain higher stability? Wed, 20 Dec, 11:08
chopinxb         Re: Can spark shuffle leverage Alluxio to abtain higher stability? Thu, 21 Dec, 03:43
Georg Heiler           Re: Can spark shuffle leverage Alluxio to abtain higher stability? Thu, 21 Dec, 08:34
vincent gromakowski             Re: Can spark shuffle leverage Alluxio to abtain higher stability? Fri, 22 Dec, 06:28
Fwd: ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
Vishal Verma   Fwd: ERROR executor.CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM Wed, 20 Dec, 11:29
CondyZhou keep sparkContext alive and wait for next job just like spark-shell Thu, 21 Dec, 03:31
Noorul Islam Kamal Malmiyoda Exception in Shutdown-thread, bad file descriptor Thu, 21 Dec, 04:22
Bang Xiao AM restart in a other node makes SparkSQL jobs into a state of feign death Thu, 21 Dec, 07:02
Bang Xiao AM restart in a other node make SparkSQL job into a state of feign death Thu, 21 Dec, 07:03
marko Reading data from OpenTSDB or KairosDB Thu, 21 Dec, 11:27
Jörn Franke   Re: Reading data from OpenTSDB or KairosDB Thu, 21 Dec, 11:48
marko     Re: Reading data from OpenTSDB or KairosDB Thu, 28 Dec, 11:47
Richard L. Burton III Anyone know where to find independent contractors in New York? Thu, 21 Dec, 16:34
Stephen Boesch   Re: Anyone know where to find independent contractors in New York? Thu, 21 Dec, 17:31
x x     Re: Anyone know where to find independent contractors in New York? Thu, 21 Dec, 19:33
ashish rawat Spark Streaming to REST API Thu, 21 Dec, 20:32
Gourav Sengupta   Re: Spark Streaming to REST API Thu, 21 Dec, 22:30
ashish rawat     Re: Spark Streaming to REST API Fri, 22 Dec, 03:36
Fwd: [pyspark][MLlib] Getting WARN FPGrowth: Input data is not cached for cached data
Anu B Nair   Fwd: [pyspark][MLlib] Getting WARN FPGrowth: Input data is not cached for cached data Fri, 22 Dec, 07:44
Aakash Basu Passing an array of more than 22 elements in a UDF Fri, 22 Dec, 09:24
ayan guha   Re: Passing an array of more than 22 elements in a UDF Fri, 22 Dec, 11:15
Felix Cheung   Re: Passing an array of more than 22 elements in a UDF Mon, 25 Dec, 01:21
Aakash Basu     Re: Passing an array of more than 22 elements in a UDF Tue, 26 Dec, 05:13
Felix Cheung       Re: Passing an array of more than 22 elements in a UDF Tue, 26 Dec, 19:19
Vadim Semenov         Re: Passing an array of more than 22 elements in a UDF Tue, 26 Dec, 19:35
Toy How to do stop streaming before the application got killed Fri, 22 Dec, 17:56
Rastogi, Pankaj   Re: [E] How to do stop streaming before the application got killed Fri, 22 Dec, 18:14
Jean Georges Perrin Storage at node or executor level Sat, 23 Dec, 06:29
kant kodali How to use schema from one of the columns of a dataset to parse another column and create a flattened dataset using Spark Streaming 2.2.0? Sat, 23 Dec, 11:50
puneetloya Structured streaming checkpointing Sat, 23 Dec, 19:46
Re: Custom Data Source for getting data from Rest based services
Subarna Bhattacharyya   Re: Custom Data Source for getting data from Rest based services Sun, 24 Dec, 01:56
Jean Georges Perrin     Re: Custom Data Source for getting data from Rest based services Sun, 24 Dec, 08:07
vaish02   Re: Custom Data Source for getting data from Rest based services Thu, 28 Dec, 19:54
Serkan TAS Which kafka client to use with spark streaming Mon, 25 Dec, 08:16
Diogo Munaro Vieira   Re: Which kafka client to use with spark streaming Tue, 26 Dec, 01:58
Cody Koeninger     Re: Which kafka client to use with spark streaming Tue, 26 Dec, 15:46
Serkan TAS       RE: Which kafka client to use with spark streaming Wed, 27 Dec, 07:47
sujeet jog Spark Docker Mon, 25 Dec, 08:54
Jörn Franke   Re: Spark Docker Mon, 25 Dec, 09:06
Apache Spark - Structured Streaming graceful shutdown
M Singh   Apache Spark - Structured Streaming graceful shutdown Mon, 25 Dec, 21:19
Diogo Munaro Vieira     Re: Apache Spark - Structured Streaming graceful shutdown Tue, 26 Dec, 01:39
M Singh       Re: Apache Spark - Structured Streaming graceful shutdown Tue, 26 Dec, 20:37
Eyal Zituny         Re: Apache Spark - Structured Streaming graceful shutdown Wed, 27 Dec, 09:15
M Singh           Re: Apache Spark - Structured Streaming graceful shutdown Sat, 30 Dec, 22:34
Apache Spark - Structured Streaming from file - checkpointing
M Singh   Apache Spark - Structured Streaming from file - checkpointing Mon, 25 Dec, 21:24
Diogo Munaro Vieira     Re: Apache Spark - Structured Streaming from file - checkpointing Tue, 26 Dec, 01:40
Apache Spark - (2.2.0) - window function for DataSet
M Singh   Apache Spark - (2.2.0) - window function for DataSet Mon, 25 Dec, 22:15
Diogo Munaro Vieira     Re: Apache Spark - (2.2.0) - window function for DataSet Tue, 26 Dec, 01:43
Mu Kong Is there a way to make the broker merge big result set faster? Tue, 26 Dec, 01:46
Shu Li Zheng [Structured Streaming] Reuse computation result Tue, 26 Dec, 10:32
Lalwani, Jayesh   Re: [Structured Streaming] Reuse computation result Fri, 29 Dec, 21:05
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Oct 2020233
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137