spark-user mailing list archives: November 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
Gerald-G Question About Task Number In A spark Stage Fri, 20 Nov, 09:23
Balachandar R.A. spark-shell issue Job in illegal state & sparkcontext not serializable Fri, 20 Nov, 10:30
glennie How to control number of parquet files generated when using partitionBy Fri, 20 Nov, 11:03
glennie   Re: How to control number of parquet files generated when using partitionBy Fri, 20 Nov, 13:59
Saiph Kappa Spark Streaming - stream between 2 applications Fri, 20 Nov, 13:48
Christian   Re: Spark Streaming - stream between 2 applications Fri, 20 Nov, 18:12
Saiph Kappa     Re: Spark Streaming - stream between 2 applications Fri, 20 Nov, 19:07
Cody Koeninger       Re: Spark Streaming - stream between 2 applications Fri, 20 Nov, 19:18
Christian       Re: Spark Streaming - stream between 2 applications Sat, 21 Nov, 14:40
Patrick McGloin Data in one partition after reduceByKey Fri, 20 Nov, 16:17
Patrick McGloin   Re: Data in one partition after reduceByKey Mon, 23 Nov, 13:35
Ruslan Dautkhanov     Re: Data in one partition after reduceByKey Wed, 25 Nov, 15:05
Tamas Szuromi how to use sc.hadoopConfiguration from pyspark Fri, 20 Nov, 16:23
Eike von Seggern   Re: how to use sc.hadoopConfiguration from pyspark Mon, 23 Nov, 09:21
Tamas Szuromi     Re: how to use sc.hadoopConfiguration from pyspark Mon, 23 Nov, 09:26
Eike von Seggern       Re: how to use sc.hadoopConfiguration from pyspark Mon, 23 Nov, 09:33
Bryan Jeffrey Hive error after update from 1.4.1 to 1.5.2 Fri, 20 Nov, 19:13
Bryan Jeffrey   Re: Hive error after update from 1.4.1 to 1.5.2 Fri, 20 Nov, 19:14
Bryan Jeffrey     Re: Hive error after update from 1.4.1 to 1.5.2 Fri, 20 Nov, 20:07
Kali.tumm...@gmail.com Does spark streaming write ahead log writes all received data to HDFS ? Fri, 20 Nov, 20:26
Tathagata Das   Re: Does spark streaming write ahead log writes all received data to HDFS ? Sat, 21 Nov, 00:04
anshu shukla Corelation between 2 consecutive RDDs in Dstream Fri, 20 Nov, 21:17
FW: starting spark-shell throws /tmp/hive on HDFS should be writable error
Mich Talebzadeh   FW: starting spark-shell throws /tmp/hive on HDFS should be writable error Fri, 20 Nov, 22:43
jluan How to run two operations on the same RDD simultaneously Fri, 20 Nov, 23:38
Ali Tajeldin EDU   Re: How to run two operations on the same RDD simultaneously Fri, 20 Nov, 23:48
Jay Luan     Re: How to run two operations on the same RDD simultaneously Wed, 25 Nov, 22:50
Re: updateStateByKey schedule time
Tathagata Das   Re: updateStateByKey schedule time Sat, 21 Nov, 00:05
Vikram Kone How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 02:46
Ted Yu   Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 03:08
Vikram Kone     Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 03:11
Vikram Kone     Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 06:02
varun sharma       Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 07:29
Ted Yu       Re: How to kill spark applications submitted using spark-submit reliably? Sun, 22 Nov, 22:17
Ted Yu         Re: How to kill spark applications submitted using spark-submit reliably? Mon, 23 Nov, 01:43
Sudhanshu Janghel           Re: How to kill spark applications submitted using spark-submit reliably? Mon, 23 Nov, 06:13
Stéphane Verlet   Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 03:12
Vikram Kone     Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 03:21
Stéphane Verlet       Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 03:49
Ted Yu     Re: How to kill spark applications submitted using spark-submit reliably? Sat, 21 Nov, 04:42
Bryan Initial State Sat, 21 Nov, 02:52
Tathagata Das   Re: Initial State Mon, 23 Nov, 01:00
Bryan     RE: Initial State Mon, 23 Nov, 01:24
hokam chauhan Error in Saving the MLlib models Sat, 21 Nov, 07:30
Hokam Singh Chauhan How to kill the spark job using Java API. Sat, 21 Nov, 07:35
OcterA Spark : merging object with approximation Sat, 21 Nov, 10:24
Karl Higley   Re: Spark : merging object with approximation Wed, 25 Nov, 18:36
Deenar Toraskar Spark-SQL idiomatic way of adding a new partition or writing to Partitioned Persistent Table Sat, 21 Nov, 10:25
Michael Armbrust   Re: Spark-SQL idiomatic way of adding a new partition or writing to Partitioned Persistent Table Sun, 22 Nov, 18:54
Deenar Toraskar     Re: Spark-SQL idiomatic way of adding a new partition or writing to Partitioned Persistent Table Mon, 23 Nov, 01:32
Stephen Boesch       Re: Spark-SQL idiomatic way of adding a new partition or writing to Partitioned Persistent Table Mon, 23 Nov, 02:48
Fengdong Yu How to adjust Spark shell table width Sat, 21 Nov, 14:24
Jagrut Sharma   Re: How to adjust Spark shell table width Sun, 22 Nov, 09:39
Ted Yu     Re: How to adjust Spark shell table width Sun, 22 Nov, 15:49
trung kien RDD partition after calling mapToPair Sat, 21 Nov, 17:46
Cody Koeninger   Re: RDD partition after calling mapToPair Sun, 22 Nov, 17:26
Thúy Hằng Lê     Re: RDD partition after calling mapToPair Mon, 23 Nov, 15:01
Cody Koeninger       Re: RDD partition after calling mapToPair Mon, 23 Nov, 15:19
trung kien         Re: RDD partition after calling mapToPair Wed, 25 Nov, 00:51
Shushant Arora spark shuffle Sat, 21 Nov, 17:51
Shushant Arora   Re: spark shuffle Sun, 22 Nov, 11:21
Andy Davidson newbie : why are thousands of empty files being created on HDFS? Sat, 21 Nov, 18:29
Sabarish Sasidharan   Re: newbie : why are thousands of empty files being created on HDFS? Sun, 22 Nov, 03:20
Andy Davidson     Re: newbie : why are thousands of empty files being created on HDFS? Mon, 23 Nov, 20:15
Xiao Li       Re: newbie : why are thousands of empty files being created on HDFS? Mon, 23 Nov, 20:21
Andy Davidson         Re: newbie : why are thousands of empty files being created on HDFS? Mon, 23 Nov, 22:31
Don Drake           Re: newbie : why are thousands of empty files being created on HDFS? Tue, 24 Nov, 03:10
Andy Davidson             Re: newbie : why are thousands of empty files being created on HDFS? Tue, 24 Nov, 18:54
Sabarish Sasidharan           Re: newbie : why are thousands of empty files being created on HDFS? Tue, 24 Nov, 03:57
Andy Davidson             Re: newbie : why are thousands of empty files being created on HDFS? Tue, 24 Nov, 18:49
emao Closures sent once per executor or copied with each tasks? Sat, 21 Nov, 20:14
Ilango Ravi Datastore for GrpahX Sat, 21 Nov, 21:08
Sonal Goyal   Re: Datastore for GrpahX Mon, 23 Nov, 05:43
ravi.gawai JavaStreamingContext nullpointer exception while fetching data from Cassandra Sun, 22 Nov, 02:03
Sea [Spark Streaming] Unable to write checkpoint when restart Sun, 22 Nov, 05:19
Jeremy Davis Need Help Diagnosing/operating/tuning Sun, 22 Nov, 20:38
Jeremy Davis   Re: Need Help Diagnosing/operating/tuning Mon, 23 Nov, 01:30
Igor Berman     Re: Need Help Diagnosing/operating/tuning Mon, 23 Nov, 22:05
谢廷稳 A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Mon, 23 Nov, 12:41
Saisai Shao   Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Mon, 23 Nov, 13:00
谢廷稳     Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 02:48
Saisai Shao       Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 03:00
谢廷稳         Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 03:54
Saisai Shao           Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 04:00
谢廷稳             Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 04:13
Saisai Shao               Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 05:10
谢廷稳                 Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 06:15
cherrywayb...@gmail.com               Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 06:30
谢廷稳                 Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 06:56
Saisai Shao                   Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 07:14
谢廷稳                     Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 08:28
Sabarish Sasidharan                       Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 08:42
Saisai Shao                         Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 08:47
谢廷稳                           Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 09:12
Saisai Shao                             Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 09:15
谢廷稳                               Re: Re: A Problem About Running Spark 1.5 on YARN with Dynamic Alloction Tue, 24 Nov, 09:53
Bryan Jeffrey DateTime Support - Hive Parquet Mon, 23 Nov, 13:40
Cheng Lian   Re: DateTime Support - Hive Parquet Tue, 24 Nov, 06:42
Bryan     RE: DateTime Support - Hive Parquet Tue, 24 Nov, 11:25
Cheng Lian       Re: DateTime Support - Hive Parquet Tue, 24 Nov, 11:49
Bryan         RE: DateTime Support - Hive Parquet Tue, 24 Nov, 12:05
Cheng Lian           Re: DateTime Support - Hive Parquet Mon, 30 Nov, 07:02
Cesar Flores A question about sql clustering Mon, 23 Nov, 15:27
Siva Gudavalli spark 1.4.1 to oracle 11g write to an existing table Mon, 23 Nov, 16:57
YaoPau Getting different DESCRIBE results between SparkSQL and Hive Mon, 23 Nov, 17:46
swetha Spark Kafka Direct Error Mon, 23 Nov, 18:57
Cody Koeninger   Re: Spark Kafka Direct Error Mon, 23 Nov, 19:01
swetha kasireddy     Re: Spark Kafka Direct Error Tue, 24 Nov, 05:36
Cody Koeninger       Re: Spark Kafka Direct Error Tue, 24 Nov, 14:31
swetha kasireddy         Re: Spark Kafka Direct Error Tue, 24 Nov, 16:28
Cody Koeninger           Re: Spark Kafka Direct Error Tue, 24 Nov, 16:33
swetha kasireddy             Re: Spark Kafka Direct Error Tue, 24 Nov, 16:39
Vishnu Viswanath how to us DataFrame.na.fill based on condition Mon, 23 Nov, 19:05
Davies Liu   Re: how to us DataFrame.na.fill based on condition Mon, 23 Nov, 19:37
Vishnu Viswanath     Re: how to us DataFrame.na.fill based on condition Mon, 23 Nov, 19:57
Davies Liu       Re: how to us DataFrame.na.fill based on condition Mon, 23 Nov, 22:13
spark_user_2015 Dataframe constructor Mon, 23 Nov, 19:09
Fengdong Yu   Re: Dataframe constructor Tue, 24 Nov, 01:16
Daniel Lopes spark-csv on Amazon EMR Mon, 23 Nov, 20:16
Darko Marjanovic Add Data Science Serbia meetup Mon, 23 Nov, 22:34
Any workaround for Kafka couldn't find leaders for set?
Hudong Wang   Any workaround for Kafka couldn't find leaders for set? Mon, 23 Nov, 22:54
Cody Koeninger     Re: Any workaround for Kafka couldn't find leaders for set? Tue, 24 Nov, 02:06
Jakob Odersky Relation between RDDs, DataFrames and Project Tungsten Tue, 24 Nov, 00:18
Michael Armbrust   Re: Relation between RDDs, DataFrames and Project Tungsten Tue, 24 Nov, 01:47
Jakob Odersky     Re: Relation between RDDs, DataFrames and Project Tungsten Tue, 24 Nov, 01:56
Xiao Li       Re: Relation between RDDs, DataFrames and Project Tungsten Tue, 24 Nov, 03:30
Mark Hamstra         Re: Relation between RDDs, DataFrames and Project Tungsten Tue, 24 Nov, 04:28
Jeff Schecter spark-ec2 script to launch cluster running Spark 1.5.2 built with HIVE? Tue, 24 Nov, 00:48
Nicholas Chammas   Re: spark-ec2 script to launch cluster running Spark 1.5.2 built with HIVE? Tue, 24 Nov, 02:33
Jeff Schecter     Re: spark-ec2 script to launch cluster running Spark 1.5.2 built with HIVE? Tue, 24 Nov, 17:55
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
Box list
Dec 202113
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137