spark-user mailing list archives: September 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Shing Hing Man Spark-cassandra-connector 1.0.0-rc5: java.io.NotSerializableException Fri, 05 Sep, 14:26
rapelly kartheek replicated rdd storage problem Fri, 05 Sep, 15:42
Penny Espinoza spark-streaming-kafka with broadcast variable Fri, 05 Sep, 17:36
Tathagata Das   Re: spark-streaming-kafka with broadcast variable Fri, 05 Sep, 18:22
Re: how to choose right DStream batch interval
qihong   Re: how to choose right DStream batch interval Fri, 05 Sep, 19:09
Mayur Rustagi     Re: how to choose right DStream batch interval Sun, 07 Sep, 15:43
qihong       Re: how to choose right DStream batch interval Wed, 10 Sep, 04:23
Tim Smith         Re: how to choose right DStream batch interval Wed, 10 Sep, 18:28
Re: Shared variable in Spark Streaming
Chris Fregly   Re: Shared variable in Spark Streaming Fri, 05 Sep, 19:42
Tathagata Das     Re: Shared variable in Spark Streaming Fri, 05 Sep, 20:22
anthonyjschu...@gmail.com Repartition inefficient Fri, 05 Sep, 20:09
Re: Sparse Matrices support in Spark
anthonyjschu...@gmail.com   Re: Sparse Matrices support in Spark Fri, 05 Sep, 20:24
yannis_at     Re: Sparse Matrices support in Spark Fri, 05 Sep, 20:46
Penny Espinoza prepending jars to the driver class path for spark-submit on YARN Fri, 05 Sep, 23:33
Victor Tso-Guillen   Re: prepending jars to the driver class path for spark-submit on YARN Sun, 07 Sep, 00:13
Xiangrui Meng     Re: prepending jars to the driver class path for spark-submit on YARN Mon, 08 Sep, 06:40
Penny Espinoza     RE: prepending jars to the driver class path for spark-submit on YARN Mon, 08 Sep, 17:46
Xiangrui Meng       Re: prepending jars to the driver class path for spark-submit on YARN Mon, 08 Sep, 19:01
Penny Espinoza     RE: prepending jars to the driver class path for spark-submit on YARN Mon, 08 Sep, 19:03
Penny Espinoza       Re: prepending jars to the driver class path for spark-submit on YARN Tue, 09 Sep, 20:32
Penny Espinoza   RE: prepending jars to the driver class path for spark-submit on YARN Mon, 08 Sep, 19:44
Re: Huge matrix
Debasish Das   Re: Huge matrix Sat, 06 Sep, 01:14
Reza Zadeh     Re: Huge matrix Sat, 06 Sep, 02:40
Debasish Das       Re: Huge matrix Sat, 06 Sep, 02:43
Reza Zadeh         Re: Huge matrix Sat, 06 Sep, 02:48
Debasish Das           Re: Huge matrix Sat, 06 Sep, 02:54
Debasish Das             Re: Huge matrix Sat, 06 Sep, 03:02
Reza Zadeh               Re: Huge matrix Sat, 06 Sep, 03:13
Debasish Das                 Re: Huge matrix Sat, 06 Sep, 03:20
Reza Zadeh                   Re: Huge matrix Sat, 06 Sep, 03:55
Debasish Das                     Re: Huge matrix Sat, 06 Sep, 04:15
Reza Zadeh                       Re: Huge matrix Sat, 06 Sep, 04:43
Debasish Das                         Re: Huge matrix Tue, 09 Sep, 07:05
Reza Zadeh                           Re: Huge matrix Tue, 09 Sep, 08:14
Debasish Das                             Re: Huge matrix Tue, 09 Sep, 14:03
Reza Zadeh                               Re: Huge matrix Tue, 09 Sep, 16:45
Debasish Das                                 Re: Huge matrix Thu, 18 Sep, 01:52
Reza Zadeh                                   Re: Huge matrix Thu, 18 Sep, 17:34
Debasish Das                                     Re: Huge matrix Thu, 18 Sep, 17:43
Debasish Das                                     Re: Huge matrix Thu, 18 Sep, 21:06
Reza Zadeh                                       Re: Huge matrix Thu, 18 Sep, 21:08
Debasish Das                                         Re: Huge matrix Thu, 18 Sep, 21:33
Deep Pradhan Array and RDDs Sat, 06 Sep, 05:21
Mayur Rustagi   Re: Array and RDDs Sun, 07 Sep, 15:27
Deep Pradhan How to change the values in Array of Bytes Sat, 06 Sep, 09:09
Aaron Davidson   Re: How to change the values in Array of Bytes Sat, 06 Sep, 10:48
Murali Raju unsubscribe Sat, 06 Sep, 11:48
Derek Schoettle   Re: unsubscribe Sat, 06 Sep, 11:52
Nicholas Chammas     Re: unsubscribe Sat, 06 Sep, 13:41
jamborta Spark SQL check if query is completed (pyspark) Sat, 06 Sep, 13:02
Davies Liu   Re: Spark SQL check if query is completed (pyspark) Sat, 06 Sep, 18:11
Michael Armbrust     Re: Spark SQL check if query is completed (pyspark) Sun, 07 Sep, 21:18
jamborta       Re: Spark SQL check if query is completed (pyspark) Mon, 08 Sep, 10:02
Michael Armbrust         Re: Spark SQL check if query is completed (pyspark) Mon, 08 Sep, 21:54
Q: About scenarios where driver execution flow may block...
didata   Q: About scenarios where driver execution flow may block... Sat, 06 Sep, 18:44
Mayur Rustagi     Re: Q: About scenarios where driver execution flow may block... Sun, 07 Sep, 15:23
jchen Spark Streaming and database access (e.g. MySQL) Sun, 07 Sep, 06:24
Mayur Rustagi   Re: Spark Streaming and database access (e.g. MySQL) Sun, 07 Sep, 15:19
Sean Owen     Re: Spark Streaming and database access (e.g. MySQL) Sun, 07 Sep, 20:26
Soumitra Kumar       Re: Spark Streaming and database access (e.g. MySQL) Sun, 07 Sep, 23:29
Sean Owen         Re: Spark Streaming and database access (e.g. MySQL) Mon, 08 Sep, 07:39
Tobias Pfeiffer           Re: Spark Streaming and database access (e.g. MySQL) Mon, 08 Sep, 08:02
Mayur Rustagi             Re: Spark Streaming and database access (e.g. MySQL) Wed, 10 Sep, 07:51
Sandeep Singh Crawler and Scraper with different priorities Sun, 07 Sep, 07:15
Daniil Osipov   Re: Crawler and Scraper with different priorities Mon, 08 Sep, 19:15
Sandeep Singh     Re: Crawler and Scraper with different priorities Tue, 09 Sep, 05:27
Peng Cheng       Re: Crawler and Scraper with different priorities Wed, 10 Sep, 00:11
Tomer Benyamini Adding quota to the ephemeral hdfs on a standalone spark cluster on ec2 Sun, 07 Sep, 12:27
Ognen Duzlevski   Re: Adding quota to the ephemeral hdfs on a standalone spark cluster on ec2 Sun, 07 Sep, 13:29
Tomer Benyamini     Re: Adding quota to the ephemeral hdfs on a standalone spark cluster on ec2 Sun, 07 Sep, 13:37
Fwd: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop.
Ognen Duzlevski   Fwd: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop. Sun, 07 Sep, 13:31
Marcelo Vanzin     Re: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop. Wed, 10 Sep, 18:25
Andrew Or       Re: DELIVERY FAILURE: Error transferring to QCMBSJ601.HERMES.SI.SOCGEN; Maximum hop count exceeded. Message probably in a routing loop. Wed, 10 Sep, 21:49
Tomer Benyamini distcp on ec2 standalone spark cluster Sun, 07 Sep, 13:42
Ye Xianjin   Re: distcp on ec2 standalone spark cluster Sun, 07 Sep, 16:25
Tomer Benyamini     Re: distcp on ec2 standalone spark cluster Sun, 07 Sep, 16:33
Nicholas Chammas       Re: distcp on ec2 standalone spark cluster Sun, 07 Sep, 18:19
Josh Rosen   Re: distcp on ec2 standalone spark cluster Sun, 07 Sep, 18:27
Tomer Benyamini     Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 07:28
Frank Austin Nothaft       Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 07:33
Nicholas Chammas       Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 14:57
Tomer Benyamini         Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 15:13
Ye Xianjin           Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 15:39
Tomer Benyamini             Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 16:08
Ye Xianjin               Re: distcp on ec2 standalone spark cluster Mon, 08 Sep, 16:50
julyfire Spark groupByKey partition out of memory Mon, 08 Sep, 00:23
Otis Gospodnetic Deployment model popularity - Standard vs. YARN vs. Mesos vs. SIMR Mon, 08 Sep, 01:29
Patrick Wendell   Re: Deployment model popularity - Standard vs. YARN vs. Mesos vs. SIMR Mon, 08 Sep, 03:02
durin Solving Systems of Linear Equations Using Spark? Mon, 08 Sep, 04:59
Xiangrui Meng   Re: Solving Systems of Linear Equations Using Spark? Mon, 08 Sep, 06:34
Debasish Das     Re: Solving Systems of Linear Equations Using Spark? Mon, 08 Sep, 14:04
Debasish Das       Re: Solving Systems of Linear Equations Using Spark? Mon, 08 Sep, 14:12
Xiangrui Meng         Re: Solving Systems of Linear Equations Using Spark? Mon, 08 Sep, 19:37
Debasish Das           Re: Solving Systems of Linear Equations Using Spark? Mon, 08 Sep, 20:15
durin       Re: Solving Systems of Linear Equations Using Spark? Mon, 22 Sep, 23:58
Manku Timma sharing off_heap rdds Mon, 08 Sep, 08:59
rapelly kartheek How to profile a spark application Mon, 08 Sep, 09:48
Ted Yu   Re: How to profile a spark application Mon, 08 Sep, 10:03
rapelly kartheek     Re: How to profile a spark application Mon, 08 Sep, 14:55
rapelly kartheek       Re: How to profile a spark application Tue, 09 Sep, 04:53
julyfire   Re: How to profile a spark application Tue, 09 Sep, 06:47
Re: Standalone spark cluster. Can't submit job programmatically -> java.io.InvalidClassException
DrKhu   Re: Standalone spark cluster. Can't submit job programmatically -> java.io.InvalidClassException Mon, 08 Sep, 13:36
남윤민 spark application in cluster mode doesn't run correctly Mon, 08 Sep, 13:40
남윤민 Error while running sparkSQL application in the cluster-mode environment Mon, 08 Sep, 13:46
richiesgr How to scale large kafka topic Mon, 08 Sep, 13:47
Dimension Data, LLC.   If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 16:35
Marcelo Vanzin     Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 16:41
Dimension Data, LLC.       Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 17:00
Marcelo Vanzin         Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 17:36
Dimension Data, LLC.           Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 18:52
Marcelo Vanzin             Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 19:46
Dimension Data, LLC.               Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 22:54
Marcelo Vanzin                 Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Mon, 08 Sep, 23:41
Dimension Data, LLC.                   Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Tue, 09 Sep, 01:00
Marcelo Vanzin                     Re: If for YARN you use 'spark.yarn.jar', what is the LOCAL equivalent to that property ... Tue, 09 Sep, 17:10
Greg Hill clarification for some spark on yarn configuration options Mon, 08 Sep, 13:59
Andrew Or   Re: clarification for some spark on yarn configuration options Tue, 09 Sep, 22:49
Greg Hill     Re: clarification for some spark on yarn configuration options Mon, 22 Sep, 20:26
Nishkam Ravi       Re: clarification for some spark on yarn configuration options Mon, 22 Sep, 20:30
Greg Hill         Re: clarification for some spark on yarn configuration options Mon, 22 Sep, 20:41
Nishkam Ravi           Re: clarification for some spark on yarn configuration options Mon, 22 Sep, 21:04
Andrew Or             Re: clarification for some spark on yarn configuration options Tue, 23 Sep, 01:11
Greg Hill               Re: clarification for some spark on yarn configuration options Tue, 23 Sep, 14:23
Andrew Or                 Re: clarification for some spark on yarn configuration options Tue, 23 Sep, 21:53
Greg Hill   Re: clarification for some spark on yarn configuration options Mon, 22 Sep, 20:32
ericacm Cannot run SimpleApp as regular Java app Mon, 08 Sep, 14:16
Yana Kadiyska   Re: Cannot run SimpleApp as regular Java app Tue, 09 Sep, 19:05
ericacm     Re: Cannot run SimpleApp as regular Java app Wed, 10 Sep, 00:28
ericacm       Re: Cannot run SimpleApp as regular Java app Thu, 18 Sep, 15:57
ericacm         Re: Cannot run SimpleApp as regular Java app Fri, 19 Sep, 16:12
gtinside Spark SQL on Cassandra Mon, 08 Sep, 14:22
Michael Armbrust   Re: Spark SQL on Cassandra Mon, 08 Sep, 22:10
Hui Li A problem for running MLLIB in amazon clound Mon, 08 Sep, 14:23
Xiangrui Meng   Re: A problem for running MLLIB in amazon clound Mon, 08 Sep, 19:01
redocpot groupBy gives non deterministic results Mon, 08 Sep, 14:29
redocpot   Re: groupBy gives non deterministic results Mon, 08 Sep, 15:16
Davies Liu     Re: groupBy gives non deterministic results Tue, 09 Sep, 07:06
Ye Xianjin   Re: groupBy gives non deterministic results Tue, 09 Sep, 08:25
redocpot     Re: groupBy gives non deterministic results Tue, 09 Sep, 14:03
Davies Liu       Re: groupBy gives non deterministic results Tue, 09 Sep, 17:22
redocpot         Re: groupBy gives non deterministic results Wed, 10 Sep, 10:03
Ye Xianjin           Re: groupBy gives non deterministic results Wed, 10 Sep, 10:29
redocpot             Re: groupBy gives non deterministic results Wed, 10 Sep, 12:07
redocpot             Re: groupBy gives non deterministic results Wed, 10 Sep, 13:05
Ye Xianjin               Re: groupBy gives non deterministic results Wed, 10 Sep, 13:29
Davies Liu                 Re: groupBy gives non deterministic results Wed, 10 Sep, 16:12
Ye Xianjin                   Re: groupBy gives non deterministic results Wed, 10 Sep, 17:16
DrKhu How do you perform blocking IO in apache spark job? Mon, 08 Sep, 15:30
Jörn Franke   Re: How do you perform blocking IO in apache spark job? Mon, 08 Sep, 15:40
DrKhu     Re: How do you perform blocking IO in apache spark job? Mon, 08 Sep, 15:51
Jörn Franke       Re: How do you perform blocking IO in apache spark job? Mon, 08 Sep, 18:22
Sean Owen   Re: How do you perform blocking IO in apache spark job? Mon, 08 Sep, 15:54
DrKhu     Re: How do you perform blocking IO in apache spark job? Mon, 08 Sep, 16:49
Hemanth Yamijala Setting Kafka parameters in Spark Streaming Mon, 08 Sep, 16:48
Shao, Saisai   RE: Setting Kafka parameters in Spark Streaming Tue, 09 Sep, 02:51
Hemanth Yamijala     Re: Setting Kafka parameters in Spark Streaming Tue, 09 Sep, 05:18
Shao, Saisai       RE: Setting Kafka parameters in Spark Streaming Tue, 09 Sep, 05:39
Peter Aberline Spark-submit ClassNotFoundException with JAR! Mon, 08 Sep, 17:03
Arun Ahuja Input Field in Spark 1.1 Web UI Mon, 08 Sep, 19:25
Dariusz Kobylarz saveAsHadoopFile into avro format Mon, 08 Sep, 19:46
danilopds Records - Input Byte Mon, 08 Sep, 20:54
Mayur Rustagi   Re: Records - Input Byte Wed, 10 Sep, 05:13
Manu Mukerji Recommendations for performance Mon, 08 Sep, 21:37
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Sep 202186
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137