spark-user mailing list archives: January 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Hafiz Mujadid creating a single kafka producer object for all partitions Mon, 12 Jan, 10:56
Sean Owen   Re: creating a single kafka producer object for all partitions Mon, 12 Jan, 11:02
kevinkim   Re: creating a single kafka producer object for all partitions Mon, 12 Jan, 11:03
Hafiz Mujadid     Re: creating a single kafka producer object for all partitions Mon, 12 Jan, 11:10
Sean Owen       Re: creating a single kafka producer object for all partitions Mon, 12 Jan, 11:24
Cody Koeninger         Re: creating a single kafka producer object for all partitions Mon, 12 Jan, 14:19
Re: Spark SQL & Parquet - data are reading very very slow
kaushal   Re: Spark SQL & Parquet - data are reading very very slow Mon, 12 Jan, 12:56
Mick Davies   Re: Spark SQL & Parquet - data are reading very very slow Fri, 16 Jan, 11:18
Mick Davies     Re: Spark SQL & Parquet - data are reading very very slow Mon, 19 Jan, 09:05
Alex Minnaar RowMatrix multiplication Mon, 12 Jan, 14:33
Reza Zadeh   Re: RowMatrix multiplication Mon, 12 Jan, 18:58
Alex Minnaar     Re: RowMatrix multiplication Mon, 12 Jan, 19:45
Reza Zadeh       Re: RowMatrix multiplication Mon, 12 Jan, 20:05
Alex Minnaar       Re: RowMatrix multiplication Mon, 12 Jan, 20:35
Toni Verbeiren       Re: RowMatrix multiplication Thu, 15 Jan, 08:49
rkgurram Spark does not loop through a RDD.map Mon, 12 Jan, 15:49
Cody Koeninger   Re: Spark does not loop through a RDD.map Mon, 12 Jan, 16:05
Re: How to use memcached with spark
octavian.ganea   Re: How to use memcached with spark Mon, 12 Jan, 15:52
Akhil Das     Re: How to use memcached with spark Mon, 12 Jan, 16:47
David McWhorter configuring spark.yarn.driver.memoryOverhead on Spark 1.2.0 Mon, 12 Jan, 16:01
Ganelin, Ilya   Re: configuring spark.yarn.driver.memoryOverhead on Spark 1.2.0 Mon, 12 Jan, 16:12
David McWhorter     Re: configuring spark.yarn.driver.memoryOverhead on Spark 1.2.0 Mon, 12 Jan, 16:37
Sean Owen   Re: configuring spark.yarn.driver.memoryOverhead on Spark 1.2.0 Mon, 12 Jan, 16:23
Luis Guerra Spark executors resources. Blocking? Mon, 12 Jan, 16:36
Luis Guerra   Re: Spark executors resources. Blocking? Tue, 13 Jan, 08:19
Brett Meyer     Re: Spark executors resources. Blocking? Wed, 14 Jan, 15:58
Rosner, Frank (Allianz SE) Pattern Matching / Equals on Case Classes in Spark Not Working Mon, 12 Jan, 18:04
Matei Zaharia   Re: Pattern Matching / Equals on Case Classes in Spark Not Working Mon, 12 Jan, 18:53
Rosner, Frank (Allianz SE)     RE: Pattern Matching / Equals on Case Classes in Spark Not Working Tue, 13 Jan, 17:00
maherrt can I buffer flatMap input at each worker node? Mon, 12 Jan, 18:17
Sven Krasser   Re: can I buffer flatMap input at each worker node? Mon, 12 Jan, 18:22
Max Xu ReliableKafkaReceiver stopped receiving data after WriteAheadLogBasedBlockHandler throws TimeoutException Mon, 12 Jan, 20:10
Dibyendu Bhattacharya   Re: ReliableKafkaReceiver stopped receiving data after WriteAheadLogBasedBlockHandler throws TimeoutException Sun, 18 Jan, 17:32
Dan Dong no snappyjava in java.library.path Mon, 12 Jan, 20:28
David Rosenstrauch   Re: no snappyjava in java.library.path Mon, 12 Jan, 20:40
Ethan Wolf Spark Framework handling of Mesos master change Mon, 12 Jan, 20:44
Tim Chen   Re: Spark Framework handling of Mesos master change Mon, 12 Jan, 21:54
Michael Albert How does unmanaged memory work with the executor memory limits? Mon, 12 Jan, 22:06
Marcelo Vanzin   Re: How does unmanaged memory work with the executor memory limits? Mon, 12 Jan, 22:10
Jianguo Li including the spark-mllib in build.sbt Mon, 12 Jan, 22:27
Xiangrui Meng   Re: including the spark-mllib in build.sbt Mon, 12 Jan, 22:40
rajnish How Spark Calculate partition size automatically Mon, 12 Jan, 22:33
Pala M Muthaia Broadcast joins on RDD Mon, 12 Jan, 23:15
Reza Zadeh   Re: Broadcast joins on RDD Tue, 13 Jan, 01:14
Tianshuo Deng [mllib] GradientDescent requires huge memory for storing weight vector Tue, 13 Jan, 00:26
Reza Zadeh   Re: [mllib] GradientDescent requires huge memory for storing weight vector Tue, 13 Jan, 01:01
Simon Chan Re: Is there any Spark implementation for Item-based Collaborative Filtering? Tue, 13 Jan, 02:01
Kevin Burton quickly counting the number of rows in a partition? Tue, 13 Jan, 02:54
Sven Krasser   Re: quickly counting the number of rows in a partition? Tue, 13 Jan, 03:11
Kevin Burton   Re: quickly counting the number of rows in a partition? Tue, 13 Jan, 05:50
Tobias Pfeiffer     Re: quickly counting the number of rows in a partition? Wed, 14 Jan, 01:06
Tobias Pfeiffer       Re: quickly counting the number of rows in a partition? Wed, 14 Jan, 01:07
Ganelin, Ilya       RE: quickly counting the number of rows in a partition? Wed, 14 Jan, 05:17
Michael Segel         Re: quickly counting the number of rows in a partition? Wed, 14 Jan, 18:45
Ilya Ganelin           Re: quickly counting the number of rows in a partition? Wed, 14 Jan, 18:54
Xuelin Cao How to create an empty RDD with a given type? Tue, 13 Jan, 05:50
Justin Yip   Re: How to create an empty RDD with a given type? Tue, 13 Jan, 06:00
Xuelin Cao     Re: How to create an empty RDD with a given type? Tue, 13 Jan, 07:51
Sean Owen   Re: How to create an empty RDD with a given type? Tue, 13 Jan, 09:59
Ajay Srivastava Creating RDD from only few columns of a Parquet file Tue, 13 Jan, 06:20
Ajay Srivastava   Re: Creating RDD from only few columns of a Parquet file Tue, 13 Jan, 08:51
Reynold Xin   Re: Creating RDD from only few columns of a Parquet file Tue, 13 Jan, 08:56
Arun Lists Running Spark application from command line Tue, 13 Jan, 06:58
Arun Lists   Re: Running Spark application from command line Tue, 13 Jan, 18:08
Arun Lists     Re: Running Spark application from command line Tue, 13 Jan, 18:49
Kevin Burton saveAsTextFile just uses toString and Row@37f108 Tue, 13 Jan, 08:03
Reynold Xin   Re: saveAsTextFile just uses toString and Row@37f108 Tue, 13 Jan, 08:54
Anders Arpteg Failing jobs runs twice Tue, 13 Jan, 08:32
Andrew Or   Re: Failing jobs runs twice Tue, 13 Jan, 18:58
Anders Arpteg     Re: Failing jobs runs twice Tue, 13 Jan, 19:00
Anders Arpteg       Re: Failing jobs runs twice Thu, 15 Jan, 14:01
Anders Arpteg         Re: Failing jobs runs twice Fri, 16 Jan, 18:25
Kevin Burton saveAsObjectFile is actually saveAsSequenceFile Tue, 13 Jan, 08:39
Sean Owen   Re: saveAsObjectFile is actually saveAsSequenceFile Tue, 13 Jan, 10:28
Kevin Burton     Re: saveAsObjectFile is actually saveAsSequenceFile Tue, 13 Jan, 22:43
Sean Owen       Re: saveAsObjectFile is actually saveAsSequenceFile Wed, 14 Jan, 09:26
Surbhit Spark Sql reading whole table from cache instead of required coulmns Tue, 13 Jan, 09:46
Cheng Lian   Re: Spark Sql reading whole table from cache instead of required coulmns Tue, 20 Jan, 21:04
Sasi How to define SparkContext with Cassandra connection for spark-jobserver? Tue, 13 Jan, 12:14
abhishek   Re: How to define SparkContext with Cassandra connection for spark-jobserver? Thu, 15 Jan, 14:19
Sasi     Re: How to define SparkContext with Cassandra connection for spark-jobserver? Fri, 16 Jan, 10:29
Night Wolf Problems with Spark Core 1.2.0 SBT project in IntelliJ Tue, 13 Jan, 12:16
Akhil Das   Re: Problems with Spark Core 1.2.0 SBT project in IntelliJ Tue, 13 Jan, 21:15
Enno Shioji   Re: Problems with Spark Core 1.2.0 SBT project in IntelliJ Tue, 13 Jan, 21:45
Jay Vyas     Re: Problems with Spark Core 1.2.0 SBT project in IntelliJ Tue, 13 Jan, 21:52
Night Wolf       Re: Problems with Spark Core 1.2.0 SBT project in IntelliJ Wed, 14 Jan, 05:09
Enno Shioji         Re: Problems with Spark Core 1.2.0 SBT project in IntelliJ Wed, 14 Jan, 07:52
Jem Tucker IndexedRDD Tue, 13 Jan, 13:35
Andrew Ash   Re: IndexedRDD Tue, 13 Jan, 16:06
Jerry Lam     Re: IndexedRDD Tue, 13 Jan, 17:05
Jem Tucker       Re: IndexedRDD Tue, 13 Jan, 18:16
Re: Job getting killed
akhandeshi   Re: Job getting killed Tue, 13 Jan, 15:07
Re: Unable to find configuration file at location scalastyle-config.xml
Sean Owen   Re: Unable to find configuration file at location scalastyle-config.xml Tue, 13 Jan, 16:21
thomas j Querying over mutliple (avro) files using Spark SQL Tue, 13 Jan, 17:25
jeremy p Unread block data exception when reading from HBase Tue, 13 Jan, 17:45
jeremy p Can't run Spark java code from command line Tue, 13 Jan, 17:45
Akhil Das   Re: Can't run Spark java code from command line Tue, 13 Jan, 21:10
Ye Xianjin     Re: Can't run Spark java code from command line Wed, 14 Jan, 04:27
jamborta save spark streaming output to single file on hdfs Tue, 13 Jan, 18:04
Davies Liu   Re: save spark streaming output to single file on hdfs Tue, 13 Jan, 18:15
Tamas Jambor     Re: save spark streaming output to single file on hdfs Tue, 13 Jan, 18:35
Davies Liu       Re: save spark streaming output to single file on hdfs Tue, 13 Jan, 19:08
Prannoy   Re: save spark streaming output to single file on hdfs Thu, 15 Jan, 16:37
jamborta     Re: save spark streaming output to single file on hdfs Thu, 15 Jan, 23:43
akhandeshi ExternalSorter - spilling in-memory map Tue, 13 Jan, 18:29
Shuai Zheng Why always spilling to disk and how to improve it? Tue, 13 Jan, 20:21
Sven Krasser   Re: Why always spilling to disk and how to improve it? Tue, 13 Jan, 20:50
Akhil Das   Re: Why always spilling to disk and how to improve it? Tue, 13 Jan, 20:53
Shuai Zheng     RE: Why always spilling to disk and how to improve it? Wed, 14 Jan, 20:10
Yana Kadiyska [SparkSQL] Try2: Parquet predicate pushdown troubles Tue, 13 Jan, 20:56
Cheng Lian   Re: [SparkSQL] Try2: Parquet predicate pushdown troubles Wed, 21 Jan, 02:07
Yana Kadiyska     Re: [SparkSQL] Try2: Parquet predicate pushdown troubles Wed, 21 Jan, 15:11
Cheng Lian       Re: [SparkSQL] Try2: Parquet predicate pushdown troubles Wed, 21 Jan, 18:39
Cheng Lian         Re: [SparkSQL] Try2: Parquet predicate pushdown troubles Thu, 29 Jan, 01:15
Puneet Kapoor Save RDD with partition information Tue, 13 Jan, 21:30
Raghavendra Pandey   Re: Save RDD with partition information Wed, 14 Jan, 05:17
lihu   Re: Save RDD with partition information Wed, 14 Jan, 05:42
lihu   Re: Save RDD with partition information Wed, 14 Jan, 05:45
ankits spark.cleaner questions Tue, 13 Jan, 21:41
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Oct 201966
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137