spark-user mailing list archives: July 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Guanhua Yan Confused by groupByKey() and the default partitioner Sat, 12 Jul, 19:20
Aaron Davidson   Re: Confused by groupByKey() and the default partitioner Sat, 12 Jul, 23:32
Guanhua Yan     Re: Confused by groupByKey() and the default partitioner Sun, 13 Jul, 16:13
Aaron Davidson       Re: Confused by groupByKey() and the default partitioner Sun, 13 Jul, 17:51
lokesh.gidra Scalability issue in Spark with SparkPageRank example Sat, 12 Jul, 21:43
Nick Chammas Stopping StreamingContext does not kill receiver Sat, 12 Jul, 22:03
Nicholas Chammas   Re: Stopping StreamingContext does not kill receiver Sat, 12 Jul, 22:21
Tathagata Das     Re: Stopping StreamingContext does not kill receiver Sat, 12 Jul, 22:45
Nicholas Chammas       Re: Stopping StreamingContext does not kill receiver Sat, 12 Jul, 23:28
Parthus Convert from RDD[Object] to RDD[Array[Object]] Sun, 13 Jul, 01:03
Aaron Davidson   Re: Convert from RDD[Object] to RDD[Array[Object]] Sun, 13 Jul, 01:26
Mark Hamstra     Re: Convert from RDD[Object] to RDD[Array[Object]] Sun, 13 Jul, 03:56
Nick Chammas Supported SQL syntax in Spark SQL Sun, 13 Jul, 02:16
Nicholas Chammas   Re: Supported SQL syntax in Spark SQL Mon, 14 Jul, 03:18
Nicholas Chammas     Re: Supported SQL syntax in Spark SQL Mon, 14 Jul, 03:48
Michael Armbrust       Re: Supported SQL syntax in Spark SQL Mon, 14 Jul, 04:05
Nicholas Chammas         Re: Supported SQL syntax in Spark SQL Mon, 14 Jul, 04:41
Martin Gammelsæter           Re: Supported SQL syntax in Spark SQL Mon, 14 Jul, 07:25
Michael Armbrust             Re: Supported SQL syntax in Spark SQL Mon, 14 Jul, 18:06
Nicholas Chammas               Re: Supported SQL syntax in Spark SQL Thu, 17 Jul, 20:17
Kyle Ellrott Large Task Size? Sun, 13 Jul, 02:27
Aaron Davidson   Re: Large Task Size? Sun, 13 Jul, 02:50
Kyle Ellrott     Re: Large Task Size? Sun, 13 Jul, 08:05
Aaron Davidson       Re: Large Task Size? Tue, 15 Jul, 19:00
Ognen Duzlevski         count vs countByValue in for/yield Tue, 15 Jul, 19:23
Ognen Duzlevski           Re: count vs countByValue in for/yield Wed, 16 Jul, 13:03
Kyle Ellrott         Re: Large Task Size? Tue, 15 Jul, 21:45
Kyle Ellrott           Re: Large Task Size? Sun, 20 Jul, 00:42
Xiangrui Meng             Re: Large Task Size? Mon, 21 Jul, 01:27
anyweil Repeated data item search with Spark SQL(1.0.1) Sun, 13 Jul, 06:16
anyweil   Re: Nested Query With Spark SQL(1.0.1) Sun, 13 Jul, 11:11
Michael Armbrust     Re: Nested Query With Spark SQL(1.0.1) Mon, 14 Jul, 20:05
anyweil       Re: Nested Query With Spark SQL(1.0.1) Tue, 15 Jul, 06:25
Michael Armbrust         Re: Nested Query With Spark SQL(1.0.1) Tue, 15 Jul, 06:31
anyweil           Re: Nested Query With Spark SQL(1.0.1) Tue, 15 Jul, 06:50
Michael Armbrust   Re: Repeated data item search with Spark SQL(1.0.1) Mon, 14 Jul, 20:12
anyweil     Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 06:38
Michael Armbrust       Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 06:56
anyweil         Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 07:38
Jerry Lam           Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 19:16
Michael Armbrust             Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 20:32
Jerry Lam               Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 21:50
Michael Armbrust                 Re: Repeated data item search with Spark SQL(1.0.1) Tue, 15 Jul, 22:22
Jerry Lam                   Re: Repeated data item search with Spark SQL(1.0.1) Wed, 16 Jul, 18:13
Michael Armbrust                     Re: Repeated data item search with Spark SQL(1.0.1) Wed, 16 Jul, 19:19
Walrus theCat can't print DStream after reduce Sun, 13 Jul, 08:03
Tathagata Das   Re: can't print DStream after reduce Sun, 13 Jul, 18:34
Walrus theCat     Re: can't print DStream after reduce Sun, 13 Jul, 18:47
Walrus theCat       Re: can't print DStream after reduce Sun, 13 Jul, 21:00
Walrus theCat         Re: can't print DStream after reduce Sun, 13 Jul, 21:24
Michael Campbell           Re: can't print DStream after reduce Sun, 13 Jul, 23:24
Sean Owen             Re: can't print DStream after reduce Sun, 13 Jul, 23:26
Tathagata Das               Re: can't print DStream after reduce Mon, 14 Jul, 19:57
Michael Campbell                 Re: can't print DStream after reduce Wed, 16 Jul, 00:52
Michael Campbell                 Re: can't print DStream after reduce Wed, 16 Jul, 00:57
Tathagata Das                   Re: can't print DStream after reduce Wed, 16 Jul, 02:03
Tobias Pfeiffer                     Re: can't print DStream after reduce Wed, 16 Jul, 04:31
Tathagata Das                       Re: can't print DStream after reduce Wed, 16 Jul, 22:21
Walrus theCat   Re: can't print DStream after reduce Sun, 13 Jul, 18:42
Mahebub Sayyed Error in JavaKafkaWordCount.java example Sun, 13 Jul, 13:43
Ognen Duzlevski   Problem reading in LZO compressed files Sun, 13 Jul, 14:49
Nicholas Chammas     Re: Problem reading in LZO compressed files Sun, 13 Jul, 15:35
Ognen Duzlevski       Re: Problem reading in LZO compressed files Sun, 13 Jul, 16:57
Nicholas Chammas         Re: Problem reading in LZO compressed files Mon, 14 Jul, 00:05
Ognen Duzlevski           Re: Problem reading in LZO compressed files Mon, 14 Jul, 12:54
Tathagata Das   Re: Error in JavaKafkaWordCount.java example Mon, 14 Jul, 19:49
Andy Davidson SparkSql newbie problems with nested selects Sun, 13 Jul, 19:43
Michael Armbrust   Re: SparkSql newbie problems with nested selects Sun, 13 Jul, 20:18
Andy Davidson     Re: SparkSql newbie problems with nested selects Sun, 13 Jul, 21:15
Sébastien Rainville Task serialized size dependent on size of RDD? Sun, 13 Jul, 20:32
lokesh.gidra Ideal core count within a single JVM Sun, 13 Jul, 23:03
Matei Zaharia   Re: Ideal core count within a single JVM Mon, 14 Jul, 19:11
lokesh.gidra     Re: Ideal core count within a single JVM Mon, 14 Jul, 19:23
Matei Zaharia       Re: Ideal core count within a single JVM Mon, 14 Jul, 19:37
lokesh.gidra         Re: Ideal core count within a single JVM Mon, 14 Jul, 20:02
Matei Zaharia           Re: Ideal core count within a single JVM Tue, 15 Jul, 01:39
Matei Zaharia             Re: Ideal core count within a single JVM Tue, 15 Jul, 01:41
lokesh.gidra             Re: Ideal core count within a single JVM Tue, 15 Jul, 20:07
Ron Gonzalez Possible bug in ClientBase.scala? Mon, 14 Jul, 01:49
Nicholas Chammas   Re: Possible bug in ClientBase.scala? Mon, 14 Jul, 01:55
Chester Chen   Re: Possible bug in ClientBase.scala? Mon, 14 Jul, 03:15
Sandy Ryza     Re: Possible bug in ClientBase.scala? Wed, 16 Jul, 23:19
Aniket Bhatnagar Catalyst dependency on Spark Core Mon, 14 Jul, 03:51
Yanbo Liang   Re: Catalyst dependency on Spark Core Mon, 14 Jul, 07:21
Michael Armbrust     Re: Catalyst dependency on Spark Core Mon, 14 Jul, 20:04
Matei Zaharia       Re: Catalyst dependency on Spark Core Mon, 14 Jul, 21:15
Patrick Wendell         Re: Catalyst dependency on Spark Core Tue, 15 Jul, 04:59
Sean Owen           Re: Catalyst dependency on Spark Core Tue, 15 Jul, 10:03
hassan SPARK S3 LZO input; worker stuck Mon, 14 Jul, 04:16
hassan   Re: SPARK S3 LZO input; worker stuck Mon, 14 Jul, 04:33
Madhura mapPartitionsWithIndex Mon, 14 Jul, 06:26
Xiangrui Meng   Re: mapPartitionsWithIndex Mon, 14 Jul, 07:00
Madhura     Re: mapPartitionsWithIndex Mon, 14 Jul, 10:05
crater Error when testing with large sparse svm Mon, 14 Jul, 07:15
Xiangrui Meng   Re: Error when testing with large sparse svm Mon, 14 Jul, 07:29
crater     Re: Error when testing with large sparse svm Mon, 14 Jul, 17:18
Srikrishna S       Re: Error when testing with large sparse svm Mon, 14 Jul, 17:46
crater         Re: Error when testing with large sparse svm Mon, 14 Jul, 18:50
Srikrishna S           Re: Error when testing with large sparse svm Mon, 14 Jul, 19:14
Xiangrui Meng             Re: Error when testing with large sparse svm Tue, 15 Jul, 00:56
Srikrishna S               Re: Error when testing with large sparse svm Tue, 15 Jul, 01:39
crater                 Re: Error when testing with large sparse svm Tue, 15 Jul, 21:51
Xiangrui Meng                   Re: Error when testing with large sparse svm Wed, 16 Jul, 05:38
crater                     Re: Error when testing with large sparse svm Wed, 16 Jul, 05:56
Xiangrui Meng                       Re: Error when testing with large sparse svm Wed, 16 Jul, 06:13
crater                         Re: Error when testing with large sparse svm Thu, 17 Jul, 05:29
crater               Re: Error when testing with large sparse svm Tue, 15 Jul, 04:04
victor sheng spark1.0.1 catalyst transform filter not push down Mon, 14 Jul, 10:42
Yin Huai   Re: spark1.0.1 catalyst transform filter not push down Mon, 14 Jul, 15:08
Victor Sheng     Re: spark1.0.1 catalyst transform filter not push down Tue, 15 Jul, 02:07
boci sbt + idea + test Mon, 14 Jul, 10:50
Niek Tax Running Spark on Microsoft Azure HDInsight Mon, 14 Jul, 11:00
Marco Shaw   Re: Running Spark on Microsoft Azure HDInsight Mon, 14 Jul, 15:43
Marco Shaw     Re: Running Spark on Microsoft Azure HDInsight Mon, 14 Jul, 15:55
Pei-Lun Lee Spark SQL 1.0.1 error on reading fixed length byte array Mon, 14 Jul, 11:17
Michael Armbrust   Re: Spark SQL 1.0.1 error on reading fixed length byte array Mon, 14 Jul, 19:54
Pei-Lun Lee     Re: Spark SQL 1.0.1 error on reading fixed length byte array Tue, 15 Jul, 07:34
Michael Armbrust       Re: Spark SQL 1.0.1 error on reading fixed length byte array Tue, 15 Jul, 08:17
Pei-Lun Lee         Re: Spark SQL 1.0.1 error on reading fixed length byte array Tue, 15 Jul, 11:22
Pei-Lun Lee           Re: Spark SQL 1.0.1 error on reading fixed length byte array Tue, 15 Jul, 11:23
Rahul Bhojwani Error in spark: Exception in thread "delete Spark temp dir" Mon, 14 Jul, 12:16
Rahul Bhojwani Can we get a spark context inside a mapper Mon, 14 Jul, 13:22
Rahul Bhojwani   Re: Can we get a spark context inside a mapper Mon, 14 Jul, 18:30
Daniel Siegmann     Re: Can we get a spark context inside a mapper Mon, 14 Jul, 19:09
Matei Zaharia     Re: Can we get a spark context inside a mapper Mon, 14 Jul, 19:09
Jerry Lam       Re: Can we get a spark context inside a mapper Mon, 14 Jul, 19:21
Rahul Bhojwani         Re: Can we get a spark context inside a mapper Tue, 15 Jul, 22:03
srinivas Spark Streaming Json file groupby function Mon, 14 Jul, 17:59
Tathagata Das   Re: Spark Streaming Json file groupby function Mon, 14 Jul, 19:25
srinivas     Re: Spark Streaming Json file groupby function Mon, 14 Jul, 21:31
srinivas     Re: Spark Streaming Json file groupby function Mon, 14 Jul, 22:06
Tathagata Das       Re: Spark Streaming Json file groupby function Mon, 14 Jul, 22:42
srinivas         Re: Spark Streaming Json file groupby function Tue, 15 Jul, 05:07
Tathagata Das           Re: Spark Streaming Json file groupby function Tue, 15 Jul, 19:54
srinivas             Re: Spark Streaming Json file groupby function Tue, 15 Jul, 20:40
Tathagata Das               Re: Spark Streaming Json file groupby function Wed, 16 Jul, 01:42
srinivas                 Re: Spark Streaming Json file groupby function Wed, 16 Jul, 03:20
Tathagata Das                   Re: Spark Streaming Json file groupby function Wed, 16 Jul, 05:36
srinivas                     Re: Spark Streaming Json file groupby function Wed, 16 Jul, 15:25
Yin Huai                     Re: Spark Streaming Json file groupby function Wed, 16 Jul, 16:50
Tathagata Das                       Re: Spark Streaming Json file groupby function Wed, 16 Jul, 22:38
srinivas                         Re: Spark Streaming Json file groupby function Thu, 17 Jul, 17:32
Tathagata Das                           Re: Spark Streaming Json file groupby function Thu, 17 Jul, 18:39
srinivas                             Re: Spark Streaming Json file groupby function Fri, 18 Jul, 04:40
srinivas                             Re: Spark Streaming Json file groupby function Fri, 18 Jul, 15:24
lalit1303                               Re: Spark Streaming Json file groupby function Wed, 30 Jul, 07:52
Ben Horner Trouble with spark-ec2 script: --ebs-vol-size Mon, 14 Jul, 17:59
Ben Horner   Re: Trouble with spark-ec2 script: --ebs-vol-size Wed, 16 Jul, 15:47
Ben Horner     Re: Trouble with spark-ec2 script: --ebs-vol-size Wed, 16 Jul, 15:53
Chris DuBois       Re: Trouble with spark-ec2 script: --ebs-vol-size Wed, 16 Jul, 16:21
Ben Horner         Re: Trouble with spark-ec2 script: --ebs-vol-size Fri, 18 Jul, 21:37
Daniel Bendavid Gradient Boosted Machines Mon, 14 Jul, 18:24
Ravi Pandya Memory & compute-intensive tasks Mon, 14 Jul, 20:09
Daniel Siegmann   Re: Memory & compute-intensive tasks Mon, 14 Jul, 20:59
Matei Zaharia     Re: Memory & compute-intensive tasks Mon, 14 Jul, 21:12
Daniel Siegmann       Re: Memory & compute-intensive tasks Mon, 14 Jul, 21:20
rpandya         Re: Memory & compute-intensive tasks Wed, 16 Jul, 23:56
Liquan Pei           Re: Memory & compute-intensive tasks Thu, 17 Jul, 00:15
rpandya           Re: Memory & compute-intensive tasks Fri, 18 Jul, 18:42
rpandya             Re: Memory & compute-intensive tasks Fri, 18 Jul, 21:56
rpandya               Re: Memory & compute-intensive tasks Tue, 29 Jul, 17:12
Matei Zaharia                 Re: Memory & compute-intensive tasks Tue, 29 Jul, 21:37
Josh Happoldt Spark 1.0.1 EC2 - Launching Applications Mon, 14 Jul, 20:12
Matei Zaharia   Re: Spark 1.0.1 EC2 - Launching Applications Mon, 14 Jul, 21:16
Aris Vlasakakis Client application that calls Spark and receives an MLlib *model* Scala Object, not just result Mon, 14 Jul, 20:27
Soumya Simanta   Re: Client application that calls Spark and receives an MLlib *model* Scala Object, not just result Mon, 14 Jul, 20:43
Aris     Re: Client application that calls Spark and receives an MLlib *model* Scala Object, not just result Tue, 15 Jul, 23:25
hsy...@gmail.com How to kill running spark yarn application Mon, 14 Jul, 21:08
Jerry Lam   Re: How to kill running spark yarn application Mon, 14 Jul, 21:44
hsy...@gmail.com     Re: How to kill running spark yarn application Mon, 14 Jul, 22:05
Jerry Lam       Re: How to kill running spark yarn application Mon, 14 Jul, 23:29
hsy...@gmail.com         Re: How to kill running spark yarn application Mon, 14 Jul, 23:36
Jerry Lam           Re: How to kill running spark yarn application Tue, 15 Jul, 14:42
Jerry Lam             Re: How to kill running spark yarn application Tue, 15 Jul, 14:55
hsy...@gmail.com               Re: How to kill running spark yarn application Tue, 15 Jul, 17:58
SK Parsing Json object definition spanning multiple lines Mon, 14 Jul, 21:55
durin import org.apache.spark.streaming.twitter._ in Shell Mon, 14 Jul, 22:47
Tathagata Das   Re: import org.apache.spark.streaming.twitter._ in Shell Mon, 14 Jul, 22:52
durin     Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 00:53
Tathagata Das       Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 01:29
Nicholas Chammas     Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 01:29
Tathagata Das       Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 02:48
Nicholas Chammas         Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 02:52
Tathagata Das           Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 03:44
Nicholas Chammas             Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 03:50
Nicholas Chammas               Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 06:29
Praveen Seluka                 Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 07:06
Nick Pentreath                   Re: import org.apache.spark.streaming.twitter._ in Shell Tue, 15 Jul, 08:03
Tathagata Das                     Re: import org.apache.spark.streaming.twitter._ in Shell Wed, 16 Jul, 00:06
Michael Armbrust Change when loading/storing String data using Parquet Mon, 14 Jul, 22:55
hsy...@gmail.com SQL + streaming Mon, 14 Jul, 23:06
Tathagata Das   Re: SQL + streaming Mon, 14 Jul, 23:59
hsy...@gmail.com     Re: SQL + streaming Tue, 15 Jul, 00:25
Tathagata Das       Re: SQL + streaming Tue, 15 Jul, 01:25
hsy...@gmail.com         Re: SQL + streaming Tue, 15 Jul, 04:15
Tathagata Das           Re: SQL + streaming Tue, 15 Jul, 19:48
hsy...@gmail.com             Re: SQL + streaming Tue, 15 Jul, 23:28
hsy...@gmail.com               Re: SQL + streaming Tue, 15 Jul, 23:28
Tathagata Das                 Re: SQL + streaming Wed, 16 Jul, 01:53
hsy...@gmail.com                   Re: SQL + streaming Wed, 16 Jul, 02:52
Tathagata Das                     Re: SQL + streaming Wed, 16 Jul, 05:37
jon.burns Spark-Streaming collect/take functionality. Mon, 14 Jul, 23:11
Tathagata Das   Re: Spark-Streaming collect/take functionality. Tue, 15 Jul, 00:04
jon.burns     Re: Spark-Streaming collect/take functionality. Tue, 15 Jul, 16:41
jamborta running spark from intellj Tue, 15 Jul, 00:17
jamborta   Re: running spark from intellj Tue, 15 Jul, 11:45
jay vyas SPARK_WORKER_PORT (standalone cluster) Tue, 15 Jul, 02:01
jay vyas   Re: SPARK_WORKER_PORT (standalone cluster) Wed, 16 Jul, 19:26
SK jsonRDD: NoSuchMethodError Tue, 15 Jul, 02:06
Michael Armbrust   Re: jsonRDD: NoSuchMethodError Tue, 15 Jul, 02:30
SK     Re: jsonRDD: NoSuchMethodError Tue, 15 Jul, 06:59
SK       Re: jsonRDD: NoSuchMethodError Tue, 15 Jul, 07:50
Re: ---cores option in spark-shell
cjwang   Re: ---cores option in spark-shell Tue, 15 Jul, 02:10
Andrew Or     Re: ---cores option in spark-shell Tue, 15 Jul, 02:31
Nicholas Chammas count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 02:12
Yin Huai   Re: count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 04:16
Nicholas Chammas     Re: count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 04:36
Nicholas Chammas       Re: count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 04:49
Aaron Davidson         Re: count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 05:01
Nicholas Chammas           Re: count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 05:14
Aaron Davidson             Re: count on RDD yields NoClassDefFoundError on 1.0.1 Tue, 15 Jul, 07:03
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Sep 202070
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137