spark-user mailing list archives: August 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Re: Spark stages very slow to complete
Olivier Girardot   Re: Spark stages very slow to complete Tue, 25 Aug, 07:39
Yann ROBIN Invalid environment variable name when submitting job from windows Tue, 25 Aug, 07:55
Akhil Das   Re: Invalid environment variable name when submitting job from windows Sun, 30 Aug, 00:27
Jeetendra Gangele spark not launching in yarn-cluster mode Tue, 25 Aug, 08:19
Yanbo Liang   Re: spark not launching in yarn-cluster mode Tue, 25 Aug, 08:56
Jeetendra Gangele     Re: spark not launching in yarn-cluster mode Tue, 25 Aug, 10:13
shahid qadri How to effieciently write sorted neighborhood in pyspark Tue, 25 Aug, 09:45
shahid qadri   Re: How to effieciently write sorted neighborhood in pyspark Tue, 25 Aug, 17:13
sachintyagi22 Checkpointing in Iterative Graph Computation Tue, 25 Aug, 11:15
Todd How to increase data scale in Spark SQL Perf Tue, 25 Aug, 11:22
Ted Yu   Re: How to increase data scale in Spark SQL Perf Tue, 25 Aug, 11:32
Todd     Re:Re: How to increase data scale in Spark SQL Perf Wed, 26 Aug, 01:57
Ted Yu       Re: How to increase data scale in Spark SQL Perf Wed, 26 Aug, 05:01
Todd         Re:Re: How to increase data scale in Spark SQL Perf Wed, 26 Aug, 05:20
Todd           Re:Re:Re: How to increase data scale in Spark SQL Perf Wed, 26 Aug, 08:50
Ted Yu             Re: How to increase data scale in Spark SQL Perf Wed, 26 Aug, 08:57
Todd               Re:Re: How to increase data scale in Spark SQL Perf Wed, 26 Aug, 08:59
Phakin Cheangkrachange Select some data from Hive (SparkSQL) directly using NodeJS Tue, 25 Aug, 11:22
Rajeshkumar J using Convert function of sql in spark sql Tue, 25 Aug, 11:53
storm SparkSQL saveAsParquetFile does not preserve AVRO schema Tue, 25 Aug, 12:13
storm   Re: SparkSQL saveAsParquetFile does not preserve AVRO schema Wed, 26 Aug, 06:55
Saif.A.Ell...@wellsfargo.com Scala: Overload method by its class type Tue, 25 Aug, 13:25
Akhil Das   Re: Scala: Overload method by its class type Sun, 30 Aug, 00:30
Jonathan Coveney   Re: Scala: Overload method by its class type Mon, 31 Aug, 02:58
Kristina Rogale Plazonic Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 13:36
Sonal Goyal   Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 13:41
Kristina Rogale Plazonic     Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 14:35
Sean Owen       Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 15:11
Kristina Rogale Plazonic         Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 15:57
Sean Owen           Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 16:05
Kristina Rogale Plazonic             Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 17:54
Burak Yavuz               Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 17:57
Kristina Rogale Plazonic                 Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 18:06
Feynman Liang                   Re: Adding/subtracting org.apache.spark.mllib.linalg.Vector in Scala? Tue, 25 Aug, 18:23
Garry Chen Spark-Ec2 lunch failed on starting httpd spark 141 Tue, 25 Aug, 14:39
Shivaram Venkataraman   Re: Spark-Ec2 lunch failed on starting httpd spark 141 Tue, 25 Aug, 16:52
Re: Spark-Ec2 launch failed on starting httpd spark 141
Ted Yu   Re: Spark-Ec2 launch failed on starting httpd spark 141 Tue, 25 Aug, 14:55
Ted Yu   Re: Spark-Ec2 launch failed on starting httpd spark 141 Tue, 25 Aug, 17:25
Petr Novak DataFrame Parquet Writer doesn't keep schema Tue, 25 Aug, 15:02
Petr Novak   Re: DataFrame Parquet Writer doesn't keep schema Wed, 26 Aug, 08:49
Priya Ch Spark RDD join with CassandraRDD Tue, 25 Aug, 15:22
Matt Narrell   Re: Spark RDD join with CassandraRDD Tue, 25 Aug, 15:35
YaoPau Pyspark ImportError: No module named definitions Tue, 25 Aug, 15:37
Varadhan, Jawahar Spark (1.2.0) submit fails with exception saying log directory already exists Tue, 25 Aug, 16:37
Marcelo Vanzin   Re: Spark (1.2.0) submit fails with exception saying log directory already exists Tue, 25 Aug, 17:07
jatinpreet CHAID Decision Trees Tue, 25 Aug, 16:39
Feynman Liang   Re: CHAID Decision Trees Tue, 25 Aug, 18:12
Jatinpreet Singh     Re: CHAID Decision Trees Wed, 26 Aug, 04:20
Feynman Liang       Re: CHAID Decision Trees Wed, 26 Aug, 05:40
Muler Error:(46, 66) not found: type SparkFlumeProtocol Tue, 25 Aug, 16:50
Yana Kadiyska [SQL/Hive] Trouble with refreshTable Tue, 25 Aug, 16:51
Colin Gillespie SparkR: exported functions Tue, 25 Aug, 17:26
Felix Cheung   RE: SparkR: exported functions Wed, 26 Aug, 07:08
suchenzang Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 17:53
Cody Koeninger   Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 18:07
Susan Zhang     Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 18:15
Cody Koeninger       Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 18:37
Susan Zhang         Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 18:40
Cody Koeninger           Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 19:07
Susan Zhang             Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 19:36
Cody Koeninger               Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Wed, 26 Aug, 14:12
Susan Zhang                 Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Wed, 26 Aug, 18:04
Cody Koeninger                   Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Wed, 26 Aug, 18:19
Susan Zhang                     Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Wed, 26 Aug, 19:04
Cody Koeninger                       Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Wed, 26 Aug, 19:16
Susan Zhang                         Re: Spark Streaming Checkpointing Restarts with 0 Event Batches Wed, 26 Aug, 21:01
Mike Trienis How to unit test HiveContext without OutOfMemoryError (using sbt) Tue, 25 Aug, 18:10
Yana Kadiyska   Re: How to unit test HiveContext without OutOfMemoryError (using sbt) Tue, 25 Aug, 20:12
Mike Trienis     Re: How to unit test HiveContext without OutOfMemoryError (using sbt) Wed, 26 Aug, 17:51
Michael Armbrust       Re: How to unit test HiveContext without OutOfMemoryError (using sbt) Thu, 27 Aug, 00:53
Fwd: Join with multiple conditions (In reference to SPARK-7197)
Michal Monselise   Fwd: Join with multiple conditions (In reference to SPARK-7197) Tue, 25 Aug, 18:21
Davies Liu     Re: Join with multiple conditions (In reference to SPARK-7197) Tue, 25 Aug, 19:53
Michal Monselise       Re: Join with multiple conditions (In reference to SPARK-7197) Wed, 26 Aug, 23:59
java8964 SparkSQL problem with IBM BigInsight V3 Tue, 25 Aug, 20:41
Jason Persisting sorted parquet tables for future sort merge joins Wed, 26 Aug, 00:11
Jason   Persisting sorted parquet tables for future sort merge joins Wed, 26 Aug, 16:41
Udit Mehta Spark thrift server on yarn Wed, 26 Aug, 00:19
Cheng, Hao   RE: Spark thrift server on yarn Wed, 26 Aug, 00:32
Udit Mehta     Re: Spark thrift server on yarn Wed, 26 Aug, 00:39
Question on take function - Spark Java API
Pankaj Wahane   Question on take function - Spark Java API Wed, 26 Aug, 02:55
Sonal Goyal     Re: Question on take function - Spark Java API Wed, 26 Aug, 07:35
Pankaj Wahane       Re: Question on take function - Spark Java API Wed, 26 Aug, 19:03
Re: use GraphX with Spark Streaming
ponkin   Re: use GraphX with Spark Streaming Wed, 26 Aug, 04:44
Deepesh Maheshwari reduceByKey not working on JavaPairDStream Wed, 26 Aug, 06:05
Sean Owen   Re: reduceByKey not working on JavaPairDStream Wed, 26 Aug, 08:12
Todd BlockNotFoundException when running spark word count on Tachyon Wed, 26 Aug, 06:55
Dibyendu Bhattacharya   Re: BlockNotFoundException when running spark word count on Tachyon Wed, 26 Aug, 07:02
Dibyendu Bhattacharya     Re: BlockNotFoundException when running spark word count on Tachyon Wed, 26 Aug, 07:05
Night Wolf SPARK_DIST_CLASSPATH, primordial class loader & app ClassNotFound Wed, 26 Aug, 07:54
Samya Relation between threads and executor core Wed, 26 Aug, 08:47
Jem Tucker   Re: Relation between threads and executor core Wed, 26 Aug, 08:55
Samya MAITI     RE: Relation between threads and executor core Wed, 26 Aug, 09:05
Jem Tucker       Re: Relation between threads and executor core Wed, 26 Aug, 12:06
lucap Performance issue with Spark join Wed, 26 Aug, 09:38
Hemant Bhanawat   Re: Performance issue with Spark join Wed, 26 Aug, 10:02
Olivier Girardot ClassCastException using DataFrame only when num-executors > 2 ... Wed, 26 Aug, 09:47
Olivier Girardot   Re: ClassCastException using DataFrame only when num-executors > 2 ... Mon, 31 Aug, 16:31
Juan Rodríguez Hortalá JobScheduler: Error generating jobs for time for custom InputDStream Wed, 26 Aug, 11:30
Jaonary Rabarisoa Build k-NN graph for large dataset Wed, 26 Aug, 11:35
Robin East   Re: Build k-NN graph for large dataset Wed, 26 Aug, 11:51
Kristina Rogale Plazonic   Re: Build k-NN graph for large dataset Wed, 26 Aug, 13:24
Michael Malak     Re: Build k-NN graph for large dataset Wed, 26 Aug, 14:57
Charlie Hack       Re: Build k-NN graph for large dataset Wed, 26 Aug, 15:05
Jaonary Rabarisoa         Re: Build k-NN graph for large dataset Thu, 27 Aug, 06:16
Maruf Aytekin           Re: Build k-NN graph for large dataset Sat, 29 Aug, 18:19
Deepesh Maheshwari Custom Offset Management Wed, 26 Aug, 12:55
Cody Koeninger   Re: Custom Offset Management Wed, 26 Aug, 13:20
michael.engl...@nomura.com Spark-on-YARN LOCAL_DIRS location Wed, 26 Aug, 13:26
Akhil Das   Re: Spark-on-YARN LOCAL_DIRS location Sun, 30 Aug, 03:20
Akash Mishra Spark Job Stuck in on stage. Wed, 26 Aug, 13:37
Sameer Farooqui   Re: Spark Job Stuck in on stage. Wed, 26 Aug, 14:37
Akash Mishra     Re: Spark Job Stuck in on stage. Wed, 26 Aug, 15:29
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Nov 2021148
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137