spark-user mailing list archives: August 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Todd About Databricks's spark-sql-perf Thu, 13 Aug, 13:49
Michael Armbrust   Re: About Databricks's spark-sql-perf Thu, 13 Aug, 18:13
Todd     Re:Re: About Databricks's spark-sql-perf Thu, 13 Aug, 22:18
Yin Huai   Re: About Databricks's spark-sql-perf Thu, 13 Aug, 18:30
Re: Question regarding join with multiple columns with pyspark
Dan LaBar   Re: Question regarding join with multiple columns with pyspark Thu, 13 Aug, 14:10
Eugene Morozov Eviction of RDD persisted on disk Thu, 13 Aug, 14:15
Re: saveToCassandra not working in Spark Job but works in Spark Shell
satish chandra j   Re: saveToCassandra not working in Spark Job but works in Spark Shell Thu, 13 Aug, 14:29
Akhil Das     Re: saveToCassandra not working in Spark Job but works in Spark Shell Fri, 14 Aug, 09:14
satish chandra j       Re: saveToCassandra not working in Spark Job but works in Spark Shell Fri, 14 Aug, 10:30
Ewan Leith Create column in nested structure? Thu, 13 Aug, 14:44
Ewan Leith   RE: Create column in nested structure? Thu, 13 Aug, 14:54
allonsy spark.streaming.maxRatePerPartition parameter: what are the benefits? Thu, 13 Aug, 14:50
Cody Koeninger   Re: spark.streaming.maxRatePerPartition parameter: what are the benefits? Thu, 13 Aug, 23:00
UMESH CHAUDHARY Streaming on Exponential Data Thu, 13 Aug, 15:55
Hemant Bhanawat   Re: Streaming on Exponential Data Fri, 14 Aug, 06:00
Wyss Michael (wysm) Spark 1.3.0: ExecutorLostFailure depending on input file size Thu, 13 Aug, 17:33
Mohit Anchlia Spark RuntimeException hadoop output format Thu, 13 Aug, 17:49
Mohit Anchlia   Re: Spark RuntimeException hadoop output format Fri, 14 Aug, 05:21
Ted Yu     Re: Spark RuntimeException hadoop output format Fri, 14 Aug, 13:15
Mohit Anchlia       Re: Spark RuntimeException hadoop output format Fri, 14 Aug, 20:36
Ted Yu         Re: Spark RuntimeException hadoop output format Fri, 14 Aug, 23:36
Mohit Anchlia           Re: Spark RuntimeException hadoop output format Fri, 14 Aug, 23:38
Ted Yu             Re: Spark RuntimeException hadoop output format Sat, 15 Aug, 00:29
Priya Ch Write to cassandra...each individual statement Thu, 13 Aug, 18:30
Philip Weaver   Re: Write to cassandra...each individual statement Thu, 13 Aug, 18:37
Priya Ch     Re: Write to cassandra...each individual statement Thu, 13 Aug, 18:48
Philip Weaver       Re: Write to cassandra...each individual statement Thu, 13 Aug, 19:22
Fwd: - Spark 1.4.1 - run-example SparkPi - Failure ...
Naga Vij   Fwd: - Spark 1.4.1 - run-example SparkPi - Failure ... Thu, 13 Aug, 18:46
Benyi Wang MatrixFactorizationModel.save got StackOverflowError Thu, 13 Aug, 19:02
Xiao JIANG RDD.join vs spark SQL join Thu, 13 Aug, 19:55
Akhil Das   Re: RDD.join vs spark SQL join Fri, 14 Aug, 09:21
Xiao JIANG   RE: RDD.join vs spark SQL join Sat, 15 Aug, 22:42
Sereday, Scott New Spark User - GBM iterations and Spark benchmarks Thu, 13 Aug, 20:24
Matt Forbes Input size increasing every iteration of gradient boosted trees [1.4] Thu, 13 Aug, 21:04
Sean Owen   Re: Input size increasing every iteration of gradient boosted trees [1.4] Thu, 13 Aug, 21:33
Matt Forbes     Re: Input size increasing every iteration of gradient boosted trees [1.4] Fri, 14 Aug, 00:29
Stephen Durfey Retrieving offsets from previous spark streaming checkpoint Thu, 13 Aug, 21:53
Cody Koeninger   Re: Retrieving offsets from previous spark streaming checkpoint Thu, 13 Aug, 23:03
Tech Meme Custom serialization and checkpointing Thu, 13 Aug, 23:32
dizzy5112 graphx class not found error Fri, 14 Aug, 01:17
Ted Yu   Re: graphx class not found error Fri, 14 Aug, 01:18
dizzy5112   Re: graphx class not found error Fri, 14 Aug, 01:19
Re: ERROR Executor java.lang.NoClassDefFoundError
nsalian   Re: ERROR Executor java.lang.NoClassDefFoundError Fri, 14 Aug, 02:08
Alexander Pivovarov Reduce number of partitions before saving to file. coalesce or repartition? Fri, 14 Aug, 02:56
Anish Haldiya   Re: Reduce number of partitions before saving to file. coalesce or repartition? Fri, 14 Aug, 06:14
randylu Always two tasks slower than others, and then job fails Fri, 14 Aug, 03:01
Jeff Zhang   Re: Always two tasks slower than others, and then job fails Fri, 14 Aug, 07:36
Zolt├ín Zvara     Re: Always two tasks slower than others, and then job fails Fri, 14 Aug, 09:34
kale spark streaming map use external variable occur a problem Fri, 14 Aug, 03:02
Shixiong Zhu   Re: spark streaming map use external variable occur a problem Fri, 14 Aug, 10:07
Todd Materials for deep insight into Spark SQL Fri, 14 Aug, 03:54
Ted Yu   Re: Materials for deep insight into Spark SQL Fri, 14 Aug, 04:02
Todd     Re:Re: Materials for deep insight into Spark SQL Fri, 14 Aug, 07:01
go canal matrix inverse and multiplication Fri, 14 Aug, 03:59
go canal   Re: matrix inverse and multiplication Fri, 14 Aug, 07:52
James Pirz worker and executor memory Fri, 14 Aug, 04:10
James Pirz   Re: worker and executor memory Fri, 14 Aug, 22:34
Mohit Durgapal how do you convert directstream into data frames Fri, 14 Aug, 04:41
Mohit Durgapal   Re: how do you convert directstream into data frames Fri, 14 Aug, 05:15
Ara Vartanian Driver staggering task launch times Fri, 14 Aug, 05:13
Philip Weaver   Re: Driver staggering task launch times Fri, 14 Aug, 05:58
Ara Vartanian     Re: Driver staggering task launch times Fri, 14 Aug, 06:03
Philip Weaver       Re: Driver staggering task launch times Fri, 14 Aug, 06:05
mark Using unserializable classes in tasks Fri, 14 Aug, 07:05
Dawid Wysakowicz   Fwd: Using unserializable classes in tasks Fri, 14 Aug, 07:33
Dawid Wysakowicz   Re: Using unserializable classes in tasks Fri, 14 Aug, 07:43
Akhil Das     Re: Using unserializable classes in tasks Tue, 25 Aug, 09:26
Re: spark.files.userClassPathFirst=true Return Error - Please help
Kyle Lin   Re: spark.files.userClassPathFirst=true Return Error - Please help Fri, 14 Aug, 08:35
Akhil Das     Re: spark.files.userClassPathFirst=true Return Error - Please help Fri, 14 Aug, 09:11
Kyle Lin       Re: spark.files.userClassPathFirst=true Return Error - Please help Fri, 14 Aug, 10:25
hide Spark job endup with NPE Fri, 14 Aug, 11:05
Akhil Das   Re: Spark job endup with NPE Fri, 14 Aug, 15:02
stelsavva Error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration Fri, 14 Aug, 11:59
Stephen Boesch   Re: Error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration Fri, 14 Aug, 13:19
Rishi Yadav     Re: Error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration Sun, 16 Aug, 16:55
VIJAYAKUMAR JAWAHARLAL Left outer joining big data set with small lookups Fri, 14 Aug, 13:39
Silvio Fiorito   Re: Left outer joining big data set with small lookups Fri, 14 Aug, 14:27
VIJAYAKUMAR JAWAHARLAL     Re: Left outer joining big data set with small lookups Mon, 17 Aug, 16:39
Silvio Fiorito       Re: Left outer joining big data set with small lookups Mon, 17 Aug, 16:52
VIJAYAKUMAR JAWAHARLAL         Re: Left outer joining big data set with small lookups Tue, 18 Aug, 17:30
Raghavendra Pandey   Re: Left outer joining big data set with small lookups Sat, 15 Aug, 02:10
Saif.A.Ell...@wellsfargo.com Cannot cast to Tuple when running in cluster mode Fri, 14 Aug, 15:34
Akhil Das   Re: Cannot cast to Tuple when running in cluster mode Mon, 17 Aug, 09:11
Re: Maintaining Kafka Direct API Offsets
dutrow   Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 15:36
Cody Koeninger     Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 15:40
dutrow   Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 15:42
dutrow     Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 17:34
Cody Koeninger       Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 19:21
Dan Dutrow         Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 19:58
Jerry Another issue with using lag and lead with data frames Fri, 14 Aug, 16:50
Salih Oztop   Re: Another issue with using lag and lead with data frames Fri, 14 Aug, 20:23
Jerry     Re: Another issue with using lag and lead with data frames Fri, 14 Aug, 20:39
Jerry       Re: Another issue with using lag and lead with data frames Fri, 14 Aug, 20:57
Fwd: Graphx - how to add vertices to a HashSet of vertices ?
Ranjana Rajendran   Fwd: Graphx - how to add vertices to a HashSet of vertices ? Fri, 14 Aug, 18:04
Re: Checkpointing doesn't appear to be working for direct streaming from Kafka
Dmitry Goldenberg   Re: Checkpointing doesn't appear to be working for direct streaming from Kafka Fri, 14 Aug, 19:31
Cody Koeninger     Re: Checkpointing doesn't appear to be working for direct streaming from Kafka Fri, 14 Aug, 22:17
Dmitry Goldenberg       Re: Checkpointing doesn't appear to be working for direct streaming from Kafka Sat, 15 Aug, 01:19
Asim Jalis QueueStream Does Not Support Checkpointing Fri, 14 Aug, 20:04
Tathagata Das   Re: QueueStream Does Not Support Checkpointing Fri, 14 Aug, 22:35
Holden Karau     Re: QueueStream Does Not Support Checkpointing Fri, 14 Aug, 23:03
Asim Jalis       Re: QueueStream Does Not Support Checkpointing Sat, 15 Aug, 00:43
Asim Jalis         Re: QueueStream Does Not Support Checkpointing Sat, 15 Aug, 00:49
Saif.A.Ell...@wellsfargo.com Help with persist: Data is requested again Fri, 14 Aug, 21:11
Akhil Das   Re: Help with persist: Data is requested again Mon, 17 Aug, 09:14
Re: Setting up Spark/flume/? to Ingest 10TB from FTP
Varadhan, Jawahar   Re: Setting up Spark/flume/? to Ingest 10TB from FTP Fri, 14 Aug, 21:11
Marcelo Vanzin     Re: Setting up Spark/flume/? to Ingest 10TB from FTP Fri, 14 Aug, 21:24
Steve Loughran     Re: Setting up Spark/flume/? to Ingest 10TB from FTP Mon, 17 Aug, 17:35
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Dec 202126
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137