spark-user mailing list archives: November 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
anyone using netlib-java with sparkR on yarn spark1.6?
Tom Graves   anyone using netlib-java with sparkR on yarn spark1.6? Fri, 06 Nov, 21:39
Shivaram Venkataraman     Re: anyone using netlib-java with sparkR on yarn spark1.6? Wed, 11 Nov, 02:28
Tom Graves       Re: anyone using netlib-java with sparkR on yarn spark1.6? Wed, 11 Nov, 13:55
Shivaram Venkataraman         Re: anyone using netlib-java with sparkR on yarn spark1.6? Wed, 11 Nov, 19:31
Andy Davidson bug: can not run Ipython notebook on cluster Fri, 06 Nov, 22:18
Andy Davidson   Re: bug: can not run Ipython notebook on cluster Sat, 07 Nov, 00:48
swetha What is the efficient way to Join two RDDs? Fri, 06 Nov, 23:21
Ted Yu   Re: What is the efficient way to Join two RDDs? Fri, 06 Nov, 23:45
swetha kasireddy     Re: What is the efficient way to Join two RDDs? Sat, 07 Nov, 00:49
Emaasit spark ec2 script doest not install necessary files to launch spark Fri, 06 Nov, 23:30
Alexander Pivovarov   Re: spark ec2 script doest not install necessary files to launch spark Sat, 07 Nov, 03:04
Shashi Vishwakarma Spark Job failing with exit status 15 Sat, 07 Nov, 15:59
Ted Yu   Re: Spark Job failing with exit status 15 Sun, 08 Nov, 18:03
Shashi Vishwakarma     Re: Spark Job failing with exit status 15 Sun, 08 Nov, 18:11
Deng Ching-Mallete       Re: Spark Job failing with exit status 15 Mon, 09 Nov, 04:22
Andy Davidson streaming: missing data. does saveAsTextFile() append or replace? Sat, 07 Nov, 21:55
Gerard Maas   Re: streaming: missing data. does saveAsTextFile() append or replace? Sun, 08 Nov, 10:13
Andy Davidson     Re: streaming: missing data. does saveAsTextFile() append or replace? Mon, 09 Nov, 17:27
YaoPau sqlCtx.sql('some_hive_table') works in pyspark but not spark-submit Sat, 07 Nov, 22:12
Deng Ching-Mallete   Re: sqlCtx.sql('some_hive_table') works in pyspark but not spark-submit Mon, 09 Nov, 04:33
Re: Whether Spark is appropriate for our use case.
Igor Berman   Re: Whether Spark is appropriate for our use case. Sun, 08 Nov, 07:18
Amit Behera Connecting SparkR through Yarn Sun, 08 Nov, 18:36
Sun, Rui   RE: Connecting SparkR through Yarn Wed, 11 Nov, 06:32
Sun, Rui     RE: Connecting SparkR through Yarn Sat, 14 Nov, 04:41
prajwol sangat Broadcast Variables not showing inside Partitions Apache Spark Sun, 08 Nov, 22:24
Kristina Rogale Plazonic passing RDDs/DataFrames as arguments to functions - what happens? Mon, 09 Nov, 01:57
Todd How to use --principal and --keytab in SparkSubmit Mon, 09 Nov, 02:01
Re: Is SPARK is the right choice for traditional OLAP query processing?
Hitoshi Ozawa   Re: Is SPARK is the right choice for traditional OLAP query processing? Mon, 09 Nov, 04:03
chandan prakash     Re: Is SPARK is the right choice for traditional OLAP query processing? Mon, 09 Nov, 05:07
Re: How to analyze weather data in Spark?
Hitoshi Ozawa   Re: How to analyze weather data in Spark? Mon, 09 Nov, 04:20
ayan guha     Re: How to analyze weather data in Spark? Mon, 09 Nov, 04:33
Re: why prebuild spark 1.5.1 still say Failed to find Spark assembly in
Hitoshi Ozawa   Re: why prebuild spark 1.5.1 still say Failed to find Spark assembly in Mon, 09 Nov, 04:23
Re: visualizations using the apache spark
Hitoshi Ozawa   Re: visualizations using the apache spark Mon, 09 Nov, 04:50
Clustering of Words
Deep Pradhan   Clustering of Words Mon, 09 Nov, 05:09
pradhandeep   Clustering of Words Mon, 09 Nov, 10:09
fightf...@163.com OLAP query using spark dataframe with cassandra Mon, 09 Nov, 06:02
Jörn Franke   Re: OLAP query using spark dataframe with cassandra Mon, 09 Nov, 06:40
fightf...@163.com   Re: Re: OLAP query using spark dataframe with cassandra Mon, 09 Nov, 06:46
tsh     Re: OLAP query using spark dataframe with cassandra Mon, 09 Nov, 18:56
Andrés Ivaldi       Re: OLAP query using spark dataframe with cassandra Mon, 09 Nov, 23:03
Ted Yu         Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 01:22
fightf...@163.com       Re: Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 02:01
Andrés Ivaldi         Re: Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 12:47
Luke Han       Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 07:16
David Morales         Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 08:44
didier vila   First project in scala IDE : first problem Mon, 09 Nov, 23:39
didier vila   RE: First project in scala IDE : first problem Tue, 10 Nov, 01:00
fightf...@163.com   Re: Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 02:11
Andrés Ivaldi     Re: Re: OLAP query using spark dataframe with cassandra Tue, 10 Nov, 13:04
trs...@gmail.com PySpark: cannot convert float infinity to integer, when setting batch in add_shuffle_key Mon, 09 Nov, 07:32
fanooos java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 07:36
Sean Owen   Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 07:45
أنس الليثي     Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 07:47
أنس الليثي       Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 09:02
Tathagata Das         Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 09:27
أنس الليثي           Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 10:49
Tathagata Das             Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 13:07
D..@ Gmail               Re: java.lang.ClassNotFoundException: org.apache.spark.streaming.twitter.TwitterReceiver Mon, 09 Nov, 14:06
swetha Unwanted SysOuts in Spark Parquet Mon, 09 Nov, 07:40
Hitoshi Ozawa   Re: Unwanted SysOuts in Spark Parquet Tue, 10 Nov, 01:00
Cheng Lian   Re: Unwanted SysOuts in Spark Parquet Tue, 10 Nov, 10:03
Muhammad Haseeb Javed Wrap an RDD with a ShuffledRDD Mon, 09 Nov, 07:41
swetha parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark Mon, 09 Nov, 07:43
Ted Yu   Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark Mon, 09 Nov, 08:57
Fengdong Yu   Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark Mon, 09 Nov, 09:00
swetha kasireddy     Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark Mon, 09 Nov, 13:34
Fengdong Yu       Re: parquet.io.ParquetEncodingException Warning when trying to save parquet file in Spark Mon, 09 Nov, 13:48
kundan kumar Batch Recovering from Checkpoint is taking longer runtime than usual Mon, 09 Nov, 10:51
ikeralbeniz shapely + pyspark Mon, 09 Nov, 11:07
JoneZhang What would happen when reduce memory is not enough on spark shuffle read stage? Mon, 09 Nov, 12:14
Re: [SPARK STREAMING ] Sending data to ElasticSearch
Akhil Das   Re: [SPARK STREAMING ] Sending data to ElasticSearch Mon, 09 Nov, 13:39
Re: How to properly read the first number lines of file into a RDD
Akhil Das   Re: How to properly read the first number lines of file into a RDD Mon, 09 Nov, 13:51
Zhiliang Zhu     Re: How to properly read the first number lines of file into a RDD Wed, 18 Nov, 05:45
Re: Issue on spark.driver.maxResultSize
Akhil Das   Re: Issue on spark.driver.maxResultSize Mon, 09 Nov, 13:58
karthik kadiyam     Re: Issue on spark.driver.maxResultSize Mon, 09 Nov, 17:35
Re: heap memory
Akhil Das   Re: heap memory Mon, 09 Nov, 14:04
Eyal Sharon Help with serialization Mon, 09 Nov, 16:06
swetha Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 18:26
Cody Koeninger   Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 19:09
swetha kasireddy     Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 20:03
Cody Koeninger       Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 20:34
swetha kasireddy         Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 20:40
Cody Koeninger           Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 20:45
swetha kasireddy             Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 09 Nov, 21:22
Adrian Tanase           Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Tue, 10 Nov, 09:54
Cody Koeninger             Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Thu, 12 Nov, 17:07
swetha kasireddy               Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 30 Nov, 19:50
Cody Koeninger                 Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 30 Nov, 20:23
swetha kasireddy                   Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Mon, 30 Nov, 23:13
Adrian Tanase   Re: Kafka Direct does not recover automatically when the Kafka Stream gets messed up? Tue, 10 Nov, 09:50
Zhan Zhang Anybody hit this issue in spark shell? Mon, 09 Nov, 18:37
Ted Yu   Re: Anybody hit this issue in spark shell? Mon, 09 Nov, 18:46
Zhan Zhang     Re: Anybody hit this issue in spark shell? Mon, 09 Nov, 18:55
Ted Yu     Re: Anybody hit this issue in spark shell? Mon, 09 Nov, 20:20
Xiu Guo       Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 01:46
Marcelo Vanzin   Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 01:50
Ted Yu     Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 01:54
Marcelo Vanzin       Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 02:13
Michael Armbrust       Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 02:13
Josh Rosen         Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 02:39
Ted Yu           Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 02:47
Shixiong Zhu             Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 19:22
Ted Yu               Re: Anybody hit this issue in spark shell? Tue, 10 Nov, 21:33
Ted Yu               Re: Anybody hit this issue in spark shell? Thu, 12 Nov, 01:46
Igor Berman status of slaves in standalone cluster rest/rpc call Mon, 09 Nov, 20:41
Igor Berman   Re: status of slaves in standalone cluster rest/rpc call Mon, 09 Nov, 20:58
swetha Spark IndexedRDD dependency in Maven Mon, 09 Nov, 21:34
Ted Yu   Re: Spark IndexedRDD dependency in Maven Mon, 09 Nov, 21:37
Simone Franzini Slow stage? Mon, 09 Nov, 21:52
Jakob Odersky   Re: Slow stage? Wed, 11 Nov, 18:58
Mark Hamstra     Re: Slow stage? Wed, 11 Nov, 20:23
Koert Kuipers       Re: Slow stage? Wed, 11 Nov, 20:35
mayurladwa Overriding Derby in hive-site.xml giving strange results... Mon, 09 Nov, 23:32
Michael Armbrust   Re: Overriding Derby in hive-site.xml giving strange results... Mon, 09 Nov, 23:37
Gaurav Tiwari     Re: Overriding Derby in hive-site.xml giving strange results... Tue, 10 Nov, 10:48
spark shared RDD
Ben   spark shared RDD Mon, 09 Nov, 23:45
Ben   spark shared RDD Tue, 10 Nov, 10:20
Ben   spark shared RDD Tue, 10 Nov, 10:24
Is it possible Running SparkR on 2 nodes without HDFS
Sanjay Subramanian   Is it possible Running SparkR on 2 nodes without HDFS Tue, 10 Nov, 02:06
Ali Tajeldin EDU     Re: Is it possible Running SparkR on 2 nodes without HDFS Tue, 10 Nov, 23:16
Sanjay Subramanian   Re: Is it possible Running SparkR on 2 nodes without HDFS Tue, 10 Nov, 17:44
could not see the print out log in spark functions as mapPartitions
Zhiliang Zhu   could not see the print out log in spark functions as mapPartitions Tue, 10 Nov, 03:33
Deng Ching-Mallete     Re: could not see the print out log in spark functions as mapPartitions Tue, 10 Nov, 03:41
Zhiliang Zhu       Re: could not see the print out log in spark functions as mapPartitions Tue, 10 Nov, 03:52
Zhiliang Zhu         Re: could not see the print out log in spark functions as mapPartitions Tue, 10 Nov, 04:20
Zhiliang Zhu           Re: could not see the print out log in spark functions as mapPartitions Tue, 10 Nov, 07:54
Zhiliang Zhu       static spark Function as map Tue, 10 Nov, 08:12
Zhiliang Zhu         could not understand issue about static spark Function (map / sortBy ...) Tue, 10 Nov, 09:12
Zhiliang Zhu           Re: could not understand issue about static spark Function (map / sortBy ...) Tue, 10 Nov, 15:43
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · Next »Thread · Author · Date
Box list
Nov 2021148
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137