spark-user mailing list archives: July 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
周康 Re: ClassNotFoundException for Workers Tue, 25 Jul, 08:17
kant kodali some Ideas on expressing Spark SQL using JSON Tue, 25 Jul, 09:46
Gokula Krishnan D [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 12:15
Gokula Krishnan D Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 12:21
Gokula Krishnan D Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 12:54
Xiayun Sun Re: real world spark code Tue, 25 Jul, 13:05
Jörn Franke Re: real world spark code Tue, 25 Jul, 13:30
Jain, Nishit Re: Spark Data Frame Writer - Range Partiotioning Tue, 25 Jul, 13:49
Robin East Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 13:50
Xiayun Sun Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 13:55
Patrick Re: Nested JSON Handling in Spark 2.1 Tue, 25 Jul, 14:28
Gokula Krishnan D Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 14:29
Adaryl Wakefield RE: real world spark code Tue, 25 Jul, 14:58
jeff saremi Re: How to list only erros for a stage Tue, 25 Jul, 15:06
Jörn Franke Re: real world spark code Tue, 25 Jul, 15:09
Frank Austin Nothaft Re: real world spark code Tue, 25 Jul, 15:30
Keith Chapman Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 15:52
kant kodali Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 16:15
Keith Chapman Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 16:26
Matei Zaharia Re: real world spark code Tue, 25 Jul, 21:17
Burak Yavuz Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 21:22
Sathish Kumaran Vairavelu Re: some Ideas on expressing Spark SQL using JSON Tue, 25 Jul, 21:42
Martin Peng Re: Spark Job crash due to File Not found when shuffle intermittently Tue, 25 Jul, 22:58
Priyank Shrivastava [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 01:05
Debabrata Ghosh Need some help around a Spark Error Wed, 26 Jul, 01:13
萝卜丝炒饭 Re: how to set the assignee in JIRA please? Wed, 26 Jul, 02:58
Hyukjin Kwon Re: how to set the assignee in JIRA please? Wed, 26 Jul, 04:15
萝卜丝炒饭 Re: how to set the assignee in JIRA please? Wed, 26 Jul, 05:56
Georg Heiler Re: some Ideas on expressing Spark SQL using JSON Wed, 26 Jul, 06:00
Julien CHAMP Cache problem ? Too much Stages ? Need help :( Wed, 26 Jul, 08:33
Tathagata Das Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 08:46
Alonso Isidoro Roman Re: Need some help around a Spark Error Wed, 26 Jul, 10:10
msachdev [Spark SQL] [pyspark.sql]: Potential bug in toDF using nested structures Wed, 26 Jul, 11:33
Sathish Kumaran Vairavelu Re: some Ideas on expressing Spark SQL using JSON Wed, 26 Jul, 12:22
Xiayun Sun Re: Cache problem ? Too much Stages ? Need help :( Wed, 26 Jul, 12:50
RCinna [Spark streaming-Mesos-cluster mode] java.lang.RuntimeException: Stream jar not found Wed, 26 Jul, 17:13
Mikhailau, Alex DStream Spark 2.1.1 Streaming on EMR at scale - long running job fails after two hours Wed, 26 Jul, 18:47
Priyank Shrivastava Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 18:49
Tathagata Das Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 19:49
ayan guha Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 19:54
Jone Zhang Can i move TFS and TSFT out of spark package Thu, 27 Jul, 03:32
ayan guha Create static Map Type column Thu, 27 Jul, 04:30
sowmya ramesh Please unsubscribe <EOM> Thu, 27 Jul, 05:12
satishl running spark application compiled with 1.6 on spark 2.1 cluster Thu, 27 Jul, 05:45
ayan guha Re: Create static Map Type column Thu, 27 Jul, 05:46
Patrick Re: Complex types projection handling with Spark 2 SQL and Parquet Thu, 27 Jul, 07:55
luohui20...@sina.com A tool to generate simulation data Thu, 27 Jul, 09:23
babita Sancheti Please unsubscribe <EOM> Thu, 27 Jul, 11:48
saatvikshah1994 How does Spark handle timestamps during Pandas dataframe conversion Thu, 27 Jul, 14:44
Markus.Bre...@materna.de guava not compatible to hadoop version 2.6.5 Thu, 27 Jul, 14:46
Marcelo Vanzin Re: running spark application compiled with 1.6 on spark 2.1 cluster Thu, 27 Jul, 15:45
周康 Re: running spark application compiled with 1.6 on spark 2.1 cluster Thu, 27 Jul, 16:11
Suzen, Mehmet Re: A tool to generate simulation data Thu, 27 Jul, 17:18
Vikash Kumar Spark2.1 installation issue Thu, 27 Jul, 17:54
Marcelo Vanzin Re: Spark2.1 installation issue Thu, 27 Jul, 17:58
Pedro Tuero Persisting RDD: Low Percentage with a lot of memory available Thu, 27 Jul, 18:11
Vikash Kumar Re: Spark2.1 installation issue Thu, 27 Jul, 18:18
Gourav Sengupta SPARK Storagelevel issues Thu, 27 Jul, 19:04
luohui20...@sina.com 回复:Re: A tool to generate simulation data Fri, 28 Jul, 02:19
Tao Lu unsubscribe Fri, 28 Jul, 02:34
Tathagata Das Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 02:47
周康 Re: SPARK Storagelevel issues Fri, 28 Jul, 03:43
jeff saremi How to configure spark on Yarn cluster Fri, 28 Jul, 06:03
yohann jardin Re: How to configure spark on Yarn cluster Fri, 28 Jul, 06:15
Gourav Sengupta Re: SPARK Storagelevel issues Fri, 28 Jul, 09:09
周康 Re: SPARK Storagelevel issues Fri, 28 Jul, 09:25
Chetan Khatri Support Dynamic Partition Inserts params with SET command in Spark 2.0.1 Fri, 28 Jul, 10:19
Jörn Franke Re: Support Dynamic Partition Inserts params with SET command in Spark 2.0.1 Fri, 28 Jul, 10:48
Chetan Khatri Re: Support Dynamic Partition Inserts params with SET command in Spark 2.0.1 Fri, 28 Jul, 10:51
ayan guha Re: Support Dynamic Partition Inserts params with SET command in Spark 2.0.1 Fri, 28 Jul, 11:14
Chetan Khatri Re: Support Dynamic Partition Inserts params with SET command in Spark 2.0.1 Fri, 28 Jul, 11:52
ajit roshen subscribe Fri, 28 Jul, 13:48
ajit roshen Spark Streaming as a Service Fri, 28 Jul, 15:12
emceemouli Re: Spark Streaming with long batch / window duration Fri, 28 Jul, 16:03
jeff saremi Re: How to configure spark on Yarn cluster Fri, 28 Jul, 16:05
Pedro Tuero Re: Persisting RDD: Low Percentage with a lot of memory available Fri, 28 Jul, 16:11
jeff saremi Job keeps aborting because of org.apache.spark.shuffle.FetchFailedException: Failed to connect to server/ip:39232 Fri, 28 Jul, 16:57
yohann jardin Re: How to configure spark on Yarn cluster Fri, 28 Jul, 17:47
jeff saremi Re: How to configure spark on Yarn cluster Fri, 28 Jul, 18:00
yohann jardin Re: How to configure spark on Yarn cluster Fri, 28 Jul, 19:22
Siddhartha Singh Sandhu RE: changing directories in Spark Streming Fri, 28 Jul, 19:25
pedroT Persisting RDD: Low Percentage with a lot of memory available Fri, 28 Jul, 20:35
Richard Xin can I do spark-submit --jars [s3://bucket/folder/jar_file]? or --jars Fri, 28 Jul, 20:52
Priyank Shrivastava Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:06
Burak Yavuz Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:13
Priyank Shrivastava Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:17
Priyank Shrivastava Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:23
Juan Rodríguez Hortalá Re: Job keeps aborting because of org.apache.spark.shuffle.FetchFailedException: Failed to connect to server/ip:39232 Fri, 28 Jul, 23:20
jeff saremi Re: Job keeps aborting because of org.apache.spark.shuffle.FetchFailedException: Failed to connect to server/ip:39232 Fri, 28 Jul, 23:38
jeff saremi Re: Job keeps aborting because of org.apache.spark.shuffle.FetchFailedException: Failed to connect to server/ip:39232 Fri, 28 Jul, 23:40
萝卜丝炒饭 Re: SPARK Storagelevel issues Sat, 29 Jul, 08:41
johnzengspark Logging in RDD mapToPair of Java Spark application Sat, 29 Jul, 18:09
Jnana Sagar Unsubscribe Sat, 29 Jul, 18:23
Cristian Garcia ALSModel.load not working on pyspark 2.1.0 Sat, 29 Jul, 19:57
cgarciae ALSModel.load not working on pyspark 2.1.0 Sat, 29 Jul, 20:03
Riccardo Ferrari Re: Logging in RDD mapToPair of Java Spark application Sat, 29 Jul, 20:18
周康 Re: Job keeps aborting because of org.apache.spark.shuffle.FetchFailedException: Failed to connect to server/ip:39232 Sun, 30 Jul, 04:54
ayan guha OrderedDict to DF Sun, 30 Jul, 13:34
serkan taş Spark parquet file read problem ! Sun, 30 Jul, 15:11
pandees waran Re: Spark parquet file read problem ! Sun, 30 Jul, 16:12
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Box list
Jun 2021118
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137