spark-user mailing list archives: July 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Spark Streaming: Blocks and Partitions
Kalim, Faria   Spark Streaming: Blocks and Partitions Thu, 20 Jul, 19:52
Cassa L How to use Update statement or call stored procedure of Oracle from Spark Thu, 20 Jul, 20:19
Xiayun Sun   Re: How to use Update statement or call stored procedure of Oracle from Spark Fri, 21 Jul, 04:10
Gokula Krishnan D Spark on Cloudera Configuration (Scheduler Mode = FAIR) Thu, 20 Jul, 20:45
Mark Hamstra   Re: Spark on Cloudera Configuration (Scheduler Mode = FAIR) Thu, 20 Jul, 20:56
Gokula Krishnan D     Re: Spark on Cloudera Configuration (Scheduler Mode = FAIR) Thu, 20 Jul, 21:02
Mark Hamstra       Re: Spark on Cloudera Configuration (Scheduler Mode = FAIR) Thu, 20 Jul, 21:11
ayan guha         Re: Spark on Cloudera Configuration (Scheduler Mode = FAIR) Thu, 20 Jul, 22:46
Gokula Krishnan D           Re: Spark on Cloudera Configuration (Scheduler Mode = FAIR) Fri, 21 Jul, 12:00
Marcelo Vanzin             Re: Spark on Cloudera Configuration (Scheduler Mode = FAIR) Fri, 21 Jul, 16:25
Re: Spark (SQL / Structured Streaming) Cassandra - PreparedStatement
Russell Spitzer   Re: Spark (SQL / Structured Streaming) Cassandra - PreparedStatement Fri, 21 Jul, 13:33
Lalwani, Jayesh Supporting columns with heterogenous data Fri, 21 Jul, 15:51
Jain, Nishit Spark Data Frame Writer - Range Partiotioning Fri, 21 Jul, 16:46
ayan guha   Re: Spark Data Frame Writer - Range Partiotioning Fri, 21 Jul, 20:25
Jain, Nishit     Re: Spark Data Frame Writer - Range Partiotioning Tue, 25 Jul, 13:49
Get full RDD lineage for a spark job
Ron Gonzalez   Get full RDD lineage for a spark job Fri, 21 Jul, 18:24
Keith Chapman     Re: Get full RDD lineage for a spark job Sat, 22 Jul, 02:57
Keith Chapman       Re: Get full RDD lineage for a spark job Sat, 22 Jul, 03:09
Ron Gonzalez         Re: Get full RDD lineage for a spark job Sun, 23 Jul, 23:23
Ernesto Valentino [ Spark SQL ] Conversion from Spark SQL to Avro decimal Fri, 21 Jul, 19:21
Cornelio Iñigo unsuscribe Fri, 21 Jul, 20:49
Cassa L Spark Structured Streaming - Spark Consumer does not display messages Fri, 21 Jul, 20:58
Cassa L   Fwd: Spark Structured Streaming - Spark Consumer does not display messages Fri, 21 Jul, 22:09
Lukasz Tracewski [Spark] Working with JavaPairRDD from Scala Fri, 21 Jul, 22:18
yohann jardin   RE: [Spark] Working with JavaPairRDD from Scala Sat, 22 Jul, 08:48
Lukasz Tracewski     Re: [Spark] Working with JavaPairRDD from Scala Sat, 22 Jul, 21:09
Martin Peng Spark Job crash due to File Not found when shuffle intermittently Sat, 22 Jul, 01:58
Martin Peng   Re: Spark Job crash due to File Not found when shuffle intermittently Mon, 24 Jul, 16:33
周康     Re: Spark Job crash due to File Not found when shuffle intermittently Tue, 25 Jul, 05:01
周康       Re: Spark Job crash due to File Not found when shuffle intermittently Tue, 25 Jul, 05:05
周康         Re: Spark Job crash due to File Not found when shuffle intermittently Tue, 25 Jul, 05:15
Martin Peng           Re: Spark Job crash due to File Not found when shuffle intermittently Tue, 25 Jul, 22:58
kant kodali Is there a way to run Spark SQL through REST? Sat, 22 Jul, 08:01
Jean Georges Perrin   Re: Is there a way to run Spark SQL through REST? Sat, 22 Jul, 10:17
Sumedh Wale   Re: Is there a way to run Spark SQL through REST? Sat, 22 Jul, 13:19
kant kodali     Re: Is there a way to run Spark SQL through REST? Mon, 24 Jul, 00:39
Sumedh Wale       Re: Is there a way to run Spark SQL through REST? Mon, 24 Jul, 06:36
unsubscribe
Vasilis Hadjipanos   unsubscribe Sat, 22 Jul, 08:12
Vasilis Hadjipanos   unsubscribe Sun, 23 Jul, 12:37
Jnana Sagar   unsubscribe Tue, 25 Jul, 05:40
Tao Lu   unsubscribe Fri, 28 Jul, 02:34
Stephen Fletcher custom joins on dataframe Sat, 22 Jul, 15:39
Sumedh Wale   Re: custom joins on dataframe Sat, 22 Jul, 17:40
Michael Armbrust   Re: custom joins on dataframe Sun, 23 Jul, 20:51
Jörn Franke   Re: custom joins on dataframe Mon, 24 Jul, 07:07
saatvikshah1994 Informing Spark about specific Partitioning scheme to avoid shuffles Sat, 22 Jul, 17:23
Luqman Ghani Querying Drill with Spark DataFrame Sat, 22 Jul, 20:42
ayan guha   Re: Querying Drill with Spark DataFrame Sat, 22 Jul, 21:02
Luqman Ghani     Re: Querying Drill with Spark DataFrame Sat, 22 Jul, 21:10
Luqman Ghani       Re: Querying Drill with Spark DataFrame Sat, 22 Jul, 21:26
Luqman Ghani         Re: Querying Drill with Spark DataFrame Sat, 22 Jul, 21:45
Kaushal Shriyan java.lang.NoClassDefFoundError: scala/runtime/AbstractPartialFunction$mcJL$sp Sun, 23 Jul, 17:48
萝卜丝炒饭 how to convert the binary from kafak to srring pleaae Mon, 24 Jul, 02:44
Szuromi Tamás   Re: how to convert the binary from kafak to srring pleaae Mon, 24 Jul, 08:32
萝卜丝炒饭     Re: how to convert the binary from kafak to srring pleaae Mon, 24 Jul, 14:13
Michael Armbrust   Re: how to convert the binary from kafak to srring pleaae Mon, 24 Jul, 20:58
萝卜丝炒饭     Re: how to convert the binary from kafak to srring pleaae Tue, 25 Jul, 01:36
Re: Question on Spark code
Reynold Xin   Re: Question on Spark code Mon, 24 Jul, 03:19
Reynold Xin     Re: Question on Spark code Mon, 24 Jul, 03:50
amit kumar singh How to configure spark with java Mon, 24 Jul, 03:22
Patrik Medvedev   Re: How to configure spark with java Mon, 24 Jul, 06:55
Mich Talebzadeh using Kudu with Spark Mon, 24 Jul, 07:25
Jörn Franke   Re: using Kudu with Spark Mon, 24 Jul, 07:30
Mich Talebzadeh     Re: using Kudu with Spark Mon, 24 Jul, 07:38
Mich Talebzadeh       Re: using Kudu with Spark Mon, 24 Jul, 10:15
Mich Talebzadeh         Re: using Kudu with Spark Mon, 24 Jul, 17:02
Pierce Lamb           Re: using Kudu with Spark Mon, 24 Jul, 17:51
Mich Talebzadeh             Re: using Kudu with Spark Mon, 24 Jul, 20:25
julio.ces...@free.fr Union large number of DataFrames Mon, 24 Jul, 08:35
Patrick Complext JSON Handling in Spark 2.1 Mon, 24 Jul, 10:34
Patrick   Re: Complext JSON Handling in Spark 2.1 Mon, 24 Jul, 10:41
Aseem Bansal Is there a difference between these aggregations Mon, 24 Jul, 11:34
yohann jardin   RE: Is there a difference between these aggregations Mon, 24 Jul, 11:38
Aseem Bansal     Re: Is there a difference between these aggregations Mon, 24 Jul, 11:57
Aseem Bansal NullPointer when collecting a dataset grouped a column Mon, 24 Jul, 13:29
Biplob Biswas Conflict resolution for data in spark streaming Mon, 24 Jul, 13:30
unk1102 Parquet error while saving in HDFS Mon, 24 Jul, 18:51
Adaryl Wakefield real world spark code Mon, 24 Jul, 23:08
Xiayun Sun   Re: real world spark code Tue, 25 Jul, 13:05
Jörn Franke   Re: real world spark code Tue, 25 Jul, 13:30
Adaryl Wakefield     RE: real world spark code Tue, 25 Jul, 14:58
Jörn Franke       Re: real world spark code Tue, 25 Jul, 15:09
Frank Austin Nothaft         Re: real world spark code Tue, 25 Jul, 15:30
Matei Zaharia           Re: real world spark code Tue, 25 Jul, 21:17
萝卜丝炒饭 how to set the assignee in JIRA please? Tue, 25 Jul, 00:57
Marcelo Vanzin   Re: how to set the assignee in JIRA please? Tue, 25 Jul, 00:59
Hyukjin Kwon     Re: how to set the assignee in JIRA please? Tue, 25 Jul, 01:04
Marcelo Vanzin       Re: how to set the assignee in JIRA please? Tue, 25 Jul, 01:09
Hyukjin Kwon         Re: how to set the assignee in JIRA please? Tue, 25 Jul, 01:15
萝卜丝炒饭           Re: how to set the assignee in JIRA please? Tue, 25 Jul, 01:22
Hyukjin Kwon             Re: how to set the assignee in JIRA please? Tue, 25 Jul, 01:25
萝卜丝炒饭   Re: how to set the assignee in JIRA please? Tue, 25 Jul, 01:09
萝卜丝炒饭   Re: how to set the assignee in JIRA please? Wed, 26 Jul, 02:58
Hyukjin Kwon     Re: how to set the assignee in JIRA please? Wed, 26 Jul, 04:15
萝卜丝炒饭   Re: how to set the assignee in JIRA please? Wed, 26 Jul, 05:56
jeff saremi How to list only erros for a stage Tue, 25 Jul, 02:02
周康   Re: How to list only erros for a stage Tue, 25 Jul, 03:04
jeff saremi   Re: How to list only erros for a stage Tue, 25 Jul, 15:06
kant kodali What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 07:50
Keith Chapman   Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 15:52
kant kodali     Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 16:15
Keith Chapman       Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 16:26
Burak Yavuz         Re: What are some disadvantages of issuing a raw sql query to spark? Tue, 25 Jul, 21:22
kant kodali some Ideas on expressing Spark SQL using JSON Tue, 25 Jul, 09:46
Sathish Kumaran Vairavelu   Re: some Ideas on expressing Spark SQL using JSON Tue, 25 Jul, 21:42
Georg Heiler     Re: some Ideas on expressing Spark SQL using JSON Wed, 26 Jul, 06:00
Sathish Kumaran Vairavelu       Re: some Ideas on expressing Spark SQL using JSON Wed, 26 Jul, 12:22
Gourav Sengupta         Re: some Ideas on expressing Spark SQL using JSON Mon, 31 Jul, 00:33
Gokula Krishnan D [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 12:15
Gokula Krishnan D   Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 12:21
Gokula Krishnan D     Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 12:54
Xiayun Sun       Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 13:55
Gokula Krishnan D         Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 14:29
Robin East     Re: [Spark-Core] sc.textFile() explicit minPartitions did not work Tue, 25 Jul, 13:50
Patrick Re: Nested JSON Handling in Spark 2.1 Tue, 25 Jul, 14:28
Priyank Shrivastava [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 01:05
Tathagata Das   Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 08:46
Priyank Shrivastava     Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 18:49
Tathagata Das       Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 19:49
Priyank Shrivastava         Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:06
Burak Yavuz           Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:13
Priyank Shrivastava             Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:17
Priyank Shrivastava               Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 22:23
ayan guha       Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Wed, 26 Jul, 19:54
Tathagata Das         Re: [SPARK STRUCTURED STREAMING]: Alternatives to using Foreach sink in pyspark Fri, 28 Jul, 02:47
Debabrata Ghosh Need some help around a Spark Error Wed, 26 Jul, 01:13
Alonso Isidoro Roman   Re: Need some help around a Spark Error Wed, 26 Jul, 10:10
Julien CHAMP Cache problem ? Too much Stages ? Need help :( Wed, 26 Jul, 08:33
Xiayun Sun   Re: Cache problem ? Too much Stages ? Need help :( Wed, 26 Jul, 12:50
msachdev [Spark SQL] [pyspark.sql]: Potential bug in toDF using nested structures Wed, 26 Jul, 11:33
RCinna [Spark streaming-Mesos-cluster mode] java.lang.RuntimeException: Stream jar not found Wed, 26 Jul, 17:13
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137