spark-user mailing list archives: June 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
mayankshete Hive 1.0.0 not able to read Spark 1.6.1 parquet output files on EMR 4.7.0 Mon, 13 Jun, 07:56
Cheng Lian   Re: Hive 1.0.0 not able to read Spark 1.6.1 parquet output files on EMR 4.7.0 Thu, 16 Jun, 00:40
april_ZMQ Spark 2.0.0 : GLM problem Mon, 13 Jun, 08:14
april_ZMQ   Re: Spark 2.0.0 : GLM problem Tue, 14 Jun, 12:09
april_ZMQ   Re: Spark 2.0.0 : GLM problem Wed, 22 Jun, 06:33
hero Another problem about parallel computing Mon, 13 Jun, 08:24
Terry Hoo   Re: Another problem about parallel computing Mon, 13 Jun, 09:06
Steve Loughran   Re: Another problem about parallel computing Mon, 13 Jun, 09:33
Jan Sourek cluster mode for Python on standalone clusters Mon, 13 Jun, 09:16
cluster mode for Python on standalone cluster
Jan Šourek   cluster mode for Python on standalone cluster Mon, 13 Jun, 09:24
Jan Sourek   cluster mode for Python on standalone cluster Tue, 14 Jun, 07:56
Natu Lauchande Spark Streamming checkpoint and restoring files from S3 Mon, 13 Jun, 09:57
Natu Lauchande   Re: Spark Streamming checkpoint and restoring files from S3 Mon, 13 Jun, 10:18
Arun Patel Spark 2.0: Unify DataFrames and Datasets question Mon, 13 Jun, 11:01
Michael Armbrust   Re: Spark 2.0: Unify DataFrames and Datasets question Mon, 13 Jun, 18:55
Arun Patel     Re: Spark 2.0: Unify DataFrames and Datasets question Mon, 13 Jun, 22:51
Arun Patel       Re: Spark 2.0: Unify DataFrames and Datasets question Tue, 14 Jun, 17:39
Michael Armbrust   Re: Spark 2.0: Unify DataFrames and Datasets question Tue, 14 Jun, 17:45
Xinh Huynh     Re: Spark 2.0: Unify DataFrames and Datasets question Tue, 14 Jun, 18:20
Kamesh Spark Streaming application failing with Kerboros issue while writing data to HBase Mon, 13 Jun, 11:44
Ted Yu   Re: Spark Streaming application failing with Kerboros issue while writing data to HBase Mon, 13 Jun, 17:18
Kamesh     Re: Spark Streaming application failing with Kerboros issue while writing data to HBase Tue, 14 Jun, 12:03
Bryan Jeffrey Kafka Exceptions Mon, 13 Jun, 13:25
Cody Koeninger   Re: Kafka Exceptions Mon, 13 Jun, 14:37
Bryan Jeffrey     Re: Kafka Exceptions Mon, 13 Jun, 15:40
Cody Koeninger       Re: Kafka Exceptions Mon, 13 Jun, 16:02
Umair Janjua Basic question. Access MongoDB data in Spark. Mon, 13 Jun, 15:09
Ted Yu   Re: Basic question. Access MongoDB data in Spark. Mon, 13 Jun, 16:02
Umair Janjua     Re: Basic question. Access MongoDB data in Spark. Mon, 13 Jun, 16:10
Prajwal Tuladhar       Re: Basic question. Access MongoDB data in Spark. Mon, 13 Jun, 16:29
Re: java.lang.StackOverflowError when calling count()
Anuj   Re: java.lang.StackOverflowError when calling count() Mon, 13 Jun, 15:18
Jeroen Miller Computing on each partition/executor with "persistent" data Mon, 13 Jun, 17:35
khaled.hammouda Is there a limit on the number of tasks in one job? Mon, 13 Jun, 18:19
Michael Armbrust   Re: Is there a limit on the number of tasks in one job? Mon, 13 Jun, 18:58
Khaled Hammouda     Re: Is there a limit on the number of tasks in one job? Mon, 13 Jun, 19:45
Mich Talebzadeh       Re: Is there a limit on the number of tasks in one job? Mon, 13 Jun, 22:24
Takeshi Yamamuro         Re: Is there a limit on the number of tasks in one job? Mon, 13 Jun, 23:04
Khaled Hammouda         Re: Is there a limit on the number of tasks in one job? Tue, 14 Jun, 15:20
Amit Sela LegacyAccumulatorWrapper basically requires the Accumulator value to implement equlas() or it will fail on isZero() Mon, 13 Jun, 19:15
Sean Owen   Re: LegacyAccumulatorWrapper basically requires the Accumulator value to implement equlas() or it will fail on isZero() Mon, 13 Jun, 19:43
Amit Sela     Re: LegacyAccumulatorWrapper basically requires the Accumulator value to implement equlas() or it will fail on isZero() Mon, 13 Jun, 19:47
Peter Halliday how to investigate skew and DataFrames and RangePartitioner Mon, 13 Jun, 20:04
Takeshi Yamamuro   Re: how to investigate skew and DataFrames and RangePartitioner Tue, 14 Jun, 15:43
Cassa L Spark Memory Error - Not enough space to cache broadcast Mon, 13 Jun, 21:56
Cassa L   Re: Spark Memory Error - Not enough space to cache broadcast Tue, 14 Jun, 22:48
Cassa L     Re: Spark Memory Error - Not enough space to cache broadcast Thu, 16 Jun, 04:37
Takeshi Yamamuro       Re: Spark Memory Error - Not enough space to cache broadcast Thu, 16 Jun, 06:04
Jacek Laskowski   Re: Spark Memory Error - Not enough space to cache broadcast Thu, 16 Jun, 12:03
Deepak Goel     Re: Spark Memory Error - Not enough space to cache broadcast Thu, 16 Jun, 12:27
Cassa L       Re: Spark Memory Error - Not enough space to cache broadcast Thu, 16 Jun, 20:55
Deepak Goel         Re: Spark Memory Error - Not enough space to cache broadcast Fri, 17 Jun, 00:57
Cassa L     Re: Spark Memory Error - Not enough space to cache broadcast Thu, 16 Jun, 20:53
KhajaAsmath Mohammed Suggestions on Lambda Architecture in Spark Mon, 13 Jun, 22:52
Luciano Resende   Re: Suggestions on Lambda Architecture in Spark Mon, 13 Jun, 22:57
Sean Owen   Re: Suggestions on Lambda Architecture in Spark Tue, 14 Jun, 07:37
Jörn Franke   Re: Suggestions on Lambda Architecture in Spark Tue, 14 Jun, 09:02
Re: Limit pyspark.daemon threads
agateaaa   Re: Limit pyspark.daemon threads Tue, 14 Jun, 07:44
Gene Pang     Re: Limit pyspark.daemon threads Wed, 15 Jun, 13:53
agateaaa       Re: Limit pyspark.daemon threads Wed, 15 Jun, 21:39
David Newberger         RE: Limit pyspark.daemon threads Wed, 15 Jun, 21:51
agateaaa           Re: Limit pyspark.daemon threads Wed, 15 Jun, 22:11
Sudhir Babu Pothineni       Re: Limit pyspark.daemon threads Wed, 15 Jun, 22:50
Jeff Zhang         Re: Limit pyspark.daemon threads Wed, 15 Jun, 23:34
agateaaa           Re: Limit pyspark.daemon threads Fri, 17 Jun, 06:20
Kristoffer Sjögren Spark corrupts text lines Tue, 14 Jun, 09:24
Sean Owen   Re: Spark corrupts text lines Tue, 14 Jun, 09:26
Jeff Zhang     Re: Spark corrupts text lines Tue, 14 Jun, 09:50
Kristoffer Sjögren     Re: Spark corrupts text lines Tue, 14 Jun, 12:38
Sean Owen       Re: Spark corrupts text lines Tue, 14 Jun, 12:42
Kristoffer Sjögren         Re: Spark corrupts text lines Tue, 14 Jun, 13:04
Sean Owen           Re: Spark corrupts text lines Tue, 14 Jun, 13:28
Kristoffer Sjögren           Re: Spark corrupts text lines Tue, 14 Jun, 13:28
Kristoffer Sjögren             Re: Spark corrupts text lines Tue, 14 Jun, 13:38
Kristoffer Sjögren               Re: Spark corrupts text lines Tue, 14 Jun, 14:03
Kristoffer Sjögren                 Re: Spark corrupts text lines Tue, 14 Jun, 14:40
Patrick Duin Create external table with partitions using sqlContext.createExternalTable Tue, 14 Jun, 10:39
Mich Talebzadeh   Re: Create external table with partitions using sqlContext.createExternalTable Tue, 14 Jun, 11:59
Patrick Duin     Re: Create external table with partitions using sqlContext.createExternalTable Tue, 14 Jun, 12:06
Mich Talebzadeh       Re: Create external table with partitions using sqlContext.createExternalTable Tue, 14 Jun, 12:15
Chanh Le Spark 2.0 Preview After caching query didn't work and can't kill job. Tue, 14 Jun, 10:45
Gene Pang   Re: Spark 2.0 Preview After caching query didn't work and can't kill job. Wed, 15 Jun, 13:42
Chanh Le     Re: Spark 2.0 Preview After caching query didn't work and can't kill job. Wed, 15 Jun, 13:44
Chanh Le       Re: Spark 2.0 Preview After caching query didn't work and can't kill job. Thu, 16 Jun, 03:52
Gene Pang         Re: Spark 2.0 Preview After caching query didn't work and can't kill job. Tue, 21 Jun, 13:01
Mail.com Running streaming applications in Production environment Tue, 14 Jun, 11:37
andy petrella [Spark 2.0.0] Structured Stream on Kafka Tue, 14 Jun, 14:21
Cody Koeninger   Re: [Spark 2.0.0] Structured Stream on Kafka Tue, 14 Jun, 14:44
andy petrella     Re: [Spark 2.0.0] Structured Stream on Kafka Tue, 14 Jun, 14:47
Chris Fregly       Re: [Spark 2.0.0] Structured Stream on Kafka Tue, 14 Jun, 15:52
Roberto Pagliari RBM in mllib Tue, 14 Jun, 14:23
Krishna Kalyan   Re: RBM in mllib Tue, 14 Jun, 14:33
pseudo oduesp MAtcheERROR : STRINGTYPE Tue, 14 Jun, 16:54
Ted Yu   Re: MAtcheERROR : STRINGTYPE Tue, 14 Jun, 16:57
Spark SQL NoSuchMethodException...DriverWrapper.<init>()
Mirko Bernardoni   Spark SQL NoSuchMethodException...DriverWrapper.<init>() Tue, 14 Jun, 17:12
Mirko   Spark SQL NoSuchMethodException...DriverWrapper.<init>() Wed, 15 Jun, 08:17
Mirko     Re: Spark SQL NoSuchMethodException...DriverWrapper.<init>() Fri, 24 Jun, 08:54
Jacek Laskowski       Re: Spark SQL NoSuchMethodException...DriverWrapper.<init>() Fri, 24 Jun, 09:17
chandana Spark-SQL with Oozie Tue, 14 Jun, 17:14
nsalian   Re: Spark-SQL with Oozie Tue, 14 Jun, 17:59
Chen, Yan I restarting of spark streaming Tue, 14 Jun, 17:34
Chen, Yan I   RE: restarting of spark streaming Wed, 15 Jun, 21:10
spark-ec2 scripts with spark-2.0.0-preview
Sunil Kumar   spark-ec2 scripts with spark-2.0.0-preview Tue, 14 Jun, 19:07
Shivaram Venkataraman     Re: spark-ec2 scripts with spark-2.0.0-preview Tue, 14 Jun, 20:06
Bertrand Dechoux SparkContext#cancelJobGroup : is it safe? Who got burn? Who is alive? Tue, 14 Jun, 19:13
Sivakumaran S choice of RDD function Tue, 14 Jun, 20:29
Jacek Laskowski   Re: choice of RDD function Wed, 15 Jun, 14:10
Sivakumaran S     Re: choice of RDD function Wed, 15 Jun, 15:03
Jacek Laskowski       Re: choice of RDD function Wed, 15 Jun, 16:02
Sivakumaran S         Re: choice of RDD function Wed, 15 Jun, 16:19
Cody Koeninger           Re: choice of RDD function Wed, 15 Jun, 21:32
Sivakumaran S             Re: choice of RDD function Wed, 15 Jun, 21:55
Jacek Laskowski               Re: choice of RDD function Thu, 16 Jun, 10:29
Sivakumaran S                 Re: choice of RDD function Thu, 16 Jun, 11:48
Sivakumaran S                   Re: choice of RDD function Thu, 16 Jun, 19:27
Jacek Laskowski             Re: choice of RDD function Thu, 16 Jun, 10:29
Darshan Singh spark standalone High availibilty issues Tue, 14 Jun, 20:56
Jacek Laskowski   Re: spark standalone High availibilty issues Wed, 15 Jun, 14:04
dhruve ashar     Re: spark standalone High availibilty issues Wed, 15 Jun, 18:49
antoniosi Writing empty Dataframes doesn't save any _metadata files in Spark 1.5.1 and 1.6 Tue, 14 Jun, 23:46
Hyukjin Kwon   Re: Writing empty Dataframes doesn't save any _metadata files in Spark 1.5.1 and 1.6 Wed, 15 Jun, 01:26
Hyukjin Kwon     Re: Writing empty Dataframes doesn't save any _metadata files in Spark 1.5.1 and 1.6 Wed, 15 Jun, 01:30
Lee Ho Yeung can not show all data for this table Wed, 15 Jun, 01:19
Lee Ho Yeung   Re: can not show all data for this table Wed, 15 Jun, 02:02
Mich Talebzadeh     Re: can not show all data for this table Wed, 15 Jun, 04:14
Lee Ho Yeung       Re: can not show all data for this table Wed, 15 Jun, 07:38
Lee Ho Yeung       Re: can not show all data for this table Wed, 15 Jun, 09:52
Mich Talebzadeh         Re: can not show all data for this table Wed, 15 Jun, 13:51
Tejaswini Buche hivecontext error Wed, 15 Jun, 01:33
Ted Yu   Re: hivecontext error Wed, 15 Jun, 01:39
Lee Ho Yeung streaming example has error Wed, 15 Jun, 01:34
David Newberger   RE: streaming example has error Wed, 15 Jun, 12:53
Lee Ho Yeung     Re: streaming example has error Thu, 16 Jun, 02:15
David Newberger       RE: streaming example has error Thu, 16 Jun, 13:13
Tejaswini Buche sqlcontext - not able to connect to database Wed, 15 Jun, 04:45
Jeff Zhang   Re: sqlcontext - not able to connect to database Wed, 15 Jun, 04:47
Khaled Hammouda Spark SQL driver memory keeps rising Wed, 15 Jun, 05:22
Mohammed Guller   RE: Spark SQL driver memory keeps rising Thu, 16 Jun, 02:23
Mich Talebzadeh     Re: Spark SQL driver memory keeps rising Thu, 16 Jun, 05:48
Khaled Hammouda     Re: Spark SQL driver memory keeps rising Thu, 16 Jun, 18:44
Mohammed Guller       RE: Spark SQL driver memory keeps rising Fri, 17 Jun, 01:13
Yang how do I set TBLPROPERTIES in dataFrame.saveAsTable()? Wed, 15 Jun, 08:02
Lee Ho Yeung can spark help to prevent memory error for itertools.combinations(initlist, 2) in python script Wed, 15 Jun, 10:02
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
Box list
Oct 202181
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137