spark-user mailing list archives: January 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Md. Rezaul Karim H2O DataFrame to Spark RDD/DataFrame Thu, 12 Jan, 18:17
Md. Rezaul Karim Old version of Spark [v1.2.0] Sun, 15 Jan, 21:16
Md. Rezaul Karim Re: Old version of Spark [v1.2.0] Sun, 15 Jan, 22:55
Md. Rezaul Karim Parsing RDF data with Spark Wed, 18 Jan, 21:00
Md. Rezaul Karim "Unable to load native-hadoop library for your platform" while running Spark jobs Thu, 19 Jan, 10:57
Md. Rezaul Karim Re: "Unable to load native-hadoop library for your platform" while running Spark jobs Thu, 19 Jan, 11:02
Md. Rezaul Karim How to reduce number of tasks and partitions in Spark job? Thu, 26 Jan, 17:13
Md. Rezaul Karim Re: How to tune number of tesks Thu, 26 Jan, 17:36
Md. Rezaul Karim Re: Text Fri, 27 Jan, 11:59
Md. Rezaul Karim DAG Visualization option is missing on Spark Web UI Sat, 28 Jan, 18:02
Md. Rezaul Karim Re: DAG Visualization option is missing on Spark Web UI Sun, 29 Jan, 00:25
Md. Rezaul Karim Pruning decision tree in Spark Mon, 30 Jan, 10:27
Md. Rezaul Karim Re: DAG Visualization option is missing on Spark Web UI Mon, 30 Jan, 10:36
Mendelson, Assaf RE: What is missing here to use sql in spark? Mon, 02 Jan, 13:22
Mendelson, Assaf RE: top-k function for Window Tue, 03 Jan, 14:07
Mendelson, Assaf RE: top-k function for Window Wed, 04 Jan, 07:56
Mendelson, Assaf Wierd performance on windows laptop Tue, 24 Jan, 11:39
Mendelson, Assaf forcing dataframe groupby partitioning Sun, 29 Jan, 16:33
Mendelson, Assaf RE: forcing dataframe groupby partitioning Sun, 29 Jan, 18:00
Mevada, Vatsal SparkAppHandle returns unknown state forever Wed, 04 Jan, 07:49
Mich Talebzadeh spark sql in Cloudera package Wed, 04 Jan, 15:17
Mich Talebzadeh IBM Fluid query versus Spark Wed, 04 Jan, 21:57
Mich Talebzadeh Yarn resource management for Spark with IBM Platform Symphony Thu, 19 Jan, 15:23
Mich Talebzadeh Re: Fw: Yarn resource management for Spark with IBM Platform Symphony Thu, 19 Jan, 17:00
Mich Talebzadeh issue with running Spark streaming with spark-shell Sat, 28 Jan, 10:20
Mich Talebzadeh Re: spark architecture question -- Pleas Read Sun, 29 Jan, 11:39
Mich Talebzadeh Re: spark architecture question -- Pleas Read Sun, 29 Jan, 15:16
Mich Talebzadeh Re: spark architecture question -- Pleas Read Sun, 29 Jan, 15:19
Mich Talebzadeh Re: Having multiple spark context Mon, 30 Jan, 08:03
Mich Talebzadeh Tableau BI on Spark SQL Mon, 30 Jan, 20:57
Mich Talebzadeh Re: Tableau BI on Spark SQL Mon, 30 Jan, 21:59
Michael Armbrust Re: Dataset Type safety Tue, 10 Jan, 20:17
Michael Armbrust Re: Setting startingOffsets to earliest in structured streaming never catches up Mon, 23 Jan, 22:18
Michael Armbrust Re: printSchema showing incorrect datatype? Wed, 25 Jan, 18:04
Michael Armbrust Re: kafka structured streaming source refuses to read Fri, 27 Jan, 21:20
Michael Armbrust Re: kafka structured streaming source refuses to read Mon, 30 Jan, 22:16
Michael Gummelt Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 18:22
Michael Gummelt Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 20:31
Michael Gummelt Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 23:12
Michael Gummelt Re: spark locality Thu, 12 Jan, 19:16
Michael Gummelt Re: spark locality Thu, 12 Jan, 20:13
Michael Gummelt Re: spark locality Thu, 12 Jan, 22:41
Michael Gummelt Re: Dynamic resource allocation to Spark on Mesos Fri, 27 Jan, 19:14
Michael Gummelt Re: Dynamic resource allocation to Spark on Mesos Sat, 28 Jan, 22:32
Michael Gummelt Re: Dynamic resource allocation to Spark on Mesos Mon, 30 Jan, 19:34
Michael Segel Re: Spark/Parquet/Statistics question Tue, 17 Jan, 16:11
Michael Segel Quick but probably silly question... Tue, 17 Jan, 16:21
Miguel Morales Re: Error when loading json to spark Sun, 01 Jan, 04:52
Miguel Morales Re: TDD in Spark Sun, 15 Jan, 23:27
Mihai Iacob Re: Dynamic resource allocation to Spark on Mesos Fri, 27 Jan, 21:04
Minudika Malshan How to save spark-ML model in Java? Thu, 12 Jan, 09:09
Minudika Malshan How to save a pipeline model in spark-ML(JAVA) ? Thu, 12 Jan, 09:13
Minudika Malshan Re: How to save spark-ML model in Java? Thu, 19 Jan, 18:31
Morten Hornbech Re: New runtime exception after switch to Spark 2.1.0 Fri, 20 Jan, 21:17
Mudasar newAPIHadoopFile bad performance Fri, 06 Jan, 04:17
Muthu Jayakumar Re: Dataframe caching Fri, 20 Jan, 15:55
N B Kryo (with Spark 1.6.3) class registration slows down processing Sat, 21 Jan, 01:15
Naveen Re: Tue, 24 Jan, 04:40
Neil Jonkers Re: Running Spark on EMR Sun, 15 Jan, 16:27
Neil Jonkers Re: spark 2.02 error when writing to s3 Fri, 20 Jan, 19:38
Nicholas Chammas Debugging a PythonException with no details Sat, 14 Jan, 01:40
Nicholas Chammas Re: Debugging a PythonException with no details Wed, 18 Jan, 01:19
Nicholas Hakobian Re: What is the difference between hive on spark and spark on hive? Mon, 09 Jan, 17:50
Nicholas Hakobian Re: Re: Re: how to change datatype by useing StructType Fri, 13 Jan, 00:35
Nicholas Sharkey Re: H2O DataFrame to Spark RDD/DataFrame Thu, 12 Jan, 18:36
Nick Pentreath Re: ML PIC Mon, 16 Jan, 11:07
Nicolas Tallineau [Spark SQL - Scala] TestHive not working in Spark 2 Fri, 13 Jan, 14:40
Nicolas Tallineau RE: [Spark SQL - Scala] TestHive not working in Spark 2 Fri, 13 Jan, 18:23
Nikhil Goyal Question about DStreamCheckpointData Wed, 25 Jan, 23:52
Nikola Z unsubscribe Thu, 05 Jan, 10:57
Nils Grabbert CompileException with Maps in Spark 2.1.0 Fri, 06 Jan, 08:28
Ninad Shringarpure Creating UUID using SparksSQL Wed, 18 Jan, 19:23
Ninad Shringarpure Making withColumn nullable Fri, 27 Jan, 15:32
Nipun Arora SparkStreaming add Max Line of each RDD throwing an exception Wed, 18 Jan, 21:10
Nipun Arora [SparkStreaming] SparkStreaming not allowing to do parallelize within a transform operation to generate a new RDD Wed, 18 Jan, 22:25
Nipun Arora [SparkStreaming] SparkStreaming not allowing to do parallelize within a transform operation to generate a new RDD Thu, 19 Jan, 17:06
Nipun Arora Re: [SparkStreaming] SparkStreaming not allowing to do parallelize within a transform operation to generate a new RDD Thu, 19 Jan, 17:50
Nipun Arora Resource Leak in Spark Streaming Tue, 31 Jan, 18:37
Nipun Arora Re: Resource Leak in Spark Streaming Tue, 31 Jan, 22:12
Nipun Arora Re: Resource Leak in Spark Streaming Tue, 31 Jan, 23:02
Nipun Arora Re: Resource Leak in Spark Streaming Tue, 31 Jan, 23:32
Niraj Kumar How to write Spark DataFrame to salesforce table Mon, 23 Jan, 14:10
Nirav Patel Dynamic scheduling not respecting spark.executor.cores Tue, 03 Jan, 22:51
Nirav Patel Re: Dynamic Allocation not respecting spark.executor.cores Wed, 04 Jan, 19:58
Nirmal Fernando Re: Sporadic ClassNotFoundException with Kryo Fri, 13 Jan, 06:20
Olivier Girardot Re: Help in generating unique Id in spark row Thu, 05 Jan, 19:53
Olivier Girardot Re: Spark SQL - Applying transformation on a struct inside an array Thu, 05 Jan, 20:01
Olivier Girardot Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 16:56
Olivier Girardot Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 20:18
Olivier Girardot Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 20:46
Olivier Girardot Re: Nested ifs in sparksql Tue, 10 Jan, 20:54
Oshadha Gunawardena Re: Will be in around 12:30pm due to some personal stuff Fri, 20 Jan, 06:02
Palash Gupta Re: [TorrentBroadcast] Pyspark Application terminated saying "Failed to get broadcast_1_ piece0 of broadcast_1 in Spark 2.0.0" Thu, 05 Jan, 09:00
Palash Gupta Re: [TorrentBroadcast] Pyspark Application terminated saying "Failed to get broadcast_1_ piece0 of broadcast_1 in Spark 2.0.0" Thu, 05 Jan, 10:35
Palash Gupta Re: [TorrentBroadcast] Pyspark Application terminated saying "Failed to get broadcast_1_ piece0 of broadcast_1 in Spark 2.0.0" Thu, 05 Jan, 11:18
Palash Gupta [Spark 2.1.0] Resource Scheduling Challenge in pyspark sparkSession Thu, 05 Jan, 13:35
Palash Gupta Re: spark-shell running out of memory even with 6GB ? Tue, 10 Jan, 02:28
Palash Gupta Re: Spark vs MongoDB: saving DataFrame to db raises missing database name exception Tue, 17 Jan, 06:44
Palash Gupta Re: Spark vs MongoDB: saving DataFrame to db raises missing database name exception Tue, 17 Jan, 07:16
Palash Gupta Re: Spark #cores Wed, 18 Jan, 17:13
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
Aug 20214
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137