spark-user mailing list archives: January 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Kevin Burton spark-shell running out of memory even with 6GB ? Tue, 10 Jan, 01:00
Kevin Burton Re: spark-shell running out of memory even with 6GB ? Tue, 10 Jan, 02:20
KhajaAsmath Mohammed Spark Log information Mon, 16 Jan, 03:41
KhajaAsmath Mohammed Re: Spark Log information Mon, 16 Jan, 03:56
KhajaAsmath Mohammed GroupBy and Spark Performance issue Tue, 17 Jan, 05:39
Koert Kuipers Re: can UDF accept "Any"/"AnyVal"/"AnyRef"(java Object) as parameter or as return type ? Tue, 03 Jan, 15:13
Koert Kuipers Re: top-k function for Window Tue, 03 Jan, 20:11
Koert Kuipers Re: OS killing Executor due to high (possibly off heap) memory usage Wed, 04 Jan, 00:25
Koert Kuipers Re: top-k function for Window Wed, 04 Jan, 15:11
Koert Kuipers Re: Spark SQL DataFrame to Kafka Topic Fri, 13 Jan, 16:28
Koert Kuipers ScalaReflectionException (class not found) error for user class in spark 2.1.0 Tue, 17 Jan, 04:51
Koert Kuipers Re: ScalaReflectionException (class not found) error for user class in spark 2.1.0 Tue, 17 Jan, 23:24
Koert Kuipers Re: Spark / Elasticsearch Error: Maybe ES was overloaded? How to throttle down Spark as it writes to ES Wed, 18 Jan, 04:37
Koert Kuipers dataset aggregators with kryo encoder very slow Thu, 19 Jan, 21:17
Koert Kuipers Re: dataset aggregators with kryo encoder very slow Fri, 20 Jan, 21:57
Koert Kuipers Re: dataset aggregators with kryo encoder very slow Sat, 21 Jan, 06:46
Koert Kuipers Re: dataset aggregators with kryo encoder very slow Sat, 21 Jan, 06:48
Koert Kuipers mvn deploy tries to upload artifacts multiple times Sat, 21 Jan, 22:43
Koert Kuipers Re: dataset aggregators with kryo encoder very slow Sun, 22 Jan, 07:35
Koert Kuipers Re: ScalaReflectionException (class not found) error for user class in spark 2.1.0 Mon, 23 Jan, 18:00
Koert Kuipers Aggregator mutate b1 in place in merge Mon, 23 Jan, 19:31
Koert Kuipers printSchema showing incorrect datatype? Tue, 24 Jan, 16:28
Koert Kuipers Re: Spark SQL DataFrame to Kafka Topic Tue, 24 Jan, 23:01
Koert Kuipers Re: printSchema showing incorrect datatype? Wed, 25 Jan, 18:46
Koert Kuipers can we plz open up encoder on dataset Wed, 25 Jan, 21:17
Koert Kuipers Re: can we plz open up encoder on dataset Thu, 26 Jan, 15:18
Koert Kuipers Re: can we plz open up encoder on dataset Thu, 26 Jan, 16:28
Koert Kuipers kafka structured streaming source refuses to read Fri, 27 Jan, 03:33
Koert Kuipers Re: kafka structured streaming source refuses to read Fri, 27 Jan, 04:56
Koert Kuipers Re: Making withColumn nullable Fri, 27 Jan, 16:37
Koert Kuipers Re: kafka structured streaming source refuses to read Fri, 27 Jan, 18:19
Koert Kuipers Re: kafka structured streaming source refuses to read Fri, 27 Jan, 18:24
Koert Kuipers Re: kafka structured streaming source refuses to read Fri, 27 Jan, 20:56
Koert Kuipers Re: kafka structured streaming source refuses to read Sat, 28 Jan, 18:13
Koert Kuipers Re: kafka structured streaming source refuses to read Sat, 28 Jan, 18:15
Koert Kuipers Re: Aggregator mutate b1 in place in merge Sun, 29 Jan, 16:17
Koert Kuipers Re: Aggregator mutate b1 in place in merge Sun, 29 Jan, 18:25
Koert Kuipers Re: userClassPathFirst=true prevents SparkContext to be initialized Mon, 30 Jan, 15:23
Koert Kuipers Re: Jars directory in Spark 2.0 Tue, 31 Jan, 17:25
Koert Kuipers Re: Spark 2.1.0 and Shapeless Tue, 31 Jan, 20:23
Koert Kuipers Re: eager? in dataframe's checkpoint Tue, 31 Jan, 20:52
Krishna Kalyan Unable to build spark documentation Wed, 11 Jan, 18:22
Kuan Feng Re: Fw: Yarn resource management for Spark with IBM Platform Symphony Thu, 19 Jan, 16:51
KumarP Spark Job hangs when one of the nodemanager goes down Wed, 18 Jan, 21:23
KumarP Re: Spark Job hangs when one of the nodemanager goes down Wed, 18 Jan, 23:12
Lan Jiang Spark Streaming proactive monitoring Mon, 23 Jan, 18:45
Lars Albertsson Re: TDD in Spark Tue, 17 Jan, 22:04
Linyuxin can UDF accept "Any"/"AnyVal"/"AnyRef"(java Object) as parameter or as return type ? Tue, 03 Jan, 12:46
Luciano Resende Re: Old version of Spark [v1.2.0] Thu, 19 Jan, 15:50
Lyndon Ollar Triplet vertices differ from vertices Wed, 18 Jan, 15:41
Madabhattula Rajesh Kumar PrefixSpan Tue, 24 Jan, 17:12
Madabhattula Rajesh Kumar ML version of Kmeans Tue, 31 Jan, 09:24
Mahender Sarangam Support of Theta Join Thu, 12 Jan, 15:19
Manish Tripathi Cosine Similarity Implementation in Spark Mon, 30 Jan, 23:20
Manohar Reddy RE: Spark Read from Google store and save in AWS s3 Thu, 05 Jan, 20:07
Manohar753 Spark java with Google Store Thu, 05 Jan, 08:23
Manohar753 Spark Read from Google store and save in AWS s3 Thu, 05 Jan, 09:58
Manohar753 Will be in around 12:30pm due to some personal stuff Fri, 20 Jan, 05:48
Manohar753 JavaRDD text matadata(file name) findings Tue, 31 Jan, 18:58
Marcelo Vanzin Re: why does spark web UI keeps changing its port? Mon, 23 Jan, 19:51
Marcelo Vanzin Re: why does spark web UI keeps changing its port? Mon, 23 Jan, 20:07
Marcelo Vanzin Re: why does spark web UI keeps changing its port? Mon, 23 Jan, 20:19
Marcelo Vanzin Re: why does spark web UI keeps changing its port? Mon, 23 Jan, 20:45
Marco Mistroni Re: Error when loading json to spark Sun, 01 Jan, 17:29
Marco Mistroni Re: Spark Streaming prediction Mon, 02 Jan, 20:07
Marco Mistroni Re: Re: Spark Streaming prediction Mon, 02 Jan, 21:30
Marco Mistroni Re: Re: Re: Spark Streaming prediction Tue, 03 Jan, 09:49
Marco Mistroni Re: [TorrentBroadcast] Pyspark Application terminated saying "Failed to get broadcast_1_ piece0 of broadcast_1 in Spark 2.0.0" Thu, 05 Jan, 09:31
Marco Mistroni Re: [TorrentBroadcast] Pyspark Application terminated saying "Failed to get broadcast_1_ piece0 of broadcast_1 in Spark 2.0.0" Thu, 05 Jan, 10:57
Marco Mistroni Re: Spark Python in Jupyter Notebook Thu, 05 Jan, 19:59
Marco Mistroni Re: Spark ML's RandomForestClassifier OOM Tue, 10 Jan, 10:22
Marco Mistroni Re: backward compatibility Tue, 10 Jan, 17:22
Marco Mistroni Re: Debugging a PythonException with no details Sat, 14 Jan, 21:02
Marco Mistroni Running Spark on EMR Sun, 15 Jan, 14:34
Marco Mistroni Re: Running Spark on EMR Sun, 15 Jan, 16:29
Marco Mistroni Re: Importing a github project on sbt Mon, 16 Jan, 15:42
Marco Mistroni Spark 2.0 vs MongoDb /Cannot find dependency using sbt Mon, 16 Jan, 21:32
Marco Mistroni Re: Spark 2.0 vs MongoDb /Cannot find dependency using sbt Mon, 16 Jan, 21:36
Marco Mistroni Spark vs MongoDB: saving DataFrame to db raises missing database name exception Mon, 16 Jan, 23:37
Marco Mistroni Re: Spark vs MongoDB: saving DataFrame to db raises missing database name exception Tue, 17 Jan, 07:53
Marco Mistroni Re: Spark vs MongoDB: saving DataFrame to db raises missing database name exception Wed, 18 Jan, 21:17
Marco Mistroni converting timestamp column to a java.util.Date Mon, 23 Jan, 23:18
Marco Mistroni Kafka dependencies in Eclipse project /Pls assist Tue, 31 Jan, 21:49
Mark Hamstra Re: Spark and Kafka integration Thu, 12 Jan, 19:28
Mark Hamstra Re: Sat, 21 Jan, 19:56
Mark Hamstra Re: DAG Visualization option is missing on Spark Web UI Sun, 29 Jan, 01:53
Mark Hamstra Re: Having multiple spark context Mon, 30 Jan, 06:54
Mars Xu Contradiction about shuffle in the documentation Sun, 22 Jan, 03:20
Marton, Elek Re: HBase Spark Tue, 31 Jan, 21:02
Masf Hbase and Spark Sun, 29 Jan, 12:22
Matheus Braun Magrin Error when loading saved ml model on pyspark (2.0.1) Tue, 31 Jan, 10:39
Matthew Dailey Re: tuning the spark.locality.wait Tue, 24 Jan, 01:19
Matthew Dailey Re: Do jobs fail because of other users of a cluster? Tue, 24 Jan, 01:43
Matthew Tovbin Metadata is not propagating with Dataset.map() Mon, 16 Jan, 23:47
Md. Rezaul Karim Re: Issue with SparkR setup on RStudio Mon, 02 Jan, 15:58
Md. Rezaul Karim RBackendHandler Error while running ML algorithms with SparkR on RStudio Tue, 03 Jan, 15:14
Md. Rezaul Karim Re: Issue with SparkR setup on RStudio Wed, 04 Jan, 15:04
Md. Rezaul Karim Re: Machine Learning in Spark 1.6 vs Spark 2.0 Mon, 09 Jan, 11:32
Md. Rezaul Karim Re: Machine Learning in Spark 1.6 vs Spark 2.0 Mon, 09 Jan, 16:44
Md. Rezaul Karim Re: How to save spark-ML model in Java? Thu, 12 Jan, 13:43
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
Aug 20216
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137