spark-user mailing list archives: January 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Guillermo Ortiz Re: Testing Spark-Cassandra Wed, 17 Jan, 18:31
HARSH TAKKAR Data of ArrayType field getting truncated when saving to parquet Wed, 31 Jan, 14:20
Hien Luu RE: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 06 Jan, 19:42
Holden Karau Re: Spark Tuning Tool Tue, 23 Jan, 05:16
Hyukjin Kwon Re: Custom line/record delimiter Tue, 02 Jan, 01:54
Iain Cundy Kafka deserialization to Structured Streaming SQL - Encoders.bean result doesn't match itself? Thu, 25 Jan, 12:11
Irtiza Ali Spark Monitoring using Jolokia Mon, 08 Jan, 13:55
Jacek Laskowski Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Wed, 03 Jan, 13:46
Jacek Laskowski Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Thu, 04 Jan, 22:19
Jacek Laskowski Re: Inner join with the table itself Mon, 15 Jan, 10:09
Jacek Laskowski Re: Inner join with the table itself Mon, 15 Jan, 21:33
Jacek Laskowski Re: Best active groups, forums or contacts for Spark ? Fri, 26 Jan, 11:56
Jacek Laskowski Re: Apache Spark - Spark Structured Streaming - Watermark usage Fri, 26 Jan, 18:59
Jacek Laskowski Re: spark job error Tue, 30 Jan, 19:55
Jason Heo [Spark SQL] How to run a custom meta query for `ANALYZE TABLE` Wed, 03 Jan, 04:17
Jean Georges Perrin Re: S3 token times out during data frame "write.csv" Thu, 25 Jan, 13:10
Jean Georges Perrin Schema - DataTypes.NullType Mon, 29 Jan, 22:05
Jean Georges Perrin Schema - DataTypes.NullType Mon, 29 Jan, 22:07
Jean Georges Perrin Re: Type Casting Error in Spark Data Frame Mon, 29 Jan, 22:08
Jeff Zhang Re: PIG to Spark Tue, 09 Jan, 04:50
Jeff Zhang Re: spark-submit can find python? Tue, 16 Jan, 02:20
Jeroen Miller Re: Spark on EMR suddenly stalling Tue, 02 Jan, 07:50
Jeroen Miller Re: Spark on EMR suddenly stalling Tue, 02 Jan, 07:53
Jhon Anderson Cardenas Diaz Spark UI stdout/stderr links point to executors internal address Tue, 09 Jan, 22:13
Jhon Anderson Cardenas Diaz How to create security filter for Spark UI in Spark on YARN Tue, 09 Jan, 22:23
Joe Wang Spark SQL bucket pruning support Tue, 23 Jan, 06:11
Joel D No Tasks have reported metrics yet Wed, 10 Jan, 18:00
John Zhuge Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Wed, 03 Jan, 06:57
John Zhuge Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 02:46
John Zhuge Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 04:18
Jose Pedro de Santana Neto unsubscribe Tue, 16 Jan, 12:23
Josh Rosen Re: Is Apache Spark-2.2.1 compatible with Hadoop-3.0.0 Mon, 08 Jan, 18:17
Jules Damji Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sun, 07 Jan, 00:16
Justin Miller "Got wrong record after seeking to offset" issue Wed, 17 Jan, 05:10
Justin Miller Re: "Got wrong record after seeking to offset" issue Thu, 18 Jan, 07:17
Justin Miller Re: "Got wrong record after seeking to offset" issue Thu, 18 Jan, 20:46
Justin Miller Re: uncontinuous offset in kafka will cause the spark streaming failure Wed, 24 Jan, 06:23
Keith Chapman Re: update LD_LIBRARY_PATH when running apache job in a YARN cluster Thu, 18 Jan, 01:42
KhajaAsmath Mohammed Null pointer exception in checkpoint directory Tue, 16 Jan, 19:42
KhajaAsmath Mohammed Spark Streaming not reading missed data Tue, 16 Jan, 21:04
KhajaAsmath Mohammed Re: Spark Streaming not reading missed data Tue, 16 Jan, 21:19
KhajaAsmath Mohammed Spark Stream is corrupted Thu, 18 Jan, 04:39
KhajaAsmath Mohammed Re: Spark Stream is corrupted Thu, 18 Jan, 14:52
KhajaAsmath Mohammed Gracefully shutdown spark streaming application Sun, 21 Jan, 20:22
KhajaAsmath Mohammed Production Critical : Data loss in spark streaming Mon, 22 Jan, 17:36
KhajaAsmath Mohammed Spark Streaming data loss checkpoint directory Tue, 23 Jan, 02:27
KhajaAsmath Mohammed Spark Streaming checkpoint Mon, 29 Jan, 18:47
Kurt Fehlhauer Re: how to create a DataType Object using the String representation in Java using Spark 2.2.0? Fri, 26 Jan, 07:11
Lalwani, Jayesh Re: Converting binary files Wed, 03 Jan, 02:48
Lalwani, Jayesh Unclosed NingWSCLient holds up a Spark appication Wed, 03 Jan, 03:00
Liana Napalkova py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet Wed, 10 Jan, 16:58
Liana Napalkova Re: py4j.protocol.Py4JJavaError: An error occurred while calling o794.parquet Wed, 10 Jan, 20:04
LongVehicle [Spark Streaming]: Non-deterministic uneven task-to-machine assignment Tue, 30 Jan, 15:12
M Singh Re: Spark on EMR suddenly stalling Mon, 01 Jan, 16:12
M Singh Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Wed, 03 Jan, 17:53
M Singh Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Thu, 04 Jan, 21:49
M Singh Re: Apache Spark - Question about Structured Streaming Sink addBatch dataframe size Fri, 05 Jan, 19:35
M Singh Apache Spark - Custom structured streaming data source Fri, 26 Jan, 04:36
M Singh Re: Apache Spark - Custom structured streaming data source Fri, 26 Jan, 15:10
M Singh Apache Spark - Spark Structured Streaming - Watermark usage Fri, 26 Jan, 18:14
M Singh Apache Spark - Exception on adding column to Structured Streaming DataFrame Wed, 31 Jan, 23:35
Manuel Sopena Ballesteros spark-submit can find python? Mon, 15 Jan, 23:53
Manuel Sopena Ballesteros RE: spark-submit can find python? Tue, 16 Jan, 00:02
Manuel Sopena Ballesteros update LD_LIBRARY_PATH when running apache job in a YARN cluster Thu, 18 Jan, 01:39
Manuel Sopena Ballesteros good materiala to learn apache spark Thu, 18 Jan, 06:15
Marcelo Vanzin Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Wed, 03 Jan, 17:59
Marcelo Vanzin Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 03:53
Marcelo Vanzin Re: Is spark-env.sh sourced by Application Master and Executor for Spark on YARN? Thu, 04 Jan, 17:16
Marco Mistroni Re: good materiala to learn apache spark Thu, 18 Jan, 09:54
Marco Mistroni Re: Best active groups, forums or contacts for Spark ? Fri, 26 Jan, 14:08
Margusja Re: run spark job in yarn cluster mode as specified user Mon, 22 Jan, 07:36
Margusja Re: run spark job in yarn cluster mode as specified user Mon, 22 Jan, 14:44
Margusja Get broadcast (set in one method) in another method Thu, 25 Jan, 20:04
Matt Hicks [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 18:21
Matt Hicks Re: [Spark ML] Positive-Only Training Classification in Scala Mon, 15 Jan, 19:56
Matt Hicks Re: [Spark ML] Positive-Only Training Classification in Scala Tue, 16 Jan, 14:51
Matt Hicks Re: [Spark ML] Positive-Only Training Classification in Scala Tue, 16 Jan, 14:57
Matteo Cossu Re: [Spark DataFrame]: Passing DataFrame to custom method results in NullPointerException Mon, 22 Jan, 16:09
Maximiliano Felice Re: Spark Monitoring using Jolokia Mon, 08 Jan, 14:14
Md. Rezaul Karim Reinforcement Learning with Spark Sat, 06 Jan, 01:04
Mich Talebzadeh Spark vs Snowflake Mon, 22 Jan, 21:51
Mich Talebzadeh Re: Spark Tuning Tool Wed, 24 Jan, 00:00
Michael Armbrust Re: Dataset API inconsistencies Wed, 10 Jan, 09:48
Michael Armbrust Re: Max number of streams supported ? Wed, 31 Jan, 20:39
Michael Armbrust Re: Prefer Structured Streaming over Spark Streaming (DStreams)? Wed, 31 Jan, 23:12
Michael Mansour Re: [EXT] How do I extract a value in foreachRDD operation Mon, 22 Jan, 17:25
Michael Segel Reading Hive RCFiles? Thu, 18 Jan, 15:32
Michael Segel Re: Reading Hive RCFiles? Thu, 18 Jan, 16:02
Michael Segel Re: Reading Hive RCFiles? Mon, 29 Jan, 15:32
Michael Shtelma Re: Inner join with the table itself Mon, 15 Jan, 14:26
Michael Shtelma Re: Inner join with the table itself Tue, 16 Jan, 09:13
Michael Shtelma spark.sql call takes far too long Wed, 24 Jan, 12:16
Mihai Iacob spark 2.0 and spark 2.2 Mon, 22 Jan, 15:07
Muhammad Yaseen Aftab unsubscribe Tue, 16 Jan, 12:20
Mutahir Ali Apache Hadoop and Spark Wed, 24 Jan, 20:50
Nan Zhu Palantir replease under org.apache.spark? Tue, 09 Jan, 17:42
Nan Zhu Re: Palantir replease under org.apache.spark? Tue, 09 Jan, 17:58
Nathan Kronenfeld select with more than 5 typed columns Mon, 08 Jan, 23:01
Nick Pentreath Re: [ML] Allow CrossValidation ParamGrid on SVMWithSGD Fri, 19 Jan, 12:04
Nick Pentreath Re: Has there been any explanation on the performance degradation between spark.ml and Mllib? Mon, 22 Jan, 07:31
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Sep 202191
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137