spark-user mailing list archives: February 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Holden Karau Re: Can spark handle this scenario? Sat, 17 Feb, 07:35
Holden Karau Re: Spark not releasing shuffle files in time (with very large heap) Sat, 24 Feb, 02:37
Hyukjin Kwon Re: SparkR test script issue: unable to run run-tests.h on spark 2.2 Wed, 14 Feb, 09:47
Irving Duran Re: Can spark handle this scenario? Sat, 17 Feb, 01:40
Ismail Bayraktar Spark conf forgets cassandra host in the configuration file Thu, 08 Feb, 09:36
J. McConnell Workarounds for OOM during serialization Fri, 02 Feb, 21:48
JB Data Re: Log analysis with GraphX Wed, 21 Feb, 08:47
JB Data Re: Log analysis with GraphX Thu, 22 Feb, 09:54
Jacek Laskowski Re: Apache Spark - Spark Structured Streaming - Watermark usage Tue, 06 Feb, 17:04
Jacek Laskowski Re: Are there any alternatives to Hive "stored by" clause as Spark 2.0 does not support it Thu, 08 Feb, 12:58
James Casiraghi unsubscribe Thu, 01 Feb, 15:47
Jean Georges Perrin Re: is there a way to create new column with timeuuid using raw spark sql ? Thu, 01 Feb, 12:01
Jean Georges Perrin Re: Schema - DataTypes.NullType Sun, 04 Feb, 18:15
Jean Georges Perrin Re: Schema - DataTypes.NullType Sun, 11 Feb, 13:40
Jean Georges Perrin Re: Schema - DataTypes.NullType Mon, 12 Feb, 15:32
Jean Rossier NotSerializableException with Trait Fri, 23 Feb, 13:59
Jenna Hoole Spark on K8s with Romana Mon, 12 Feb, 21:21
Jenna Hoole Spark on K8s - using files fetched by init-container? Mon, 26 Feb, 18:51
Jenna Hoole Re: Spark on K8s - using files fetched by init-container? Mon, 26 Feb, 21:11
Jiewen Shao Spark Streaming withWatermark Tue, 06 Feb, 18:11
Jiewen Shao Re: Spark Streaming withWatermark Tue, 06 Feb, 22:18
Jorge Machado Re: HBase connector does not read ZK configuration from Spark session Fri, 23 Feb, 07:57
Kane Kim parquet vs orc files Wed, 21 Feb, 20:54
Kane Kim Re: parquet vs orc files Wed, 21 Feb, 21:58
Karthik Jayaraman [Beginner] Kafka 0.11 header support in Spark Structured Streaming Tue, 27 Feb, 22:51
Keith Chapman Spark not releasing shuffle files in time (with very large heap) Thu, 22 Feb, 08:13
Keith Chapman Re: Spark not releasing shuffle files in time (with very large heap) Fri, 23 Feb, 03:19
Kevin Jung How to preserve the order of parquet files? Wed, 07 Feb, 12:07
Kevin Lam NullPointerException issue in LDA.train() Fri, 09 Feb, 20:02
KhajaAsmath Mohammed Structure streaming to hive with kafka 0.9 Thu, 01 Feb, 17:26
KhajaAsmath Mohammed Re: Efficient way to compare the current row with previous row contents Mon, 12 Feb, 14:16
KhajaAsmath Mohammed Joins in spark for large tables Wed, 28 Feb, 17:40
Khan, Obaidur Rehman Issue with EFS checkpoint Wed, 07 Feb, 16:08
Kurt Fehlhauer Re: parquet vs orc files Thu, 22 Feb, 19:31
Lian Jiang Spark cannot find tables in Oracle database Sun, 11 Feb, 02:26
Lian Jiang Re: Spark cannot find tables in Oracle database Sun, 11 Feb, 16:04
Lian Jiang saveAsTable does not respect spark.sql.warehouse.dir Sun, 11 Feb, 17:15
Lian Jiang Re: saveAsTable does not respect spark.sql.warehouse.dir Sun, 11 Feb, 20:09
Lian Jiang Can spark handle this scenario? Sat, 17 Feb, 00:10
Lian Jiang Re: Can spark handle this scenario? Sat, 17 Feb, 07:19
Lian Jiang Re: Can spark handle this scenario? Sat, 17 Feb, 17:13
Lian Jiang Re: Can spark handle this scenario? Sat, 17 Feb, 17:56
Lian Jiang Re: Can spark handle this scenario? Sat, 17 Feb, 19:09
Lian Jiang Re: Can spark handle this scenario? Tue, 20 Feb, 22:48
Lian Jiang Return statements aren't allowed in Spark closures Wed, 21 Feb, 21:16
Lian Jiang Re: Return statements aren't allowed in Spark closures Thu, 22 Feb, 04:46
Lian Jiang Re: Can spark handle this scenario? Thu, 22 Feb, 19:57
Lian Jiang Re: Can spark handle this scenario? Mon, 26 Feb, 18:09
Liana Napalkova Re: is there a way to create new column with timeuuid using raw spark sql ? Thu, 01 Feb, 16:35
LongVehicle Re: [Spark Streaming]: Non-deterministic uneven task-to-machine assignment Tue, 20 Feb, 13:32
M Singh Re: Apache Spark - Exception on adding column to Structured Streaming DataFrame Thu, 01 Feb, 15:43
M Singh Re: Apache Spark - Spark Structured Streaming - Watermark usage Fri, 02 Feb, 16:47
M Singh Re: Apache Spark - Exception on adding column to Structured Streaming DataFrame Mon, 05 Feb, 19:07
M Singh Re: Apache Spark - Spark Structured Streaming - Watermark usage Mon, 05 Feb, 19:11
M Singh Re: Apache Spark - Spark Structured Streaming - Watermark usage Tue, 06 Feb, 17:36
M Singh Apache Spark - Structured Streaming - Updating UDF state dynamically at run time Thu, 08 Feb, 22:58
M Singh Apache Spark - Structured Streaming Query Status - field descriptions Sun, 11 Feb, 01:42
M Singh Re: Apache Spark - Structured Streaming - Updating UDF state dynamically at run time Sun, 11 Feb, 01:43
M Singh Re: Apache Spark - Structured Streaming Query Status - field descriptions Sun, 11 Feb, 15:52
M Singh Apache Spark - Structured Streaming reading from Kafka some tasks take much longer Fri, 23 Feb, 19:38
M Singh Re: Apache Spark - Structured Streaming reading from Kafka some tasks take much longer Sat, 24 Feb, 15:45
Mallanagouda Patil Unsubscribe Mon, 26 Feb, 15:58
Marcelo Vanzin Re: [spark-sql] Custom Query Execution listener via conf properties Fri, 16 Feb, 11:38
Matteo Cossu Re: can udaf's return complex types? Tue, 13 Feb, 09:38
Mich Talebzadeh H2O ML use Fri, 09 Feb, 09:24
Mich Talebzadeh Re: Spark Dataframe and HIVE Sun, 11 Feb, 08:06
Mich Talebzadeh spark 2 new stuff Mon, 26 Feb, 14:26
Michael Armbrust Re: [Structured Streaming] Commit protocol to move temp files to dest path only when complete, with code Sat, 10 Feb, 00:18
Michael Armbrust Re: [Structured Streaming] Deserializing avro messages from kafka source using schema registry Sat, 10 Feb, 00:20
Michael Artz Re: Return statements aren't allowed in Spark closures Thu, 22 Feb, 08:51
Mihai Iacob spark 2.2.1 Thu, 01 Feb, 16:30
Mihai Iacob Re: spark 2.2.1 Fri, 02 Feb, 14:51
Mikhailau, Alex does Kinesis Connector for structured streaming auto-scales receivers if a cluster is using dynamic allocation and auto-scaling? Thu, 01 Feb, 16:54
Mina Aslani org.apache.kafka.clients.consumer.OffsetOutOfRangeException Mon, 12 Feb, 19:04
Mina Aslani Write a DataFrame with Vector values into text/csv file Tue, 20 Feb, 20:12
Mina Aslani Serialize a DataFrame with Vector values into text/csv file Tue, 20 Feb, 20:23
Mina Aslani Re: Serialize a DataFrame with Vector values into text/csv file Tue, 20 Feb, 21:51
Mina Aslani Re: Serialize a DataFrame with Vector values into text/csv file Wed, 21 Feb, 04:20
Mina Aslani Re: Serialize a DataFrame with Vector values into text/csv file Wed, 21 Feb, 04:25
Naved Alam [Spark-Listener] [How-to] Listen only to specific events Tue, 13 Feb, 08:15
Nicholas Chammas Suppressing output from Apache Ivy (?) when calling spark-submit with --packages Tue, 27 Feb, 18:37
Nicholas Hakobian Re: Spark Dataframe and HIVE Fri, 09 Feb, 18:29
Nicholas Hakobian Re: Schema - DataTypes.NullType Mon, 12 Feb, 01:15
Nicholas Hakobian Re: Does Pyspark Support Graphx? Mon, 19 Feb, 19:37
Nick Pentreath Re: Spark MLlib: Should I call .cache before fitting a model? Tue, 27 Feb, 19:49
Nicolas Paris Re: ML:One vs Rest with crossValidator for multinomial in logistic regression Thu, 01 Feb, 06:20
Nicolas Paris Re: ML:One vs Rest with crossValidator for multinomial in logistic regression Fri, 09 Feb, 22:10
Nicolas Paris Re: Does Pyspark Support Graphx? Sun, 18 Feb, 08:31
Nikhil Goyal GC issues with spark job Sun, 18 Feb, 23:31
Nikhil Goyal Job never finishing Tue, 20 Feb, 22:52
Nikhil Goyal Re: Job never finishing Wed, 21 Feb, 18:44
Nirav Patel Sharing spark executor pool across multiple long running spark applications Tue, 06 Feb, 20:00
Nirav Patel Re: Sharing spark executor pool across multiple long running spark applications Sat, 10 Feb, 14:29
Patrick Out of memory Error when using Collection Accumulator Spark 2.2 Mon, 26 Feb, 09:45
Patrick Alwell Re: Spark Dataframe and HIVE Fri, 09 Feb, 15:39
Patrick Alwell Re: Spark Dataframe and HIVE Sun, 11 Feb, 17:51
Patrick Alwell Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 22:42
Patrick Alwell Re: [Beginner] How to save Kafka Dstream data to parquet ? Wed, 28 Feb, 20:17
Patrick McCarthy Reservoir sampling in parallel Fri, 23 Feb, 15:44
Philippe de Rochambeau Log analysis with GraphX Sat, 10 Feb, 14:49
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Nov 201973
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137