spark-user mailing list archives: September 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
ravi6c2 Spark Dataframe returning null columns when schema is specified Thu, 07 Sep, 18:44
Praneeth Gayam   Re: Spark Dataframe returning null columns when schema is specified Fri, 08 Sep, 06:34
Re: Chaining Spark Streaming Jobs
Sunita Arvind   Re: Chaining Spark Streaming Jobs Fri, 08 Sep, 04:15
Praneeth Gayam     Re: Chaining Spark Streaming Jobs Fri, 08 Sep, 06:24
Sunita Arvind       Re: Chaining Spark Streaming Jobs Fri, 08 Sep, 10:56
Sunita Arvind   Re: Chaining Spark Streaming Jobs Tue, 12 Sep, 23:50
vincent gromakowski     Re: Chaining Spark Streaming Jobs Wed, 13 Sep, 06:01
Sunita Arvind       Re: Chaining Spark Streaming Jobs Wed, 13 Sep, 16:33
Michael Armbrust     Re: Chaining Spark Streaming Jobs Mon, 18 Sep, 17:15
Srikanth Sampath Spark ML DAG Pipelines Fri, 08 Sep, 05:07
Uğur Sopaoğlu Part-time job Fri, 08 Sep, 07:25
PICARD Damien [No Subject] Fri, 08 Sep, 07:36
Gourav Sengupta   Re: Mon, 11 Sep, 13:32
Jone Zhang Wish you give our product a wonderful name Fri, 08 Sep, 08:05
Sean Owen CVE-2017-12612 Unsafe deserialization in Apache Spark launcher API Fri, 08 Sep, 11:20
Matthew Anthony [Spark Core] excessive read/load times on parquet files in 2.2 vs 2.0 Fri, 08 Sep, 15:44
Neil Jonkers   Re: [Spark Core] excessive read/load times on parquet files in 2.2 vs 2.0 Fri, 08 Sep, 17:00
Matthew Anthony     Re: [Spark Core] excessive read/load times on parquet files in 2.2 vs 2.0 Fri, 08 Sep, 17:04
Matthew Anthony     Re: [Spark Core] excessive read/load times on parquet files in 2.2 vs 2.0 Mon, 11 Sep, 22:19
Gourav Sengupta       Re: [Spark Core] excessive read/load times on parquet files in 2.2 vs 2.0 Tue, 12 Sep, 05:57
Gourav Sengupta SPARK CSV ISSUE Fri, 08 Sep, 18:25
Gourav Sengupta   Re: SPARK CSV ISSUE Sat, 09 Sep, 06:20
Xiaoye Sun Multiple vcores per container when running Spark applications in Yarn cluster mode Fri, 08 Sep, 22:54
Saisai Shao   Re: Multiple vcores per container when running Spark applications in Yarn cluster mode Mon, 11 Sep, 01:19
Xiaoye Sun     Re: Multiple vcores per container when running Spark applications in Yarn cluster mode Mon, 11 Sep, 22:36
Gourav Sengupta       Re: Multiple vcores per container when running Spark applications in Yarn cluster mode Tue, 12 Sep, 05:58
Davide.Mandrini Spark Streaming - Stopped worker throws FileNotFoundException Sat, 09 Sep, 12:18
Re: Spark standalone API...
Davide.Mandrini   Re: Spark standalone API... Sat, 09 Sep, 12:22
Davide.Mandrini   Re: Spark standalone API... Sat, 09 Sep, 12:30
Davide.Mandrini   Re: Spark standalone API... Sat, 09 Sep, 12:33
Davide.Mandrini   Re: Spark standalone API... Sat, 09 Sep, 12:35
Davide.Mandrini   Re: Spark standalone API... Sat, 09 Sep, 12:40
Davide.Mandrini   Re: Spark standalone API... Sun, 10 Sep, 08:26
[Spark Streaming] - Stopped worker throws FileNotFoundException
Davide.Mandrini   [Spark Streaming] - Stopped worker throws FileNotFoundException Sat, 09 Sep, 12:42
Davide.Mandrini   [Spark Streaming] - Stopped worker throws FileNotFoundException Sat, 09 Sep, 13:26
Davide.Mandrini   [Spark Streaming] - Stopped worker throws FileNotFoundException Sun, 10 Sep, 08:32
kant kodali Queries with streaming sources must be executed with writeStream.start() Sat, 09 Sep, 23:04
Felix Cheung   Re: Queries with streaming sources must be executed with writeStream.start() Sat, 09 Sep, 23:20
kant kodali     Re: Queries with streaming sources must be executed with writeStream.start() Sat, 09 Sep, 23:40
Shixiong(Ryan) Zhu       Re: Queries with streaming sources must be executed with writeStream.start() Sun, 10 Sep, 00:14
kant kodali         Re: Queries with streaming sources must be executed with writeStream.start() Sun, 10 Sep, 01:27
Michael Armbrust           Re: Queries with streaming sources must be executed with writeStream.start() Mon, 11 Sep, 21:28
kant kodali             Re: Queries with streaming sources must be executed with writeStream.start() Tue, 12 Sep, 19:32
kant kodali               Re: Queries with streaming sources must be executed with writeStream.start() Tue, 12 Sep, 21:26
kant kodali How to convert Row to JSON in Java? Sat, 09 Sep, 23:15
Felix Cheung   Re: How to convert Row to JSON in Java? Sat, 09 Sep, 23:18
kant kodali     Re: How to convert Row to JSON in Java? Sat, 09 Sep, 23:45
Riccardo Ferrari       Re: How to convert Row to JSON in Java? Sun, 10 Sep, 18:22
ayan guha         Re: How to convert Row to JSON in Java? Mon, 11 Sep, 01:51
Jean Georges Perrin           Re: How to convert Row to JSON in Java? Mon, 11 Sep, 01:56
Jean Georges Perrin             Re: How to convert Row to JSON in Java? Mon, 11 Sep, 02:02
Riccardo Ferrari           Re: How to convert Row to JSON in Java? Mon, 11 Sep, 07:39
kant kodali             Re: How to convert Row to JSON in Java? Mon, 11 Sep, 20:15
Riccardo Ferrari               Re: How to convert Row to JSON in Java? Mon, 11 Sep, 21:45
Re: Bizarre UI Behavior after migration
Vadim Semenov   Re: Bizarre UI Behavior after migration Sun, 10 Sep, 23:16
Sunil Kalyanpur Spark UI port Mon, 11 Sep, 03:41
PICARD Damien ClassNotFoundException while unmarshalling a remote RDD on Spark 1.5.1 Mon, 11 Sep, 06:53
PICARD Damien   RE: ClassNotFoundException while unmarshalling a remote RDD on Spark 1.5.1 Tue, 12 Sep, 14:59
kant kodali Need some Clarification on checkpointing w.r.t Spark Structured Streaming Mon, 11 Sep, 09:36
Michael Armbrust   Re: Need some Clarification on checkpointing w.r.t Spark Structured Streaming Mon, 11 Sep, 21:26
张万新 [SS]How to add a column with custom system time? Mon, 11 Sep, 10:03
Michael Armbrust   Re: [SS]How to add a column with custom system time? Mon, 11 Sep, 20:47
张万新     Re: [SS]How to add a column with custom system time? Tue, 12 Sep, 03:27
Michael Armbrust       Re: [SS]How to add a column with custom system time? Tue, 12 Sep, 04:32
张万新         Re: [SS]How to add a column with custom system time? Tue, 12 Sep, 07:05
Michael Armbrust           Re: [SS]How to add a column with custom system time? Tue, 12 Sep, 18:35
张万新             Re: [SS]How to add a column with custom system time? Wed, 13 Sep, 03:33
张万新               Re: [SS]How to add a column with custom system time? Wed, 13 Sep, 03:43
张万新                 Re: [SS]How to add a column with custom system time? Wed, 13 Sep, 04:03
Michael Armbrust                   Re: [SS]How to add a column with custom system time? Thu, 14 Sep, 19:33
陈卓 How does spark work? Mon, 11 Sep, 10:18
Vikash Pareek   Re: How does spark work? Tue, 12 Sep, 11:07
nguyen duc Tuan     Re: How does spark work? Tue, 12 Sep, 15:29
Jules Damji     Re: How does spark work? Tue, 12 Sep, 16:32
Re: Why do checkpoints work the way they do?
Dmitry Naumenko   Re: Why do checkpoints work the way they do? Mon, 11 Sep, 11:13
Hugo Reinwald     Re: Why do checkpoints work the way they do? Tue, 12 Sep, 16:39
Re: Quick Start Guide Syntax Error (Python)
larister   Re: Quick Start Guide Syntax Error (Python) Mon, 11 Sep, 11:19
Md. Rezaul Karim Bayesian network with Saprk Mon, 11 Sep, 13:00
Eduardo D'Avila [Structured Streaming] Trying to use Spark structured streaming Mon, 11 Sep, 15:04
Burak Yavuz   Re: [Structured Streaming] Trying to use Spark structured streaming Mon, 11 Sep, 16:11
Eduardo D'Avila     Re: [Structured Streaming] Trying to use Spark structured streaming Mon, 11 Sep, 19:30
Efficient Spark-Submit planning
Aakash Basu   Efficient Spark-Submit planning Mon, 11 Sep, 21:10
Sonal Goyal     Re: Efficient Spark-Submit planning Tue, 12 Sep, 11:51
kant kodali Does Kafka dependency jars changed for Spark Structured Streaming 2.2.0? Tue, 12 Sep, 01:24
kant kodali   Re: Does Kafka dependency jars changed for Spark Structured Streaming 2.2.0? Tue, 12 Sep, 05:04
kant kodali unable to read from Kafka (very strange) Tue, 12 Sep, 03:20
Vikash Pareek Unable to save an RDd on S3 with SSE-KMS encryption Tue, 12 Sep, 06:21
Spark Yarn Java Out Of Memory on Complex Query Execution Plan
nimmi.cv   Spark Yarn Java Out Of Memory on Complex Query Execution Plan Tue, 12 Sep, 06:39
Nimmi Cv   Spark Yarn Java Out Of Memory on Complex Query Execution Plan Tue, 12 Sep, 06:43
Nimmi Cv     Re: Spark Yarn Java Out Of Memory on Complex Query Execution Plan Tue, 12 Sep, 15:23
Re: Spark ignores --master local[*]
Vikash Pareek   Re: Spark ignores --master local[*] Tue, 12 Sep, 11:18
Paras Bansal How to set Map values in spark/scala Tue, 12 Sep, 16:13
How to run "merge into" ACID transaction hive query using hive java api?
Hokam Singh Chauhan   How to run "merge into" ACID transaction hive query using hive java api? Tue, 12 Sep, 16:49
张万新 [SS] Any way to optimize memory consumption of SS? Tue, 12 Sep, 17:11
Michael Armbrust   Re: [SS] Any way to optimize memory consumption of SS? Tue, 12 Sep, 18:22
张万新     Re: [SS] Any way to optimize memory consumption of SS? Wed, 13 Sep, 03:42
Michael Armbrust       Re: [SS] Any way to optimize memory consumption of SS? Thu, 14 Sep, 19:34
张万新         Re: [SS] Any way to optimize memory consumption of SS? Fri, 15 Sep, 01:55
Mikhailau, Alex How do I create a JIRA issue and associate it with a PR that I created for a bug in master? Tue, 12 Sep, 19:02
Gaurav1809 How can I Upgrade Spark 1.6 to 2.x in Cloudera QuickStart VM 5.7 Tue, 12 Sep, 19:19
jeff saremi Continue reading dataframe from file despite errors Tue, 12 Sep, 21:32
jeff saremi   Re: Continue reading dataframe from file despite errors Tue, 12 Sep, 21:33
Suresh Thalamati     Re: Continue reading dataframe from file despite errors Tue, 12 Sep, 21:59
jeff saremi     Re: Continue reading dataframe from file despite errors Tue, 12 Sep, 22:32
peay Configuration for unit testing and sql.shuffle.partitions Tue, 12 Sep, 21:46
Akhil Das   Re: Configuration for unit testing and sql.shuffle.partitions Sat, 16 Sep, 16:26
Femi Anthony     Re: Configuration for unit testing and sql.shuffle.partitions Sat, 16 Sep, 18:54
Vadim Semenov       Re: Configuration for unit testing and sql.shuffle.partitions Mon, 18 Sep, 19:19
jeff saremi Multiple Sources found for csv Tue, 12 Sep, 22:38
jeff saremi   Re: Multiple Sources found for csv Tue, 12 Sep, 22:44
zhan8610189 spark streaming executor number still increase Wed, 13 Sep, 05:30
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 2019117
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137