spark-user mailing list archives: November 2017

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Serkan TAS Spark application fail wit numRecords error Wed, 01 Nov, 06:10
cjn Logistic regression in Spark TestCase Wed, 01 Nov, 07:05
Michael Artz Re: Read parquet files as buckets Wed, 01 Nov, 12:41
Yinan Li Announcing Spark on Kubernetes release 0.5.0 Wed, 01 Nov, 16:49
Prem Sure Re: Spark application fail wit numRecords error Wed, 01 Nov, 17:11
Daniel Haviv Writing custom Structured Streaming receiver Wed, 01 Nov, 17:45
Tathagata Das Re: Writing custom Structured Streaming receiver Wed, 01 Nov, 18:27
Jun Shi Fwd: Dose pyspark supports python3.6? Thu, 02 Nov, 02:54
van den Heever, Christian CC RE: Dose pyspark supports python3.6? Thu, 02 Nov, 03:58
makoto Re: Fwd: Dose pyspark supports python3.6? Thu, 02 Nov, 04:11
Serkan TAS RE: Spark application fail wit numRecords error Thu, 02 Nov, 05:27
JG Perrin Spark as ETL, was: Re: Dose pyspark supports python3.6? Thu, 02 Nov, 13:38
JG Perrin Re: share datasets across multiple spark-streaming applications for lookup Thu, 02 Nov, 13:44
Daniel de Oliveira Mantovani Getting Message From Structured Streaming Format Kafka Thu, 02 Nov, 15:36
Burak Yavuz Re: Getting Message From Structured Streaming Format Kafka Thu, 02 Nov, 16:04
Sunita Arvind Change the owner of hdfs file being saved Thu, 02 Nov, 16:35
Sunita Arvind Re: Chaining Spark Streaming Jobs Thu, 02 Nov, 16:54
Jean Georges Perrin Re: How to get the data url Fri, 03 Nov, 10:48
Jean Georges Perrin Re: Hi all, Fri, 03 Nov, 10:48
Jean Georges Perrin Re: Regarding column partitioning IDs and names as per hierarchical level SparkSQL Fri, 03 Nov, 10:48
anudeep pyspark configuration with Juyter Fri, 03 Nov, 11:31
Jeff Zhang Re: pyspark configuration with Juyter Fri, 03 Nov, 11:56
ayan guha Re: Regarding column partitioning IDs and names as per hierarchical level SparkSQL Fri, 03 Nov, 12:19
Imran Rajjad unable to run spark streaming example Fri, 03 Nov, 13:51
小野圭二 Re: How to get the data url Sat, 04 Nov, 01:04
makoto Re: pyspark configuration with Juyter Sat, 04 Nov, 16:59
Marco Mistroni Re: pyspark configuration with Juyter Sat, 04 Nov, 19:35
אורן שמון Re: Hi all, Sat, 04 Nov, 20:19
Gaspar Muñoz spark-avro aliases incompatible Sun, 05 Nov, 09:03
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 12:57
Gourav Sengupta Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 13:11
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 13:27
David Hodeffi RE: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 16:00
Gourav Sengupta Re: spark-avro aliases incompatible Sun, 05 Nov, 19:13
ayan guha Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 21:02
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 21:20
ayan guha Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 21:46
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 21:54
ayan guha Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 22:22
HARSH TAKKAR Building Spark with hive 1.1.0 Mon, 06 Nov, 12:44
Nicolas Paris pySpark driver memory limit Mon, 06 Nov, 18:56
Gaspar Muñoz Re: spark-avro aliases incompatible Mon, 06 Nov, 20:04
paulgureghian A pyspark sql query Mon, 06 Nov, 20:48
Michael Armbrust Re: Structured Stream equivalent of reduceByKey Mon, 06 Nov, 21:24
Gourav Sengupta Re: spark-avro aliases incompatible Mon, 06 Nov, 21:29
Manuel Vonthron Which predicate pushdown work or does not work with Parquet? Tue, 07 Nov, 00:29
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Tue, 07 Nov, 09:48
x x Please remove me! Tue, 07 Nov, 10:03
Davide.Mandrini Re: Programmatically get status of job (WAITING/RUNNING) Tue, 07 Nov, 11:33
HARSH TAKKAR Does Random Forest in spark ML supports multi label classification in scala Tue, 07 Nov, 12:30
Jürgen Albersdorfer How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Tue, 07 Nov, 16:07
Paul Corley Spark REST API Tue, 07 Nov, 17:24
Bryan Jeffrey Stopping a Spark Streaming Context gracefully Tue, 07 Nov, 18:36
Gaspar Muñoz Re: spark-avro aliases incompatible Tue, 07 Nov, 19:23
Dave Moyers Re: Does Random Forest in spark ML supports multi label classification in scala Tue, 07 Nov, 19:51
samar kumar Measure executor idle time Wed, 08 Nov, 09:09
Teemu Heikkilä [Spark Structured Streaming] Changing partitions of (flat)MapGroupsWithState Wed, 08 Nov, 15:34
Michael Armbrust Re: [Spark Structured Streaming] Changing partitions of (flat)MapGroupsWithState Wed, 08 Nov, 15:57
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Wed, 08 Nov, 16:21
Davide.Mandrini Re: Programmatically get status of job (WAITING/RUNNING) Wed, 08 Nov, 18:32
purna pradeep Spark http:<masterip:8080> Not showing completed apps Thu, 09 Nov, 01:33
bing...@iflytek.com spark job paused(active stages finished) Thu, 09 Nov, 03:37
purna pradeep Spark UI not showing completed applications Thu, 09 Nov, 04:13
Margusja Re: spark job paused(active stages finished) Thu, 09 Nov, 06:25
sathy Why the merge method in StructType is private Thu, 09 Nov, 06:31
Nicolas Paris Re: pySpark driver memory limit Thu, 09 Nov, 07:11
HARSH TAKKAR Re: Spark UI not showing completed applications Thu, 09 Nov, 08:06
Sebastian Piu Re: pySpark driver memory limit Thu, 09 Nov, 08:25
David Hodeffi Testing spark e-mail list Thu, 09 Nov, 08:56
yaooqinn Does the builtin hive jars talk of spark to HiveMetaStore(2.1) without any issues? Thu, 09 Nov, 10:10
David Hodefi Spark SQL - Truncate Day / Hour Thu, 09 Nov, 11:05
Marcelo Vanzin Re: Does the builtin hive jars talk of spark to HiveMetaStore(2.1) without any issues? Thu, 09 Nov, 17:41
Gaspar Muñoz Re: Spark SQL - Truncate Day / Hour Thu, 09 Nov, 18:23
kant kodali Can we pass the Calcite streaming sql queries to spark sql? Thu, 09 Nov, 19:50
Tathagata Das Re: Can we pass the Calcite streaming sql queries to spark sql? Thu, 09 Nov, 21:14
KhajaAsmath Mohammed Spark Streaming in Spark 2.1 with Kafka 0.9 Thu, 09 Nov, 22:28
Bahubali Jain Compression during shuffle writes Fri, 10 Nov, 03:54
bing...@iflytek.com Re: Re: spark job paused(active stages finished) Fri, 10 Nov, 05:37
Arnaud Wolf Enable hql on the JDBC thrift server Fri, 10 Nov, 07:08
Arnaud Wolf Re: Enable hql on the JDBC thrift server Fri, 10 Nov, 07:46
wangsan Generate windows on processing time in Spark Structured Streaming Fri, 10 Nov, 09:52
Imran Rajjad spark-stream memory table global? Fri, 10 Nov, 12:56
Frank Staszak Spark Streaming Kafka Fri, 10 Nov, 16:31
Vikas Gandham Parquet files from spark not readable in Cascading Fri, 10 Nov, 17:49
Michael Armbrust Re: Generate windows on processing time in Spark Structured Streaming Fri, 10 Nov, 19:42
Shixiong(Ryan) Zhu Re: spark-stream memory table global? Fri, 10 Nov, 20:37
Gengliang Wang Spark-avro 4.0.0 is released Sat, 11 Nov, 01:23
Evandro Cataruzzo Unsubscribe Sat, 11 Nov, 11:05
ashish rawat Spark based Data Warehouse Sun, 12 Nov, 07:21
Deepak Sharma Re: Spark based Data Warehouse Sun, 12 Nov, 07:32
Jörn Franke Re: Spark based Data Warehouse Sun, 12 Nov, 09:14
Phillip Henry Re: Spark based Data Warehouse Sun, 12 Nov, 09:32
ashish rawat Re: Spark based Data Warehouse Sun, 12 Nov, 17:50
Phillip Henry Re: Spark based Data Warehouse Sun, 12 Nov, 18:19
Gourav Sengupta Re: Spark based Data Warehouse Sun, 12 Nov, 18:47
Vadim Semenov Re: Spark based Data Warehouse Sun, 12 Nov, 21:06
Patrick Alwell Re: Spark based Data Warehouse Sun, 12 Nov, 21:40
Gimantha Bandara Possible "split brain" situation Mon, 13 Nov, 07:09
David Hodefi Re: Spark SQL - Truncate Day / Hour Mon, 13 Nov, 11:27
Eike von Seggern Re: Spark SQL - Truncate Day / Hour Mon, 13 Nov, 14:32
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
May 2019279
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137