spark-user mailing list archives: December 2017

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Re: [Spark streaming] No assigned partition error during seek
venkat   Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 01:15
venkat     Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 01:16
Qiao, Richard       Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 10:11
Cody Koeninger         Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 15:54
Re: Writing files to s3 with out temporary directory
Steve Loughran   Re: Writing files to s3 with out temporary directory Fri, 01 Dec, 12:33
Re: Getting Message From Structured Streaming Format Kafka
Daniel de Oliveira Mantovani   Re: Getting Message From Structured Streaming Format Kafka Fri, 01 Dec, 21:52
kant kodali What should LivyUrl be set to when running locally? Fri, 01 Dec, 23:28
kant kodali   Re: What should LivyUrl be set to when running locally? Fri, 01 Dec, 23:40
Re: NLTK with Spark Streaming
ashish rawat   Re: NLTK with Spark Streaming Sat, 02 Dec, 02:45
kant kodali Is Databricks REST API open source ? Sun, 03 Dec, 04:29
Holden Karau   Re: Is Databricks REST API open source ? Sun, 03 Dec, 05:46
kant kodali     Re: Is Databricks REST API open source ? Sun, 03 Dec, 06:03
Recommended way to serialize Hadoop Writables' in Spark
pradeepbaji   Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 05:36
pradeepbaji   Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 18:02
Holden Karau     Re: Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 22:41
☼ R Nair (रविशंकर नायर) Question on using pseudo columns in spark jdbc options Sun, 03 Dec, 06:39
Tomasz Dudek   Re: Question on using pseudo columns in spark jdbc options Thu, 07 Dec, 19:20
☼ R Nair (रविशंकर नायर)     Re: Question on using pseudo columns in spark jdbc options Fri, 08 Dec, 07:17
David Hodefi spark datatypes Sun, 03 Dec, 14:12
Sourav Mazumder Dynamic Resource allocation in Spark Streaming Sun, 03 Dec, 17:31
Qiao, Richard   Re: Dynamic Resource allocation in Spark Streaming Sun, 03 Dec, 17:39
Sourav Mazumder     Re: Dynamic Resource allocation in Spark Streaming Sun, 03 Dec, 17:48
Junfeng Chen Add snappy support for spark in Windows Mon, 04 Dec, 03:30
Qiao, Richard   Re: Add snappy support for spark in Windows Mon, 04 Dec, 08:12
Junfeng Chen     Re: Add snappy support for spark in Windows Mon, 04 Dec, 08:53
Qiao, Richard       Re: Add snappy support for spark in Windows Mon, 04 Dec, 11:07
Junfeng Chen         Re: Add snappy support for spark in Windows Mon, 04 Dec, 14:32
Manuel Sopena Ballesteros learning Spark Mon, 04 Dec, 03:48
Somasundaram Sekar   Re: learning Spark Tue, 05 Dec, 00:38
yohann jardin     Re: learning Spark Tue, 05 Dec, 07:14
Elior Malul       Re: learning Spark Tue, 05 Dec, 07:16
Jean Georges Perrin   Re: learning Spark Tue, 05 Dec, 11:53
makoto   Re: learning Spark Tue, 05 Dec, 22:06
Buffer/cache exhaustion Spark standalone inside a Docker container
Stein Welberg   Buffer/cache exhaustion Spark standalone inside a Docker container Mon, 04 Dec, 07:58
Stein Welberg   Buffer/cache exhaustion Spark standalone inside a Docker container Wed, 06 Dec, 16:34
Re: Programmatically get status of job (WAITING/RUNNING)
bsikander   Re: Programmatically get status of job (WAITING/RUNNING) Mon, 04 Dec, 09:06
Marcelo Vanzin     Re: Programmatically get status of job (WAITING/RUNNING) Tue, 05 Dec, 20:42
bsikander       Re: Programmatically get status of job (WAITING/RUNNING) Tue, 05 Dec, 20:43
Marcelo Vanzin         Re: Programmatically get status of job (WAITING/RUNNING) Tue, 05 Dec, 21:41
bsikander           Re: Programmatically get status of job (WAITING/RUNNING) Thu, 07 Dec, 19:40
Marcelo Vanzin             Re: Programmatically get status of job (WAITING/RUNNING) Thu, 07 Dec, 19:50
bsikander             Re: Programmatically get status of job (WAITING/RUNNING) Thu, 07 Dec, 20:06
Marcelo Vanzin               Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 01:23
Qiao, Richard             Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 02:27
bsikander               Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 08:02
Qiao, Richard     Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 02:05
bsikander       Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 08:16
Re: Access to Applications metrics
Nick Dimiduk   Re: Access to Applications metrics Mon, 04 Dec, 23:53
Qiao, Richard     Re: Access to Applications metrics Tue, 05 Dec, 00:09
Thakrar, Jayesh       Re: Access to Applications metrics Tue, 05 Dec, 21:53
Holden Karau         Re: Access to Applications metrics Wed, 06 Dec, 01:18
163 How to persistent database/table created in sparkSession Tue, 05 Dec, 07:22
Wenchen Fan   Re: How to persistent database/table created in sparkSession Tue, 05 Dec, 13:12
Rahul Raj Support for storing date time fields as TIMESTAMP_MILLIS(INT64) Tue, 05 Dec, 12:17
Dongjoon Hyun Apache Spark 2.3 and Apache ORC 1.4 finally Tue, 05 Dec, 17:47
kant kodali Do I need to do .collect inside forEachRDD Tue, 05 Dec, 20:35
Qiao, Richard   Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:26
kant kodali     Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:38
Qiao, Richard       Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:42
Gerard Maas       Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:54
kant kodali         Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 22:34
Gerard Maas           Re: Do I need to do .collect inside forEachRDD Wed, 06 Dec, 09:43
kant kodali             Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 07:30
Qiao, Richard               Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 10:46
kant kodali                 Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 17:39
Qiao, Richard                   Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 17:45
wenxing zheng How to export the Spark SQL jobs from the HiveThriftServer2 Wed, 06 Dec, 06:08
wenxing zheng   Re: How to export the Spark SQL jobs from the HiveThriftServer2 Wed, 06 Dec, 09:51
Ji Yan Spark job only starts tasks on a single node Wed, 06 Dec, 06:45
Art Rand   Re: Spark job only starts tasks on a single node Wed, 06 Dec, 13:57
Ji Yan     Re: Spark job only starts tasks on a single node Wed, 06 Dec, 19:21
Susan X. Huynh       Re: Spark job only starts tasks on a single node Thu, 07 Dec, 18:18
Art Rand         Re: Spark job only starts tasks on a single node Thu, 07 Dec, 19:34
Ji Yan           Re: Spark job only starts tasks on a single node Fri, 08 Dec, 03:37
Imran Rajjad unable to connect to connect to cluster 2.2.0 Wed, 06 Dec, 07:45
Qiao, Richard   Re: unable to connect to connect to cluster 2.2.0 Wed, 06 Dec, 08:35
Imran Rajjad     Re: unable to connect to connect to cluster 2.2.0 Wed, 06 Dec, 09:57
Filipp Zhinkin [ML] LogisticRegression and dataset's standardization before training Wed, 06 Dec, 10:13
kwunlyou A possible bug? Must call persist to make code run Wed, 06 Dec, 14:58
kant kodali sparkSession.sql("sql query") vs df.sqlContext().sql(this.query) ? Wed, 06 Dec, 18:07
khathiravan raj maadhaven   Re: sparkSession.sql("sql query") vs df.sqlContext().sql(this.query) ? Thu, 07 Dec, 17:50
tj5527 Explode schema name question Wed, 06 Dec, 23:14
satyajit vegesna Json Parsing. Wed, 06 Dec, 23:39
ayan guha   Re: Json Parsing. Thu, 07 Dec, 00:37
ayan guha     Re: Json Parsing. Thu, 07 Dec, 00:37
satyajit vegesna       Re: Json Parsing. Thu, 07 Dec, 04:00
KhajaAsmath Mohammed Spark ListenerBus Thu, 07 Dec, 05:14
Re: LDA and evaluating topic number
Stephen Boesch   Re: LDA and evaluating topic number Thu, 07 Dec, 08:15
Re: How to write dataframe to kafka topic in spark streaming application using pyspark other than collect?
umargeek   Re: How to write dataframe to kafka topic in spark streaming application using pyspark other than collect? Thu, 07 Dec, 18:20
umargeek Streaming Analytics/BI tool to connect Spark SQL Thu, 07 Dec, 18:27
Pierce Lamb   Re: Streaming Analytics/BI tool to connect Spark SQL Thu, 07 Dec, 18:51
Best way of shipping self-contained pyspark jobs with 3rd-party dependencies
Sergey Zhemzhitsky   Best way of shipping self-contained pyspark jobs with 3rd-party dependencies Thu, 07 Dec, 20:46
Sergey Zhemzhitsky   Best way of shipping self-contained pyspark jobs with 3rd-party dependencies Fri, 08 Dec, 13:00
Sandip Mehta Row Encoder For DataSet Fri, 08 Dec, 03:51
Weichen Xu   Re: Row Encoder For DataSet Fri, 08 Dec, 04:59
Sandip Mehta     Re: Row Encoder For DataSet Fri, 08 Dec, 05:19
Georg Heiler       Re: Row Encoder For DataSet Fri, 08 Dec, 07:17
Sandip Mehta         Re: Row Encoder For DataSet Sun, 10 Dec, 10:55
Tomasz Dudek           Re: Row Encoder For DataSet Sun, 10 Dec, 14:24
satyajit vegesna RDD[internalRow] -> DataSet Fri, 08 Dec, 04:25
Jacek Laskowski   Re: RDD[internalRow] -> DataSet Sat, 09 Dec, 11:38
Vadim Semenov   Re: RDD[internalRow] -> DataSet Tue, 12 Dec, 15:55
[Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java
Himasha de Silva   [Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java Fri, 08 Dec, 04:45
Himasha de Silva   [Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java Fri, 08 Dec, 05:11
Afshin, Bardia UDF issues with spark Fri, 08 Dec, 19:54
Daniel Haviv   Re: UDF issues with spark Sun, 10 Dec, 09:10
davideanastasia ML Transformer: create feature that uses multiple columns Sat, 09 Dec, 11:41
Filipp Zhinkin   Re: ML Transformer: create feature that uses multiple columns Sat, 09 Dec, 11:48
davideanastasia     Re: ML Transformer: create feature that uses multiple columns Mon, 11 Dec, 13:36
JDBC to hive batch use case in spark
Hokam Singh Chauhan   JDBC to hive batch use case in spark Sat, 09 Dec, 12:02
张万新     Re: JDBC to hive batch use case in spark Sat, 09 Dec, 13:20
ayan guha       Re: JDBC to hive batch use case in spark Sat, 09 Dec, 14:40
salemi Structured Streaming + Kafka 0.10. connectors + valueDecoder and messageHandler with python Sat, 09 Dec, 18:07
Jules Damji Spark + AI Summit CfP Open Sat, 09 Dec, 21:35
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Dec 201932
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137