spark-user mailing list archives: December 2017

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
venkat Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 01:15
venkat Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 01:16
Qiao, Richard Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 10:11
Steve Loughran Re: Writing files to s3 with out temporary directory Fri, 01 Dec, 12:33
Cody Koeninger Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 15:54
Daniel de Oliveira Mantovani Re: Getting Message From Structured Streaming Format Kafka Fri, 01 Dec, 21:52
kant kodali What should LivyUrl be set to when running locally? Fri, 01 Dec, 23:28
kant kodali Re: What should LivyUrl be set to when running locally? Fri, 01 Dec, 23:40
ashish rawat Re: NLTK with Spark Streaming Sat, 02 Dec, 02:45
kant kodali Is Databricks REST API open source ? Sun, 03 Dec, 04:29
pradeepbaji Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 05:36
Holden Karau Re: Is Databricks REST API open source ? Sun, 03 Dec, 05:46
kant kodali Re: Is Databricks REST API open source ? Sun, 03 Dec, 06:03
☼ R Nair (रविशंकर नायर) Question on using pseudo columns in spark jdbc options Sun, 03 Dec, 06:39
David Hodefi spark datatypes Sun, 03 Dec, 14:12
Sourav Mazumder Dynamic Resource allocation in Spark Streaming Sun, 03 Dec, 17:31
Qiao, Richard Re: Dynamic Resource allocation in Spark Streaming Sun, 03 Dec, 17:39
Sourav Mazumder Re: Dynamic Resource allocation in Spark Streaming Sun, 03 Dec, 17:48
pradeepbaji Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 18:02
Holden Karau Re: Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 22:41
Junfeng Chen Add snappy support for spark in Windows Mon, 04 Dec, 03:30
Manuel Sopena Ballesteros learning Spark Mon, 04 Dec, 03:48
Stein Welberg Buffer/cache exhaustion Spark standalone inside a Docker container Mon, 04 Dec, 07:58
Qiao, Richard Re: Add snappy support for spark in Windows Mon, 04 Dec, 08:12
Junfeng Chen Re: Add snappy support for spark in Windows Mon, 04 Dec, 08:53
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Mon, 04 Dec, 09:06
Qiao, Richard Re: Add snappy support for spark in Windows Mon, 04 Dec, 11:07
Junfeng Chen Re: Add snappy support for spark in Windows Mon, 04 Dec, 14:32
Nick Dimiduk Re: Access to Applications metrics Mon, 04 Dec, 23:53
Qiao, Richard Re: Access to Applications metrics Tue, 05 Dec, 00:09
Somasundaram Sekar Re: learning Spark Tue, 05 Dec, 00:38
yohann jardin Re: learning Spark Tue, 05 Dec, 07:14
Elior Malul Re: learning Spark Tue, 05 Dec, 07:16
163 How to persistent database/table created in sparkSession Tue, 05 Dec, 07:22
Jean Georges Perrin Re: learning Spark Tue, 05 Dec, 11:53
Rahul Raj Support for storing date time fields as TIMESTAMP_MILLIS(INT64) Tue, 05 Dec, 12:17
Wenchen Fan Re: How to persistent database/table created in sparkSession Tue, 05 Dec, 13:12
Dongjoon Hyun Apache Spark 2.3 and Apache ORC 1.4 finally Tue, 05 Dec, 17:47
kant kodali Do I need to do .collect inside forEachRDD Tue, 05 Dec, 20:35
Marcelo Vanzin Re: Programmatically get status of job (WAITING/RUNNING) Tue, 05 Dec, 20:42
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Tue, 05 Dec, 20:43
Qiao, Richard Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:26
kant kodali Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:38
Marcelo Vanzin Re: Programmatically get status of job (WAITING/RUNNING) Tue, 05 Dec, 21:41
Qiao, Richard Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:42
Thakrar, Jayesh Re: Access to Applications metrics Tue, 05 Dec, 21:53
Gerard Maas Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:54
makoto Re: learning Spark Tue, 05 Dec, 22:06
kant kodali Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 22:34
Holden Karau Re: Access to Applications metrics Wed, 06 Dec, 01:18
wenxing zheng How to export the Spark SQL jobs from the HiveThriftServer2 Wed, 06 Dec, 06:08
Ji Yan Spark job only starts tasks on a single node Wed, 06 Dec, 06:45
Imran Rajjad unable to connect to connect to cluster 2.2.0 Wed, 06 Dec, 07:45
Qiao, Richard Re: unable to connect to connect to cluster 2.2.0 Wed, 06 Dec, 08:35
Gerard Maas Re: Do I need to do .collect inside forEachRDD Wed, 06 Dec, 09:43
wenxing zheng Re: How to export the Spark SQL jobs from the HiveThriftServer2 Wed, 06 Dec, 09:51
Imran Rajjad Re: unable to connect to connect to cluster 2.2.0 Wed, 06 Dec, 09:57
Filipp Zhinkin [ML] LogisticRegression and dataset's standardization before training Wed, 06 Dec, 10:13
Art Rand Re: Spark job only starts tasks on a single node Wed, 06 Dec, 13:57
kwunlyou A possible bug? Must call persist to make code run Wed, 06 Dec, 14:58
Stein Welberg Buffer/cache exhaustion Spark standalone inside a Docker container Wed, 06 Dec, 16:34
kant kodali sparkSession.sql("sql query") vs df.sqlContext().sql(this.query) ? Wed, 06 Dec, 18:07
Ji Yan Re: Spark job only starts tasks on a single node Wed, 06 Dec, 19:21
tj5527 Explode schema name question Wed, 06 Dec, 23:14
satyajit vegesna Json Parsing. Wed, 06 Dec, 23:39
ayan guha Re: Json Parsing. Thu, 07 Dec, 00:37
ayan guha Re: Json Parsing. Thu, 07 Dec, 00:37
satyajit vegesna Re: Json Parsing. Thu, 07 Dec, 04:00
KhajaAsmath Mohammed Spark ListenerBus Thu, 07 Dec, 05:14
kant kodali Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 07:30
Stephen Boesch Re: LDA and evaluating topic number Thu, 07 Dec, 08:15
Qiao, Richard Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 10:46
kant kodali Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 17:39
Qiao, Richard Re: Do I need to do .collect inside forEachRDD Thu, 07 Dec, 17:45
khathiravan raj maadhaven Re: sparkSession.sql("sql query") vs df.sqlContext().sql(this.query) ? Thu, 07 Dec, 17:50
Susan X. Huynh Re: Spark job only starts tasks on a single node Thu, 07 Dec, 18:18
umargeek Re: How to write dataframe to kafka topic in spark streaming application using pyspark other than collect? Thu, 07 Dec, 18:20
umargeek Streaming Analytics/BI tool to connect Spark SQL Thu, 07 Dec, 18:27
Pierce Lamb Re: Streaming Analytics/BI tool to connect Spark SQL Thu, 07 Dec, 18:51
Tomasz Dudek Re: Question on using pseudo columns in spark jdbc options Thu, 07 Dec, 19:20
Art Rand Re: Spark job only starts tasks on a single node Thu, 07 Dec, 19:34
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Thu, 07 Dec, 19:40
Marcelo Vanzin Re: Programmatically get status of job (WAITING/RUNNING) Thu, 07 Dec, 19:50
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Thu, 07 Dec, 20:06
Sergey Zhemzhitsky Best way of shipping self-contained pyspark jobs with 3rd-party dependencies Thu, 07 Dec, 20:46
Marcelo Vanzin Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 01:23
Qiao, Richard Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 02:05
Qiao, Richard Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 02:27
Ji Yan Re: Spark job only starts tasks on a single node Fri, 08 Dec, 03:37
Sandip Mehta Row Encoder For DataSet Fri, 08 Dec, 03:51
satyajit vegesna RDD[internalRow] -> DataSet Fri, 08 Dec, 04:25
Himasha de Silva [Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java Fri, 08 Dec, 04:45
Weichen Xu Re: Row Encoder For DataSet Fri, 08 Dec, 04:59
Himasha de Silva [Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java Fri, 08 Dec, 05:11
Sandip Mehta Re: Row Encoder For DataSet Fri, 08 Dec, 05:19
☼ R Nair (रविशंकर नायर) Re: Question on using pseudo columns in spark jdbc options Fri, 08 Dec, 07:17
Georg Heiler Re: Row Encoder For DataSet Fri, 08 Dec, 07:17
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 08:02
bsikander Re: Programmatically get status of job (WAITING/RUNNING) Fri, 08 Dec, 08:16
Sergey Zhemzhitsky Best way of shipping self-contained pyspark jobs with 3rd-party dependencies Fri, 08 Dec, 13:00
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019267
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137