spark-user mailing list archives: April 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
nayan sharma filter operation using isin Mon, 17 Apr, 14:42
Vishnu Viswanath Handling skewed data Mon, 17 Apr, 15:17
Richard Siebeling   Re: Handling skewed data Wed, 19 Apr, 19:03
Justin Pihony Is there a way to tell if a receiver is a Reliable Receiver? Mon, 17 Apr, 19:34
Charles O. Bajomo   Re: Is there a way to tell if a receiver is a Reliable Receiver? Mon, 17 Apr, 20:08
Mohammad Tariq Application not found in RM Tue, 18 Apr, 00:41
Vivek Mishra Running 100 GB at standalone node Tue, 18 Apr, 09:10
o_rayer In an executor, are the Python worker memory and the MemoryOverhead overlapping? Tue, 18 Apr, 15:01
VHPC 17 CfP - VHPC at ISC extension - Papers due May 2 Tue, 18 Apr, 17:36
Erik Erlandson An Apache Spark metric sink for Kafka Tue, 18 Apr, 19:40
gae123 Spark 2.1.0 hanging while writing a table in HDFS in parquet format Tue, 18 Apr, 21:26
Dmitry Goldenberg How to fix error "Failed to get records for..." after polling for 120000 Tue, 18 Apr, 22:22
kant kodali Questions on HDFS with Spark Tue, 18 Apr, 23:07
issues solution java.lang.java.lang.UnsupportedOperationException Wed, 19 Apr, 11:42
issues solution   Re: java.lang.java.lang.UnsupportedOperationException Wed, 19 Apr, 12:13
Nicholas Hakobian     Re: java.lang.java.lang.UnsupportedOperationException Wed, 19 Apr, 19:24
Siddharth Ubale Real time incremental Update to Spark Graphs. Wed, 19 Apr, 12:09
kant kodali Problem with Java and Scala interoperability // streaming Wed, 19 Apr, 20:42
Marcelo Vanzin   Re: Problem with Java and Scala interoperability // streaming Wed, 19 Apr, 20:46
kant kodali     Re: Problem with Java and Scala interoperability // streaming Wed, 19 Apr, 20:51
Marcelo Vanzin       Re: Problem with Java and Scala interoperability // streaming Wed, 19 Apr, 20:56
kant kodali         Re: Problem with Java and Scala interoperability // streaming Wed, 19 Apr, 21:05
kant kodali           Re: Problem with Java and Scala interoperability // streaming Wed, 19 Apr, 21:08
Cinyoung Hur JDBC write error of Pyspark dataframe Thu, 20 Apr, 01:42
Vivek Mishra checkpoint on spark standalone Thu, 20 Apr, 07:28
Rick Moritz Concurrent DataFrame.saveAsTable into non-existant tables fails the second job despite Mode.APPEND Thu, 20 Apr, 07:48
Subhash Sriram   Re: Concurrent DataFrame.saveAsTable into non-existant tables fails the second job despite Mode.APPEND Thu, 20 Apr, 21:54
Radhwane Chebaane [sparkR] [MLlib] : Is word2vec implemented in SparkR MLlib ? Thu, 20 Apr, 11:30
Felix Cheung   Re: [sparkR] [MLlib] : Is word2vec implemented in SparkR MLlib ? Fri, 21 Apr, 18:36
Maximum Partitioner size
Patrick GRANDJEAN   Maximum Partitioner size Thu, 20 Apr, 14:57
Re: Any Idea about this error : IllegalArgumentException: File segment length cannot be negative ?
Victor Tso-Guillen   Re: Any Idea about this error : IllegalArgumentException: File segment length cannot be negative ? Thu, 20 Apr, 15:51
Hemanth Gudela Spark structured streaming: Is it possible to periodically refresh static data frame? Thu, 20 Apr, 20:08
Georg Heiler   Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Thu, 20 Apr, 20:11
Hemanth Gudela     Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Thu, 20 Apr, 20:30
Tathagata Das       Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Thu, 20 Apr, 21:03
Hemanth Gudela         Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Fri, 21 Apr, 03:58
Georg Heiler           Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Fri, 21 Apr, 04:21
Hemanth Gudela         Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Fri, 21 Apr, 14:47
Georg Heiler           Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Fri, 21 Apr, 15:22
Gene Pang             Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Fri, 21 Apr, 21:30
Hemanth Gudela               Re: Spark structured streaming: Is it possible to periodically refresh static data frame? Sat, 22 Apr, 07:15
Pradeep Gollakota Long Shuffle Read Blocked Time Thu, 20 Apr, 22:12
Pradeep Gollakota   Re: Long Shuffle Read Blocked Time Fri, 21 Apr, 00:39
Siddhartha Sahu Please participate in a research survey on graphs Fri, 21 Apr, 00:58
Cinyoung Hur pyspark.sql.DataFrame write error to Postgres DB Fri, 21 Apr, 02:54
Takeshi Yamamuro   Re: pyspark.sql.DataFrame write error to Postgres DB Fri, 21 Apr, 03:51
Cinyoung Hur     Re: pyspark.sql.DataFrame write error to Postgres DB Fri, 21 Apr, 05:26
Azure Event Hub with Pyspark
ayan guha   Azure Event Hub with Pyspark Fri, 21 Apr, 03:49
Ashish Singh   Re: Azure Event Hub with Pyspark Fri, 21 Apr, 04:02
ayan guha     Re: Azure Event Hub with Pyspark Fri, 21 Apr, 04:24
Nan Zhu       Re: Azure Event Hub with Pyspark Fri, 21 Apr, 04:46
Denny Lee         Re: Azure Event Hub with Pyspark Fri, 21 Apr, 05:13
ayan guha           Re: Azure Event Hub with Pyspark Fri, 21 Apr, 07:22
Paul Tremblay splitting a huge file Fri, 21 Apr, 18:36
Jörn Franke   Re: splitting a huge file Fri, 21 Apr, 18:39
Roger Marin   Re: splitting a huge file Sat, 22 Apr, 04:56
Steve Loughran   Re: splitting a huge file Mon, 24 Apr, 10:26
Chawla,Sumit What is correct behavior for spark.task.maxFailures? Fri, 21 Apr, 20:32
Dongjin Lee   Re: What is correct behavior for spark.task.maxFailures? Mon, 24 Apr, 15:02
Ryan Blue   Re: What is correct behavior for spark.task.maxFailures? Mon, 24 Apr, 16:41
Ryan Blue     Re: What is correct behavior for spark.task.maxFailures? Mon, 24 Apr, 16:48
Chawla,Sumit       Re: What is correct behavior for spark.task.maxFailures? Tue, 25 Apr, 02:31
Afshin, Bardia question regarding pyspark Fri, 21 Apr, 23:37
Pushkar.Gujar   Re: question regarding pyspark Sat, 22 Apr, 00:32
Matthew Purdy how to get variable type signature through the api Sat, 22 Apr, 05:20
Hemanth Gudela Spark SQL - Global Temporary View is not behaving as expected Sat, 22 Apr, 07:56
Felix Cheung   Re: Spark SQL - Global Temporary View is not behaving as expected Sat, 22 Apr, 08:05
Hemanth Gudela     Re: Spark SQL - Global Temporary View is not behaving as expected Sat, 22 Apr, 08:24
vincent gromakowski       Re: Spark SQL - Global Temporary View is not behaving as expected Sat, 22 Apr, 09:14
Gene Pang         Re: Spark SQL - Global Temporary View is not behaving as expected Mon, 24 Apr, 13:41
Hemanth Gudela           Re: Spark SQL - Global Temporary View is not behaving as expected Mon, 24 Apr, 14:01
vincent gromakowski             Re: Spark SQL - Global Temporary View is not behaving as expected Mon, 24 Apr, 14:16
geoHeil Off heap memory settings and Tungsten Sat, 22 Apr, 11:44
Saisai Shao   Re: Off heap memory settings and Tungsten Mon, 24 Apr, 09:40
s t heap overflow within seconds : pyspark kinesis stream with Spark 2.1.0 Sat, 22 Apr, 20:20
Chen, Mingrui Cannot convert from JavaRDD to Dataframe Sun, 23 Apr, 16:13
Radhwane Chebaane   Re: Cannot convert from JavaRDD to Dataframe Mon, 24 Apr, 10:05
kant kodali How to convert Dstream of JsonObject to Dataframe in spark 2.1.0? Sun, 23 Apr, 17:50
Sam Elamin   Re: How to convert Dstream of JsonObject to Dataframe in spark 2.1.0? Mon, 24 Apr, 08:50
kant kodali     Re: How to convert Dstream of JsonObject to Dataframe in spark 2.1.0? Mon, 24 Apr, 20:02
Richard Hanson Questions related to writing data to S3 Sun, 23 Apr, 18:49
Steve Loughran   Re: Questions related to writing data to S3 Mon, 24 Apr, 10:34
Bulldog20630405 accessing type signature Mon, 24 Apr, 00:35
vincent gromakowski Authorizations in thriftserver Mon, 24 Apr, 07:32
vincent gromakowski   Re: Authorizations in thriftserver Tue, 25 Apr, 12:51
Selvam Raman Spark Mlib - java.lang.OutOfMemoryError: Java heap space Mon, 24 Apr, 10:22
Selvam Raman   Re: Spark Mlib - java.lang.OutOfMemoryError: Java heap space Mon, 24 Apr, 10:31
Pavel Plotnikov Spark diclines mesos offers Mon, 24 Apr, 11:53
Michael Gummelt   Re: Spark diclines mesos offers Mon, 24 Apr, 18:30
Pavel Plotnikov     Re: Spark diclines mesos offers Wed, 26 Apr, 11:53
Hemanth Gudela Spark registered view in "Future" - View changes updated in "Future" are lost in main thread Mon, 24 Apr, 12:29
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Oct 2020168
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137