spark-user mailing list archives: April 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Re: spark kafka consumer with kerberos
Saisai Shao   Re: spark kafka consumer with kerberos Sat, 01 Apr, 00:58
Richard Tsai [Spark Core]: flatMap/reduceByKey seems to be quite slow with Long keys on some distributions Sat, 01 Apr, 07:29
Selvam Raman Convert Dataframe to Dataset<String> in pyspark Sat, 01 Apr, 12:36
Michael Armbrust   Re: Convert Dataframe to Dataset<String> in pyspark Mon, 03 Apr, 18:55
Deepu Raj Cuesheet - spark deployment Sat, 01 Apr, 12:55
Chintan Bhatt getting error while storing data in Hbase Sat, 01 Apr, 16:47
Paul Tremblay pyspark bug with PYTHONHASHSEED Sat, 01 Apr, 19:43
Paul Tremblay bug with PYTHONHASHSEED Sat, 01 Apr, 19:54
Eike von Seggern   Re: bug with PYTHONHASHSEED Tue, 04 Apr, 14:49
Paul Tremblay     Re: bug with PYTHONHASHSEED Tue, 04 Apr, 16:02
Holden Karau     Re: bug with PYTHONHASHSEED Tue, 04 Apr, 16:03
Jeff Zhang       Re: bug with PYTHONHASHSEED Tue, 04 Apr, 23:42
Paul Tremblay         Re: bug with PYTHONHASHSEED Wed, 05 Apr, 16:40
Jiang Jacky strange behavior of spark 2.1.0 Sat, 01 Apr, 20:14
Timur Shenkao   Re: strange behavior of spark 2.1.0 Sun, 02 Apr, 09:22
Jiang Jacky     Re: strange behavior of spark 2.1.0 Sun, 02 Apr, 12:27
Yogesh Vyas read binary file in PySpark Sun, 02 Apr, 06:46
jasbir.s...@accenture.com Partitioning strategy Sun, 02 Apr, 10:32
Jörn Franke   Re: Partitioning strategy Sun, 02 Apr, 11:18
kant kodali Does Apache Spark use any Dependency Injection framework? Sun, 02 Apr, 13:28
Jacek Laskowski   Re: Does Apache Spark use any Dependency Injection framework? Mon, 03 Apr, 08:41
Selvam Raman Update DF record with delta data in spark Sun, 02 Apr, 13:57
Jörn Franke   Re: Update DF record with delta data in spark Sun, 02 Apr, 15:21
Old-School Represent documents as a sequence of wordID & frequency and perform PCA Sun, 02 Apr, 14:51
Re: Spark SQL 2.1 Complex SQL - Query Planning Issue
Sathish Kumaran Vairavelu   Re: Spark SQL 2.1 Complex SQL - Query Planning Issue Sun, 02 Apr, 15:54
Robert Yokota Graph Analytics on HBase with HGraphDB and Spark GraphFrames Sun, 02 Apr, 16:40
Felix Cheung   Re: Graph Analytics on HBase with HGraphDB and Spark GraphFrames Mon, 03 Apr, 00:19
Irving Duran     Re: Graph Analytics on HBase with HGraphDB and Spark GraphFrames Mon, 03 Apr, 02:08
Weiqing Yang       Re: Graph Analytics on HBase with HGraphDB and Spark GraphFrames Mon, 03 Apr, 06:25
Re: Looking at EMR Logs
Paul Tremblay   Re: Looking at EMR Logs Sun, 02 Apr, 20:05
grjohnson35 org.apache.spark.sql.AnalysisException: resolved attribute(s) code#906 missing from code#1992, Mon, 03 Apr, 02:30
kant kodali What is the difference between forEachAsync vs forEachPartitionAsync? Mon, 03 Apr, 03:36
kant kodali   Re: What is the difference between forEachAsync vs forEachPartitionAsync? Mon, 03 Apr, 03:53
Benchmarking streaming frameworks
gvdongen   Benchmarking streaming frameworks Mon, 03 Apr, 07:34
gvdongen   Benchmarking streaming frameworks Mon, 03 Apr, 07:41
Alonso Isidoro Roman     Re: Benchmarking streaming frameworks Mon, 03 Apr, 09:47
mathewwicks Do we support excluding the current row in PARTITION BY windowing functions? Mon, 03 Apr, 08:52
mathewwicks   Re: Do we support excluding the current row in PARTITION BY windowing functions? Mon, 03 Apr, 09:17
mathewwicks   Re: Do we support excluding the current row in PARTITION BY windowing functions? Mon, 03 Apr, 09:30
Old-School Read file and represent rows as Vectors Mon, 03 Apr, 12:05
Paul Tremblay   Re: Read file and represent rows as Vectors Tue, 04 Apr, 00:18
颜发才(Yan Facai)   Re: Read file and represent rows as Vectors Thu, 06 Apr, 05:36
Rishikesh Teke Executor unable to pick postgres driver in Spark standalone cluster Mon, 03 Apr, 13:43
Sam Elamin   Re: Executor unable to pick postgres driver in Spark standalone cluster Tue, 04 Apr, 08:51
Selvam Raman Pyspark - pickle.PicklingError: Can't pickle Mon, 03 Apr, 18:34
drewrobb _SUCCESS file validation on read Mon, 03 Apr, 20:58
Re: Alternatives for dataframe collectAsList()
Paul Tremblay   Re: Alternatives for dataframe collectAsList() Tue, 04 Apr, 00:44
Eike von Seggern   Re: Alternatives for dataframe collectAsList() Tue, 04 Apr, 14:38
Keith Chapman     Re: Alternatives for dataframe collectAsList() Tue, 04 Apr, 19:12
lucas.g...@gmail.com       Re: Alternatives for dataframe collectAsList() Wed, 05 Apr, 04:55
mathewwicks Do we support excluding the CURRENT ROW in PARTITION BY windowing functions? Tue, 04 Apr, 02:21
Koert Kuipers map transform on array in spark sql Tue, 04 Apr, 03:18
Michael Armbrust   Re: map transform on array in spark sql Tue, 04 Apr, 18:09
kant kodali is there a way to persist the lineages generated by spark? Tue, 04 Apr, 03:19
ayan guha   Re: is there a way to persist the lineages generated by spark? Tue, 04 Apr, 04:41
Gourav Sengupta   Re: is there a way to persist the lineages generated by spark? Fri, 07 Apr, 05:27
Jörn Franke   Re: is there a way to persist the lineages generated by spark? Fri, 07 Apr, 05:30
kant kodali     Re: is there a way to persist the lineages generated by spark? Fri, 07 Apr, 06:08
Koert Kuipers how do i force unit test to do whole stage codegen Tue, 04 Apr, 20:10
Kazuaki Ishizaki   Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 04:07
Koert Kuipers     Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 04:44
Jacek Laskowski     Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 15:15
Koert Kuipers       Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 16:14
Jacek Laskowski         Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 16:44
kant kodali Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 00:17
Tathagata Das   Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 00:34
kant kodali     Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 07:39
kant kodali       Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 14:17
kant kodali         Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 15:49
Gaurav1809 With Twitter4j API, why am I not able to pull tweets with certain keywords? Wed, 05 Apr, 04:02
Ian.Malo...@tdameritrade.com   Re: With Twitter4j API, why am I not able to pull tweets with certain keywords? Wed, 05 Apr, 15:02
satishl spark stages UI page has 'gc time' column Emtpy Wed, 05 Apr, 04:24
Yogesh Vyas reading binary file in spark-kafka streaming Wed, 05 Apr, 06:11
asethia Market Basket Analysis by deploying FP Growth algorithm Wed, 05 Apr, 09:29
Patrick Plaatje   Re: Market Basket Analysis by deploying FP Growth algorithm Wed, 05 Apr, 09:34
Hamza HACHANI convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 09:43
hosur narahari   Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 09:44
Vinay Parekar   Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 16:24
Jiang Jacky     Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 18:10
Vinay Parekar       Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 19:55
Mungeol Heo JSON lib works differently in spark-shell and IDE like intellij Wed, 05 Apr, 09:52
Mungeol Heo   Re: JSON lib works differently in spark-shell and IDE like intellij Thu, 06 Apr, 02:01
Re: How to use ManualClock with Spark streaming
Hemalatha A   Re: How to use ManualClock with Spark streaming Wed, 05 Apr, 10:59
Mendelson, Assaf     RE: How to use ManualClock with Spark streaming Wed, 05 Apr, 18:36
Re: unit testing in spark
Shiva Ramagopal   Re: unit testing in spark Wed, 05 Apr, 11:32
Gokula Krishnan D     Re: unit testing in spark Mon, 10 Apr, 13:46
Jörn Franke       Re: unit testing in spark Mon, 10 Apr, 14:32
Elliot West         Re: unit testing in spark Tue, 11 Apr, 11:14
Steve Loughran     Re: unit testing in spark Tue, 11 Apr, 10:53
Justin Miller Spark Streaming Kafka Job has strange behavior for certain tasks Wed, 05 Apr, 17:03
Nick Chammas Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 19:27
Mark Hamstra   Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 19:54
Mark Hamstra     Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 19:54
Nicholas Chammas       Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 20:11
Mark Hamstra         Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 20:31
Nicholas Chammas           Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 20:41
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Aug 201994
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137