spark-user mailing list archives: September 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Leonard Cohen Re: Scala Vs Python Tue, 06 Sep, 10:38
Sea How to specify file Fri, 23 Sep, 06:56
Сергей Романов Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Thu, 01 Sep, 15:55
Сергей Романов Re[2]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Fri, 02 Sep, 11:03
Сергей Романов Re[4]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 11:54
Сергей Романов Re[5]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 12:40
Сергей Романов Re[6]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 12:50
Сергей Романов Re[7]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Sat, 03 Sep, 13:04
Сергей Романов Re[8]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Mon, 05 Sep, 11:21
Сергей Романов Re[10]: Spark 2.0: SQL runs 5x times slower when adding 29th field to aggregation. Wed, 07 Sep, 09:33
شجاع الرحمن بیگ CPU Consumption of spark process Wed, 14 Sep, 19:11
刘虓 Re: Why does spark take so much time for simple task without calculation? Mon, 05 Sep, 02:38
刘虓 Re: Scala Vs Python Tue, 06 Sep, 10:48
李剑 Spark yarn use IP instead hostname Thu, 08 Sep, 10:26
时金魁 Re:Scala Vs Python Thu, 01 Sep, 02:26
毅程 Re: spark streaming kafka connector questions Sat, 10 Sep, 07:37
毅程 Re: spark streaming kafka connector questions Fri, 16 Sep, 23:35
박경희 RE: how to specify cores and executor to run spark jobs simultaneously Wed, 14 Sep, 15:09
颜发才(Yan Facai) Dataframe, Java: How to convert String to Vector ? Tue, 06 Sep, 06:56
颜发才(Yan Facai) How to convert String to Vector ? Tue, 06 Sep, 09:56
颜发才(Yan Facai) Re: Dataframe, Java: How to convert String to Vector ? Wed, 07 Sep, 06:39
颜发才(Yan Facai) Re: Dataframe, Java: How to convert String to Vector ? Thu, 08 Sep, 08:23
颜发才(Yan Facai) Re: Does it run distributed if class not Serializable Sat, 10 Sep, 10:49
颜发才(Yan Facai) study materials for operators on Dataframe Mon, 19 Sep, 02:41
颜发才(Yan Facai) Re: Dataframe, Java: How to convert String to Vector ? Mon, 19 Sep, 08:29
颜发才(Yan Facai) Re: Dataframe, Java: How to convert String to Vector ? Wed, 21 Sep, 08:32
齐忠 java.io.IOException: FAILED_TO_UNCOMPRESS(5) Sat, 10 Sep, 14:08
김태준 Is Spark ML model possible continues learning Fri, 02 Sep, 03:44
Jörn Franke Re: Off Heap (Tungsten) Memory Usage / Management ? Thu, 22 Sep, 17:42
Jörn Franke Re: Off Heap (Tungsten) Memory Usage / Management ? Thu, 22 Sep, 17:46
Shashikant Kulkarni (शशिकांत कुलकर्णी) Re: Apache Spark JavaRDD pipe() need help Thu, 22 Sep, 09:10
Shashikant Kulkarni (शशिकांत कुलकर्णी) Re: Apache Spark JavaRDD pipe() need help Fri, 23 Sep, 10:35
Christophe Préaud Re: Partition n keys into exacly n partitions Tue, 13 Sep, 07:48
Maciej Bryński Re: Difference between Data set and Data Frame in Spark 2 Thu, 01 Sep, 18:11
Piotr Smoliński Re: Writing Dataframe to CSV yields blank file called "_SUCCESS" Mon, 26 Sep, 05:44
Piotr Smoliński Re: Writing Dataframe to CSV yields blank file called "_SUCCESS" Mon, 26 Sep, 13:35
Piotr Smoliński Re: Is Spark 2.0 master node compatible with Spark 1.5 work node? Mon, 26 Sep, 18:00
Yusuf Can Gürkan Does it run distributed if class not Serializable Fri, 09 Sep, 10:47
Leonard Cohen Re: How to convert String to Vector ? Tue, 06 Sep, 10:09
Sea 回复: How to specify file Fri, 23 Sep, 07:26
ChangMingMin(常明敏) unsubscribe Tue, 13 Sep, 03:38
hxw黄祥为 why spark ml package doesn't contain svm algorithm Tue, 27 Sep, 07:09
muhammet pakyürek clear steps for installation of spark, cassandra and cassandra connector to run on spyder 2.3.7 using python 3.5 and anaconda 2.4 ipython 4.0 Tue, 06 Sep, 10:34
muhammet pakyürek Failed to open native connection to Cassandra at Wed, 07 Sep, 13:50
muhammet pakyürek cassandra can not accessed via pyspark or spark-shell but it is accessible using cqlsh. what is the problem. Mon, 19 Sep, 06:01
muhammet pakyürek true conf for sparkconf().set().setMaster() to connect to cassandra Mon, 19 Sep, 06:56
muhammet pakyürek cassandra 3.7 is compatible with datastax Spark Cassandra Connector 2.0? Mon, 19 Sep, 07:37
muhammet pakyürek best versions for cassandra spark connection Mon, 19 Sep, 08:11
muhammet pakyürek cassandra.yaml configuration for cassandra spark connection Mon, 19 Sep, 11:48
muhammet pakyürek is there any bug for the configuration of spark 2.0 cassandra spark connector 2.0 and cassandra 3.0.8 Tue, 20 Sep, 05:47
muhammet pakyürek cassandra and spark can be built and worked on the same computer? Tue, 20 Sep, 06:08
muhammet pakyürek unresolved dependency: datastax#spark-cassandra-connector;2.0.0-s_2.11-M3-20-g75719df: not found Wed, 21 Sep, 08:38
muhammet pakyürek ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up. Fri, 23 Sep, 12:07
muhammet pakyürek how to find NaN values of each row of spark dataframe to decide whether the rows is dropeed or not Mon, 26 Sep, 07:30
muhammet pakyürek how to decide which part of process use spark dataframe and pandas dataframe? Mon, 26 Sep, 08:08
张建鑫(市场部) Re: LabeledPoint creation Thu, 08 Sep, 12:05
Jörn Franke Re: Efficiently write a Dataframe to Text file(Spark Version 1.6.1) Wed, 14 Sep, 12:24
Jörn Franke Re: Efficiently write a Dataframe to Text file(Spark Version 1.6.1) Wed, 14 Sep, 14:16
Jörn Franke Re: Reading the most recent text files created by Spark streaming Wed, 14 Sep, 17:36
Jörn Franke Re: Streaming - lookup against reference data Wed, 14 Sep, 21:09
Jörn Franke Re: Spark Streaming-- for each new file in HDFS Thu, 15 Sep, 17:31
Jörn Franke Re: Is there such thing as cache fusion with the underlying tables/files on HDFS Sun, 18 Sep, 06:37
Jörn Franke Re: Is there such thing as cache fusion with the underlying tables/files on HDFS Sun, 18 Sep, 10:08
Jörn Franke Re: filling missing values in a sequence Mon, 19 Sep, 05:42
Jörn Franke Re: SPARK PERFORMANCE TUNING Wed, 21 Sep, 12:14
Jörn Franke Re: Sqoop vs spark jdbc Wed, 21 Sep, 20:47
Jörn Franke Re: Off Heap (Tungsten) Memory Usage / Management ? Wed, 21 Sep, 22:41
Jörn Franke Re: Memory usage by Spark jobs Thu, 22 Sep, 08:13
Jörn Franke Re: Redshift Vs Spark SQL (Thrift) Fri, 23 Sep, 06:18
Jörn Franke Re: ideas on de duplication for spark streaming? Sat, 24 Sep, 16:50
Jörn Franke Re: How to use Spark-Scala to download a CSV file from the web? Sun, 25 Sep, 09:14
ABHISHEK Spark Yarn Cluster with Reference File Fri, 23 Sep, 07:33
ABHISHEK Re: Spark Yarn Cluster with Reference File Fri, 23 Sep, 13:59
ABHISHEK Re: Spark Yarn Cluster with Reference File Fri, 23 Sep, 14:19
ABHISHEK Restful WS for Spark Fri, 30 Sep, 18:07
AJT Dataframe Grouping - Sorting - Mapping Fri, 30 Sep, 10:46
ANDREA SPINA java.lang.OutOfMemoryError Spark MLlib ALS matrix factorization Thu, 01 Sep, 09:49
ANDREA SPINA Managing Dataset API Partitions - Spark 2.0 Wed, 07 Sep, 15:04
Aakash Basu Fwd: Need some help Thu, 01 Sep, 19:42
Aakash Basu Re: Fwd: Need some help Thu, 01 Sep, 20:05
Aakash Basu Re: Fwd: Need some help Fri, 02 Sep, 08:24
Aaron Jackson Left Join Yields Results And Not Results Sun, 25 Sep, 06:46
Abhishek Anand Finding unique across all columns in dataset Mon, 19 Sep, 09:05
Abhishek Anand Re: Finding unique across all columns in dataset Mon, 19 Sep, 10:36
Adam Roberts Re: Spark 2.0.0 - Java vs Scala performance difference Thu, 01 Sep, 13:24
Adam Roberts Re: Hi, guys, does anyone use Spark in finance market? Thu, 01 Sep, 14:25
Aditya Spark RDD and Memory Thu, 22 Sep, 14:54
Aditya Re: Spark RDD and Memory Fri, 23 Sep, 04:53
Aditya Re: Spark RDD and Memory Fri, 23 Sep, 06:54
Aditya Re: How to specify file Fri, 23 Sep, 07:14
Aditya Re: Spark Yarn Cluster with Reference File Fri, 23 Sep, 07:43
Aditya Re: Spark Yarn Cluster with Reference File Fri, 23 Sep, 14:06
Aditya Spark Executor Lost issue Wed, 28 Sep, 06:47
Aditya Re: Spark Executor Lost issue Wed, 28 Sep, 07:08
Aditya Re: Spark Executor Lost issue Wed, 28 Sep, 14:00
Adline Dsilva RE: Window Functions with SQLContext Thu, 01 Sep, 05:34
Adline Dsilva RE: Anyone got a good solid example of integrating Spark and Solr Wed, 14 Sep, 15:00
Adrian Bridgett very high maxresults setting (no collect()) Mon, 19 Sep, 21:05
Adrian Bridgett Re: very high maxresults setting (no collect()) Thu, 22 Sep, 07:53
Adrian Bridgett Re: Issue with rogue data in csv file used in Spark application Tue, 27 Sep, 21:53
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Oct 201979
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137