spark-user mailing list archives: November 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Finding a Spark Equivalent for Pandas' get_dummies
Nicholas Sharkey   Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 18:27
nsharkey   Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 18:32
Nick Pentreath     Re: Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 19:00
Nicholas Sharkey       Re: Finding a Spark Equivalent for Pandas' get_dummies Fri, 11 Nov, 21:21
neil90     Re: Finding a Spark Equivalent for Pandas' get_dummies Tue, 15 Nov, 16:55
appHandle.kill(), SparkSubmit Process, JVM questions related to SparkLauncher design and Spark Driver
Elkhan Dadashov   appHandle.kill(), SparkSubmit Process, JVM questions related to SparkLauncher design and Spark Driver Fri, 11 Nov, 22:49
SamPenrose pyspark: accept unicode column names in DataFrame.corr and cov Sat, 12 Nov, 00:36
Hyukjin Kwon   Re: pyspark: accept unicode column names in DataFrame.corr and cov Sat, 12 Nov, 11:43
Elkhan Dadashov SparkDriver memory calculation mismatch Sat, 12 Nov, 02:18
Sean Owen   Re: SparkDriver memory calculation mismatch Sat, 12 Nov, 08:24
Elkhan Dadashov     Re: SparkDriver memory calculation mismatch Sat, 12 Nov, 09:13
Sean Owen       Re: SparkDriver memory calculation mismatch Sat, 12 Nov, 09:40
Elkhan Dadashov         Re: SparkDriver memory calculation mismatch Sat, 12 Nov, 09:59
Elkhan Dadashov Exception not failing Python applications (in yarn client mode) - SparkLauncher says app succeeded, where app actually has failed Sat, 12 Nov, 03:32
ayan guha   Re: Exception not failing Python applications (in yarn client mode) - SparkLauncher says app succeeded, where app actually has failed Sat, 12 Nov, 11:00
Rohit Verma Spark joins using row id Sat, 12 Nov, 11:11
Rohit Verma   Re: Spark joins using row id Sat, 12 Nov, 13:54
颜发才(Yan Facai)   Re: Spark joins using row id Sun, 13 Nov, 10:51
dev loper Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 12:36
Cody Koeninger   Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 16:25
dev loper     Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 16:29
Cody Koeninger       Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 21:28
ayan guha         Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sat, 12 Nov, 23:52
dev loper           Re: Spark Streaming- ReduceByKey not removing Duplicates for the same key in a Batch Sun, 13 Nov, 03:16
Anirudh Perugu toDebugString is clipped Sun, 13 Nov, 01:56
Sean Owen   Re: toDebugString is clipped Sun, 13 Nov, 12:50
Kelum Perera spark-shell not starting ( in a Kali linux 2 OS) Sun, 13 Nov, 04:50
Sean Owen   Re: spark-shell not starting ( in a Kali linux 2 OS) Sun, 13 Nov, 08:41
Kelum Perera   Re: spark-shell not starting ( in a Kali linux 2 OS) Sun, 13 Nov, 10:44
Marco Mistroni     Re: spark-shell not starting ( in a Kali linux 2 OS) Sun, 13 Nov, 12:01
Kelum Perera       Re: spark-shell not starting ( in a Kali linux 2 OS) Sun, 13 Nov, 12:18
Re: Spark stalling during shuffle (maybe a memory issue)
bogdanbaraila   Re: Spark stalling during shuffle (maybe a memory issue) Sun, 13 Nov, 09:54
Meeraj Kunnumpurath Nearest neighbour search Sun, 13 Nov, 15:04
Meeraj Kunnumpurath   Re: Nearest neighbour search Sun, 13 Nov, 18:56
Meeraj Kunnumpurath     Re: Nearest neighbour search Sun, 13 Nov, 20:07
Kevin Mellott       Re: Nearest neighbour search Mon, 14 Nov, 15:12
Nick Pentreath         Re: Nearest neighbour search Mon, 14 Nov, 15:37
rakesh sharma Spark SQL shell hangs Sun, 13 Nov, 15:20
Hyukjin Kwon   Re: Spark SQL shell hangs Mon, 14 Nov, 01:18
Luciano Resende [ANNOUNCE] Apache SystemML 0.11.0-incubating released Sun, 13 Nov, 18:28
Shushant Arora receiver based spark streaming doubts Sun, 13 Nov, 19:04
Marco Mistroni sbt shenanigans for a Spark-based project Sun, 13 Nov, 21:01
Don Drake   Re: sbt shenanigans for a Spark-based project Sun, 13 Nov, 22:52
Marco Mistroni     Re: sbt shenanigans for a Spark-based project Mon, 14 Nov, 21:11
Don Drake       Re: sbt shenanigans for a Spark-based project Mon, 14 Nov, 23:13
Marco Mistroni         Re: sbt shenanigans for a Spark-based project Tue, 15 Nov, 22:45
Re: Spark ML : One hot Encoding for multiple columns
janardhan shetty   Re: Spark ML : One hot Encoding for multiple columns Mon, 14 Nov, 00:55
Nicholas Sharkey     Re: Spark ML : One hot Encoding for multiple columns Mon, 14 Nov, 01:00
janardhan shetty Convert SparseVector column to Densevector column Mon, 14 Nov, 04:20
Takeshi Yamamuro   Re: Convert SparseVector column to Densevector column Mon, 14 Nov, 05:34
janardhan shetty     Re: Convert SparseVector column to Densevector column Mon, 14 Nov, 18:00
ruan.answer handle data skew problem when calculating word count and word dependency Mon, 14 Nov, 07:26
Prithish AVRO File size when caching in-memory Mon, 14 Nov, 09:05
Jörn Franke   Re: AVRO File size when caching in-memory Mon, 14 Nov, 09:36
Prithish     Re: AVRO File size when caching in-memory Tue, 15 Nov, 05:15
Prithish       Re: AVRO File size when caching in-memory Wed, 16 Nov, 04:44
Shreya Agarwal         RE: AVRO File size when caching in-memory Wed, 16 Nov, 07:48
Prithish           Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:26
Takeshi Yamamuro             Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:38
Prithish               Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:47
Shreya Agarwal               RE: AVRO File size when caching in-memory Wed, 16 Nov, 16:29
Mohamed Nadjib Mami SparkSQL: intra-SparkSQL-application table registration Mon, 14 Nov, 10:03
Yu Wei Two questions about running spark on mesos Mon, 14 Nov, 11:10
Michael Gummelt   Re: Two questions about running spark on mesos Mon, 14 Nov, 18:40
Rohit Verma Spark hash function Mon, 14 Nov, 11:21
Andrés Ivaldi Grouping Set Mon, 14 Nov, 15:20
ayan guha   Re: Grouping Set Mon, 14 Nov, 20:48
ayan guha     Re: Grouping Set Mon, 14 Nov, 20:49
Andrés Ivaldi       Re: Grouping Set Thu, 17 Nov, 17:05
Re: took more time to get data from spark dataset to driver program
Rishikesh Teke   Re: took more time to get data from spark dataset to driver program Mon, 14 Nov, 16:27
Arijit Spark streaming data loss due to timeout in writing BlockAdditionEvent to WAL by the driver Mon, 14 Nov, 18:24
Bhaarat Sharma scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 18:30
Nick Pentreath   Re: scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 18:44
Bhaarat Sharma     Re: scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 19:02
Nick Pentreath       Re: scala.MatchError while doing BinaryClassificationMetrics Mon, 14 Nov, 21:00
Bhaarat Sharma         Re: scala.MatchError while doing BinaryClassificationMetrics Tue, 15 Nov, 13:25
jggg777 Pasting oddity with Spark 2.0 (scala) Mon, 14 Nov, 20:09
jtgenesis Cannot find Native Library in "cluster" deploy-mode Mon, 14 Nov, 21:41
Mo Tao   Re: Cannot find Native Library in "cluster" deploy-mode Tue, 15 Nov, 05:26
jtgenesis     Re: Cannot find Native Library in "cluster" deploy-mode Tue, 15 Nov, 17:03
jtgenesis     Re: Cannot find Native Library in "cluster" deploy-mode Tue, 15 Nov, 20:04
Nirav Patel Spark SQL UDF - passing map as a UDF parameter Tue, 15 Nov, 00:33
Takeshi Yamamuro   Re: Spark SQL UDF - passing map as a UDF parameter Tue, 15 Nov, 08:38
Nirav Patel     Re: Spark SQL UDF - passing map as a UDF parameter Tue, 15 Nov, 19:29
Reynold Xin [ANNOUNCE] Apache Spark 2.0.2 Tue, 15 Nov, 05:14
Daniel Haviv mapWithState job slows down & exceeds yarn's memory limits Tue, 15 Nov, 06:44
Praseetha HiveContext.getOrCreate not accessible Tue, 15 Nov, 07:17
Shixiong(Ryan) Zhu   Re: HiveContext.getOrCreate not accessible Thu, 17 Nov, 21:34
Sree Eedupuganti How to read a Multi Line json object via Spark Tue, 15 Nov, 07:20
Kappaganthu, Sivaram (ES)   RE: How to read a Multi Line json object via Spark Tue, 15 Nov, 07:26
Hyukjin Kwon   Re: How to read a Multi Line json object via Spark Tue, 15 Nov, 08:11
Esa Heikkinen Simple "state machine" functionality using Scala or Python Tue, 15 Nov, 09:43
Fwd:
Anton Okolnychyi   Fwd: Tue, 15 Nov, 11:26
Ashic Mahtab Straming - Stop when there's no more data Tue, 15 Nov, 11:29
pietrop Spark R guidelines for non-spark functions and coxph (Cox Regression for Time-Dependent Covariates) Tue, 15 Nov, 11:56
Shivaram Venkataraman   Re: Spark R guidelines for non-spark functions and coxph (Cox Regression for Time-Dependent Covariates) Tue, 15 Nov, 17:46
Yanbo Liang     Re: Spark R guidelines for non-spark functions and coxph (Cox Regression for Time-Dependent Covariates) Thu, 17 Nov, 02:41
Bhaarat Sharma Exclude certain data from Training Data - Mlib Tue, 15 Nov, 13:28
David Robison creating a javaRDD using newAPIHadoopFile and FixedLengthInputFormat Tue, 15 Nov, 13:44
benoitdr CSV to parquet preserving partitioning Tue, 15 Nov, 13:44
Daniel Siegmann   Re: CSV to parquet preserving partitioning Tue, 15 Nov, 17:57
Drooghaag, Benoit (Nokia - BE)     RE: CSV to parquet preserving partitioning Wed, 16 Nov, 13:53
neil90   Re: CSV to parquet preserving partitioning Wed, 16 Nov, 16:40
benoitdr     RE: CSV to parquet preserving partitioning Wed, 16 Nov, 16:43
neil90       RE: CSV to parquet preserving partitioning Wed, 16 Nov, 17:42
benoitdr         RE: CSV to parquet preserving partitioning Fri, 18 Nov, 10:55
benoitdr           RE: CSV to parquet preserving partitioning Wed, 23 Nov, 15:54
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · Next »Thread · Author · Date
Box list
Sep 202191
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137