spark-user mailing list archives: November 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Asher Krim Re: Spark ML DataFrame API - need cosine similarity, how to convert to RDD Vectors? Tue, 15 Nov, 19:25
Nirav Patel Re: Spark SQL UDF - passing map as a UDF parameter Tue, 15 Nov, 19:29
jtgenesis Re: Cannot find Native Library in "cluster" deploy-mode Tue, 15 Nov, 20:04
Manish Malhotra Re: Spark Streaming: question on sticky session across batches ? Tue, 15 Nov, 21:42
David Robison Problem submitting a spark job using yarn-client as master Tue, 15 Nov, 21:45
Marco Mistroni Re: sbt shenanigans for a Spark-based project Tue, 15 Nov, 22:45
coolgar Access broadcast variable from within function passed to reduceByKey Tue, 15 Nov, 23:57
Arun Patel Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 00:12
Hyukjin Kwon Re: Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 00:52
Arun Patel Re: Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 01:44
Elkhan Dadashov Re: Does the delegator map task of SparkLauncher need to stay alive until Spark job finishes ? Wed, 16 Nov, 01:57
Michael Johnson Re: Very long pause/hang at end of execution Wed, 16 Nov, 02:04
Marcelo Vanzin Re: Does the delegator map task of SparkLauncher need to stay alive until Spark job finishes ? Wed, 16 Nov, 02:20
Rohit Verma Re: Problem submitting a spark job using yarn-client as master Wed, 16 Nov, 02:27
Elkhan Dadashov Re: Does the delegator map task of SparkLauncher need to stay alive until Spark job finishes ? Wed, 16 Nov, 02:33
Rohit Verma Re: Joining to a large, pre-sorted file Wed, 16 Nov, 02:36
Prithish Re: AVRO File size when caching in-memory Wed, 16 Nov, 04:44
Devi P.V what is the optimized way to combine multiple dataframes into one dataframe ? Wed, 16 Nov, 07:05
Shreya Agarwal RE: AVRO File size when caching in-memory Wed, 16 Nov, 07:48
Shreya Agarwal RE: what is the optimized way to combine multiple dataframes into one dataframe ? Wed, 16 Nov, 07:55
Deepak Sharma Re: what is the optimized way to combine multiple dataframes into one dataframe ? Wed, 16 Nov, 08:01
Prithish Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:26
Takeshi Yamamuro Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:38
Vaibhav Sinha Writing parquet table using spark Wed, 16 Nov, 08:40
Prithish Re: AVRO File size when caching in-memory Wed, 16 Nov, 08:47
Pietro Pugni Re: Very long pause/hang at end of execution Wed, 16 Nov, 09:40
kant kodali How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Wed, 16 Nov, 09:44
Aniket Bhatnagar Re: Very long pause/hang at end of execution Wed, 16 Nov, 10:44
Aniket Bhatnagar Re: Very long pause/hang at end of execution Wed, 16 Nov, 10:48
Hyukjin Kwon Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Wed, 16 Nov, 10:49
Zsolt Tóth Map and MapParitions with partition-local variable Wed, 16 Nov, 11:59
Dirceu Semighini Filho Re: Writing parquet table using spark Wed, 16 Nov, 12:17
Reza zade problem deploying spark-jobserver on CentOS Wed, 16 Nov, 13:09
Drooghaag, Benoit (Nokia - BE) RE: CSV to parquet preserving partitioning Wed, 16 Nov, 13:53
David Robison RE: Problem submitting a spark job using yarn-client as master Wed, 16 Nov, 14:03
janardhan shetty Re: Log-loss for multiclass classification Wed, 16 Nov, 14:35
Kai Wang HttpFileServer behavior in 1.6.3 Wed, 16 Nov, 14:39
Shreya Agarwal RE: AVRO File size when caching in-memory Wed, 16 Nov, 16:29
neil90 Re: CSV to parquet preserving partitioning Wed, 16 Nov, 16:40
benoitdr RE: CSV to parquet preserving partitioning Wed, 16 Nov, 16:43
Arun Patel Re: Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 17:26
Russell Jurney Re: Spark ML DataFrame API - need cosine similarity, how to convert to RDD Vectors? Wed, 16 Nov, 17:26
ruben Re: use case reading files split per id Wed, 16 Nov, 17:28
Hyukjin Kwon Re: Spark-xml - OutOfMemoryError: Requested array size exceeds VM limit Wed, 16 Nov, 17:32
neil90 RE: CSV to parquet preserving partitioning Wed, 16 Nov, 17:42
Kuchekar Spark UI shows Jobs are processing, but the files are already written to S3 Wed, 16 Nov, 18:00
Karim, Md. Rezaul Need guidelines in Spark Streaming and Kafka integration Wed, 16 Nov, 18:18
Shreya Agarwal RE: Spark UI shows Jobs are processing, but the files are already written to S3 Wed, 16 Nov, 18:37
Michael Armbrust Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Wed, 16 Nov, 18:50
Aleksander Eskilson [SQL/Catalyst] Janino Generated Code Debugging Wed, 16 Nov, 18:59
Mohammad Tariq Re: Need guidelines in Spark Streaming and Kafka integration Wed, 16 Nov, 19:12
shyla deshpande Spark 2.0.2 with Kafka source, Error please help! Wed, 16 Nov, 19:16
David Robison RE: submitting a spark job using yarn-client and getting NoClassDefFoundError: org/apache/spark/Logging Wed, 16 Nov, 20:05
Rodrick Brown How to propagate R_LIBS to sparkr executors Wed, 16 Nov, 21:00
Shixiong(Ryan) Zhu Re: Spark 2.0.2 with Kafka source, Error please help! Wed, 16 Nov, 21:15
shyla deshpande Re: Spark 2.0.2 with Kafka source, Error please help! Wed, 16 Nov, 21:19
Shixiong(Ryan) Zhu Re: Spark 2.0.2 with Kafka source, Error please help! Wed, 16 Nov, 21:28
Edden Burrow Any with S3 experience with Spark? Having ListBucket issues Wed, 16 Nov, 22:34
Mohit Jaggi SparkILoop doesn't run Wed, 16 Nov, 22:47
shyla deshpande Re: Spark 2.0.2 with Kafka source, Error please help! Wed, 16 Nov, 23:04
shyla deshpande Re: Spark 2.0.2 with Kafka source, Error please help! Thu, 17 Nov, 00:22
Cody Koeninger Re: Kafka segmentation Thu, 17 Nov, 00:22
kant kodali Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Thu, 17 Nov, 00:39
bo yang Re: Kafka segmentation Thu, 17 Nov, 01:05
Cody Koeninger Re: Kafka segmentation Thu, 17 Nov, 01:32
Yanbo Liang Re: Spark R guidelines for non-spark functions and coxph (Cox Regression for Time-Dependent Covariates) Thu, 17 Nov, 02:41
Jon Gregg Re: Need guidelines in Spark Streaming and Kafka integration Thu, 17 Nov, 03:08
Karim, Md. Rezaul Re: Need guidelines in Spark Streaming and Kafka integration Thu, 17 Nov, 03:27
bluishpenguin Configure spark.kryoserializer.buffer.max at runtime does not take effect Thu, 17 Nov, 03:55
颜发才(Yan Facai) Best practice for preprocessing feature with DataFrame Thu, 17 Nov, 04:08
Divya Gehlot Re: Best practice for preprocessing feature with DataFrame Thu, 17 Nov, 04:23
Nathan Lande Re: How do I convert json_encoded_blob_column into a data frame? (This may be a feature request) Thu, 17 Nov, 04:41
Michael Johnson Re: Very long pause/hang at end of execution Thu, 17 Nov, 05:10
bo yang Re: Kafka segmentation Thu, 17 Nov, 05:50
kant kodali How does predicate push down really help? Thu, 17 Nov, 06:03
Perttu Ranta-aho Nested UDFs Thu, 17 Nov, 07:14
Mendelson, Assaf RE: How does predicate push down really help? Thu, 17 Nov, 07:34
Mendelson, Assaf RE: Nested UDFs Thu, 17 Nov, 07:42
kant kodali Re: How does predicate push down really help? Thu, 17 Nov, 07:49
Ashic Mahtab Re: How does predicate push down really help? Thu, 17 Nov, 07:56
Mendelson, Assaf RE: How does predicate push down really help? Thu, 17 Nov, 07:56
kant kodali Re: How does predicate push down really help? Thu, 17 Nov, 08:07
kant kodali Re: How does predicate push down really help? Thu, 17 Nov, 08:08
Takeshi Yamamuro Re: [SQL/Catalyst] Janino Generated Code Debugging Thu, 17 Nov, 08:10
Hoang Bao Thien Re: Kafka segmentation Thu, 17 Nov, 09:18
wobu why is method predict protected in PredictionModel Thu, 17 Nov, 09:24
kant kodali Another Interesting Question on SPARK SQL Thu, 17 Nov, 09:28
颜发才(Yan Facai) Re: Best practice for preprocessing feature with DataFrame Thu, 17 Nov, 09:37
Aakash Basu Join Query Thu, 17 Nov, 09:47
Aakash Basu HDPCD SPARK Certification Queries Thu, 17 Nov, 10:11
Perttu Ranta-aho Re: Nested UDFs Thu, 17 Nov, 11:49
Mendelson, Assaf RE: Nested UDFs Thu, 17 Nov, 13:08
Mich Talebzadeh Handling windows characters with Spark CSV on Linux Thu, 17 Nov, 13:11
Jörn Franke Re: Handling windows characters with Spark CSV on Linux Thu, 17 Nov, 13:20
Dirceu Semighini Filho Re: Spark Streaming Data loss on failure to write BlockAdditionEvent failure to WAL Thu, 17 Nov, 13:50
ayan guha Re: Handling windows characters with Spark CSV on Linux Thu, 17 Nov, 13:59
Debasish Ghosh outlier detection using StreamingKMeans Thu, 17 Nov, 14:03
Mich Talebzadeh Re: Handling windows characters with Spark CSV on Linux Thu, 17 Nov, 14:15
Isabelle Phan ClassCastException when using SparkSQL Window function Thu, 17 Nov, 14:20
Hyukjin Kwon Re: Handling windows characters with Spark CSV on Linux Thu, 17 Nov, 14:36
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · Next »Thread · Author · Date
Box list
Jun 2021112
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137