spark-user mailing list archives: November 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Imran Rajjad unable to run spark streaming example Fri, 03 Nov, 13:51
Imran Rajjad spark-stream memory table global? Fri, 10 Nov, 12:56
Imran Rajjad spark strucured csv file stream not detecting new files Wed, 15 Nov, 13:47
JG Perrin Spark as ETL, was: Re: Dose pyspark supports python3.6? Thu, 02 Nov, 13:38
JG Perrin Re: share datasets across multiple spark-streaming applications for lookup Thu, 02 Nov, 13:44
Jacek Laskowski Re: Restart Spark Streaming after deployment Thu, 16 Nov, 08:04
Jacek Laskowski Re: Struct Type Fri, 17 Nov, 17:26
Jean Georges Perrin Re: How to get the data url Fri, 03 Nov, 10:48
Jean Georges Perrin Re: Hi all, Fri, 03 Nov, 10:48
Jean Georges Perrin Re: Regarding column partitioning IDs and names as per hierarchical level SparkSQL Fri, 03 Nov, 10:48
Jeff Zhang Re: pyspark configuration with Juyter Fri, 03 Nov, 11:56
Jeroen Miller Processing a splittable file from a single executor Thu, 16 Nov, 09:12
Jeroen Miller Re: Processing a splittable file from a single executor Thu, 16 Nov, 09:41
Jim Carroll Re: Writing files to s3 with out temporary directory Mon, 20 Nov, 19:48
Jim Carroll Re: Writing files to s3 with out temporary directory Mon, 20 Nov, 22:10
Jim Carroll Re: Writing files to s3 with out temporary directory Tue, 21 Nov, 15:03
Jim Carroll Re: Writing files to s3 with out temporary directory Tue, 21 Nov, 20:06
Joel D Re: Process large JSON file without causing OOM Tue, 14 Nov, 01:30
Jules Damji Re: Spark 2.2 Structured Streaming + Kinesis Mon, 13 Nov, 23:25
Jun Shi Fwd: Dose pyspark supports python3.6? Thu, 02 Nov, 02:54
Kedarnath Dixit Use of Accumulators Mon, 13 Nov, 16:58
Kedarnath Dixit RE: Use of Accumulators Tue, 14 Nov, 11:51
Kedarnath Dixit Re: Use of Accumulators Tue, 14 Nov, 14:55
KhajaAsmath Mohammed Spark Streaming in Spark 2.1 with Kafka 0.9 Thu, 09 Nov, 22:28
KhajaAsmath Mohammed Restart Spark Streaming after deployment Wed, 15 Nov, 16:18
KhajaAsmath Mohammed Spark Streaming Job completed without executing next batches Fri, 17 Nov, 04:01
KhajaAsmath Mohammed Re: Spark Streaming Job completed without executing next batches Fri, 17 Nov, 04:04
KhajaAsmath Mohammed Struct Type Fri, 17 Nov, 17:06
KhajaAsmath Mohammed Spark Streaming in Wait mode Fri, 17 Nov, 22:23
KhajaAsmath Mohammed spark streaming part files in hive partition Sun, 19 Nov, 23:36
KhajaAsmath Mohammed Re: spark streaming part files in hive partition Sun, 19 Nov, 23:49
KhajaAsmath Mohammed Spark Stremaing Hive Dynamic Partitions Issue Wed, 22 Nov, 16:06
KhajaAsmath Mohammed Spark Streaming Kerberos Issue Wed, 22 Nov, 18:25
KhajaAsmath Mohammed Re: Spark Streaming Kerberos Issue Wed, 22 Nov, 18:29
KhajaAsmath Mohammed Re: Spark Streaming Kerberos Issue Wed, 22 Nov, 18:33
KhajaAsmath Mohammed Re: Spark Streaming Kerberos Issue Wed, 22 Nov, 18:36
KhajaAsmath Mohammed JDK1.8 for spark workers Wed, 29 Nov, 15:54
KhajaAsmath Mohammed Re: JDK1.8 for spark workers Thu, 30 Nov, 05:50
Kunft, Andreas [Spark R]: dapply only works for very small datasets Mon, 27 Nov, 18:27
Kunft, Andreas AW: [Spark R]: dapply only works for very small datasets Tue, 28 Nov, 11:11
Kunft, Andreas AW: [Spark R]: dapply only works for very small datasets Wed, 29 Nov, 13:04
Lalwani, Jayesh Union of streaming dataframes Fri, 17 Nov, 17:55
Mamillapalli, Purna Pradeep Executor not getting added SparkUI & Spark Eventlog in deploymode:cluster Tue, 14 Nov, 16:02
Manuel Vonthron Which predicate pushdown work or does not work with Parquet? Tue, 07 Nov, 00:29
Marcelo Vanzin Re: Does the builtin hive jars talk of spark to HiveMetaStore(2.1) without any issues? Thu, 09 Nov, 17:41
Marchant, Hayden [Structured Streaming] Continuous Processing Mode plan? Wed, 29 Nov, 08:24
Marco Mistroni Re: pyspark configuration with Juyter Sat, 04 Nov, 19:35
Margusja Re: spark job paused(active stages finished) Thu, 09 Nov, 06:25
Marius [Spark Core]: S3a with Openstack swift object storage not using credentials provided in sparkConf Wed, 15 Nov, 20:48
Mark Hamstra Re: Databricks Serverless Mon, 13 Nov, 23:34
Md. Rezaul Karim SpecificColumnarIterator has grown past JVM limit of 0xFFF Sat, 18 Nov, 00:43
Michael Armbrust Re: Structured Stream equivalent of reduceByKey Mon, 06 Nov, 21:24
Michael Armbrust Re: [Spark Structured Streaming] Changing partitions of (flat)MapGroupsWithState Wed, 08 Nov, 15:57
Michael Armbrust Re: Generate windows on processing time in Spark Structured Streaming Fri, 10 Nov, 19:42
Michael Armbrust Re: Kafka version support Thu, 30 Nov, 21:00
Michael Armbrust Re: Kafka version support Thu, 30 Nov, 21:39
Michael Artz Re: Read parquet files as buckets Wed, 01 Nov, 12:41
Michael Artz Caching dataframes and overwrite Wed, 22 Nov, 01:40
Michael Artz build spark source code Thu, 23 Nov, 02:34
Michael Artz Re: Spark Data Frame. PreSorded partitions Tue, 28 Nov, 15:42
Ming Ma [Spark ML] Compatibility between features and models Mon, 27 Nov, 06:23
Nadeem Lalani Measuring cluster utilization of a streaming job Tue, 14 Nov, 12:54
Nate Wendt [Spark ML] : Implement the Conjugate Gradient method for ALS Thu, 30 Nov, 20:03
Nicholas Hakobian Re: NLTK with Spark Streaming Tue, 28 Nov, 21:45
Nick Dimiduk Access to Applications metrics Wed, 15 Nov, 22:28
Nick Pentreath Re: does "Deep Learning Pipelines" scale out linearly? Thu, 23 Nov, 05:12
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 12:57
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 13:27
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 21:20
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Sun, 05 Nov, 21:54
Nicolas Paris pySpark driver memory limit Mon, 06 Nov, 18:56
Nicolas Paris Re: pySpark driver memory limit Thu, 09 Nov, 07:11
Nicolas Paris Re: Hive From Spark: Jdbc VS sparkContext Wed, 22 Nov, 22:55
Patrick Alwell Re: Spark based Data Warehouse Sun, 12 Nov, 21:40
Paul Corley Spark REST API Tue, 07 Nov, 17:24
Paul Mackles History server and non-HDFS filesystems Fri, 17 Nov, 23:15
Phillip Henry Re: Spark based Data Warehouse Sun, 12 Nov, 09:32
Phillip Henry Re: Spark based Data Warehouse Sun, 12 Nov, 18:19
Phillip Henry Re: Multiple transformations without recalculating or caching Sun, 19 Nov, 16:20
Prem Sure Re: Spark application fail wit numRecords error Wed, 01 Nov, 17:11
Rabin Banerjee Parquet Filter pushdown not working and statistics are not generating for any column with Spark 1.6 CDH 5.7 Tue, 21 Nov, 15:29
Rabin Banerjee Re: Spark/Parquet/Statistics question Tue, 21 Nov, 16:08
Raghavendra Pandey Kafka version support Thu, 30 Nov, 06:17
Richard Moorhead Spark Streaming Kinesis Missing Records Fri, 24 Nov, 20:36
Rishi Mishra Re: DataFrame joins with Spark-Java Thu, 30 Nov, 06:37
Romeo Valencia [SPARK: org.apache.spark.util.TaskCompletionListenerException] Wed, 15 Nov, 23:06
Sebastian Piu Re: pySpark driver memory limit Thu, 09 Nov, 08:25
Sebastian Piu Re: Multiple transformations without recalculating or caching Fri, 17 Nov, 10:06
Serkan TAS Spark application fail wit numRecords error Wed, 01 Nov, 06:10
Serkan TAS RE: Spark application fail wit numRecords error Thu, 02 Nov, 05:27
Shing Hing Man Spark 2.1.2 Spark Streaming checkpoint interval not respected Sat, 18 Nov, 15:25
Shixiong(Ryan) Zhu Re: spark-stream memory table global? Fri, 10 Nov, 20:37
Shixiong(Ryan) Zhu Re: How to print plan of Structured Streaming DataFrame Mon, 20 Nov, 18:57
Shixiong(Ryan) Zhu Re: PySpark 2.2.0, Kafka 0.10 DataFrames Tue, 21 Nov, 01:07
Siddharth Murching [ML] Spark Package Release: Deep Learning Pipelines 0.2.0 Thu, 16 Nov, 21:29
Sky Yin Re: Spark based Data Warehouse Mon, 13 Nov, 18:40
Sonal Goyal Re: Process large JSON file without causing OOM Tue, 14 Nov, 07:58
Sourav Mazumder Custom Data Source for getting data from Rest based services Tue, 21 Nov, 17:07
Sourav Mazumder Re: Custom Data Source for getting data from Rest based services Tue, 28 Nov, 03:20
Stephen Boesch Weight column values not used in Binary Logistic Regression Summary Sat, 18 Nov, 14:53
Message list« Previous · 1 · 2 · 3 · Next »Thread · Author · Date
Box list
Jun 2019245
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137