spark-user mailing list archives: July 2019

Site index · List index
Message list« Previous · 1 · 2Thread · Author · Date
Hyukjin Kwon Re: Usage of PyArrow in Spark Wed, 17 Jul, 11:17
Magnus Nilsson CPU:s per task Wed, 17 Jul, 11:29
Bobby Evans Re: [Beginner] Run compute on large matrices and return the result in seconds? Wed, 17 Jul, 14:06
Artur Sukhenko Re: event log directory(spark-history) filled by large .inprogress files for spark streaming applications Wed, 17 Jul, 15:03
Shahid K. I. Re: event log directory(spark-history) filled by large .inprogress files for spark streaming applications Wed, 17 Jul, 16:28
Gautham Acharya RE: [Beginner] Run compute on large matrices and return the result in seconds? Wed, 17 Jul, 19:13
Patrick McCarthy Re: [Beginner] Run compute on large matrices and return the result in seconds? Wed, 17 Jul, 19:39
Gautham Acharya RE: [Beginner] Run compute on large matrices and return the result in seconds? Wed, 17 Jul, 19:42
Jerry Vinokurov Re: [Beginner] Run compute on large matrices and return the result in seconds? Wed, 17 Jul, 20:27
Gautham Acharya RE: [Beginner] Run compute on large matrices and return the result in seconds? Wed, 17 Jul, 21:11
Amit Sharma Re: spark standalone mode problem about executor add and removed again and again! Thu, 18 Jul, 01:56
Abdeali Kothari Re: Usage of PyArrow in Spark Thu, 18 Jul, 07:01
Joevu unsubscribe Thu, 18 Jul, 09:07
Supun Kamburugamuve Binding spark workers to a network interface Thu, 18 Jul, 13:50
Riccardo Ferrari Re: spark standalone mode problem about executor add and removed again and again! Thu, 18 Jul, 14:16
Bryan Cutler Re: Usage of PyArrow in Spark Thu, 18 Jul, 17:49
Information Technologies Looking for a developer to help us with a small ETL project using Spark and Kubernetes Thu, 18 Jul, 22:47
Sebastian Piu Re: Looking for a developer to help us with a small ETL project using Spark and Kubernetes Fri, 19 Jul, 06:27
Dennis Suhari Spark and Oozie Fri, 19 Jul, 07:08
Bartek Dobija Re: Spark and Oozie Fri, 19 Jul, 07:23
Aslan Bakirov Unsubscribe Fri, 19 Jul, 09:40
zenglong chen Spark ImportError: No module named XXX Fri, 19 Jul, 10:57
Richard Spark dataset to explode json string Fri, 19 Jul, 20:47
Mich Talebzadeh Re: Spark dataset to explode json string Fri, 19 Jul, 21:26
Richard Re: Spark dataset to explode json string Fri, 19 Jul, 22:17
Mich Talebzadeh Re: Spark dataset to explode json string Fri, 19 Jul, 22:57
Richard Re: Spark dataset to explode json string Fri, 19 Jul, 23:00
William Shen Re: Spark and Oozie Fri, 19 Jul, 23:48
Mich Talebzadeh Re: Spark dataset to explode json string Sat, 20 Jul, 03:54
Richard Re: Spark dataset to explode json string Sat, 20 Jul, 04:20
Richard Spark SaveMode Sat, 20 Jul, 04:34
Stephen Boesch Re: NoSuchMethodError: org.apache.spark.network.util.AbstractFileRegion.transferred Sat, 20 Jul, 04:50
Jörn Franke Re: Spark SaveMode Sat, 20 Jul, 05:40
Mich Talebzadeh Re: Spark SaveMode Sat, 20 Jul, 06:42
Mich Talebzadeh Re: Spark SaveMode Sat, 20 Jul, 07:13
Shamshad Ansari How to get loss per iteration in Spark MultilayerPerceptronClassificationModel? Sat, 20 Jul, 22:07
Stephen Boesch Re: NoSuchMethodError: org.apache.spark.network.util.AbstractFileRegion.transferred Sun, 21 Jul, 01:39
Alex Landa Long-Running Spark application doesn't clean old shuffle data correctly Sun, 21 Jul, 06:01
Aayush Ranaut Re: Long-Running Spark application doesn't clean old shuffle data correctly Sun, 21 Jul, 06:07
Alex Landa Re: Long-Running Spark application doesn't clean old shuffle data correctly Sun, 21 Jul, 07:19
Mich Talebzadeh Re: Spark SaveMode Sun, 21 Jul, 13:53
Keith Chapman Re: Long-Running Spark application doesn't clean old shuffle data correctly Sun, 21 Jul, 19:49
Stephen Boesch Re: NoSuchMethodError: org.apache.spark.network.util.AbstractFileRegion.transferred Sun, 21 Jul, 21:29
Amit Sharma spark dataset.cache is not thread safe Sun, 21 Jul, 23:18
Hieu Nguyen [No Subject] Mon, 22 Jul, 04:16
Balakumar iyer S Spark 2.3 Dataframe Grouby operation throws IllegalArgumentException on Large dataset Mon, 22 Jul, 10:57
Bobby Evans Re: Spark 2.3 Dataframe Grouby operation throws IllegalArgumentException on Large dataset Mon, 22 Jul, 13:35
Amit Sharma Re: spark dataset.cache is not thread safe Tue, 23 Jul, 02:08
Nicolas Paris Avro large binary read memory problem Tue, 23 Jul, 16:56
Mario Amatucci RE: Avro large binary read memory problem Tue, 23 Jul, 17:10
Nicolas Paris Re: Avro large binary read memory problem Tue, 23 Jul, 17:19
Balakumar iyer S Re: Spark 2.3 Dataframe Grouby operation throws IllegalArgumentException on Large dataset Wed, 24 Jul, 04:15
Luca Borin Apache Spark Log4j logging applicationId Wed, 24 Jul, 05:05
Alex Landa Re: Long-Running Spark application doesn't clean old shuffle data correctly Wed, 24 Jul, 05:34
Chris Teoh Re: Spark 2.3 Dataframe Grouby operation throws IllegalArgumentException on Large dataset Wed, 24 Jul, 10:04
Praups Kumar How to get Peak CPU Utilization Rate in Spark Wed, 24 Jul, 11:18
James Pirz [Spark SQL] dependencies to use test helpers Wed, 24 Jul, 22:38
Rishi Shah [Pyspark 2.4] Large number of row groups in parquet files created using spark Thu, 25 Jul, 01:29
melin li concat function nesting function, column printing failed Thu, 25 Jul, 03:22
melin li Re: concat function nesting function, column printing failed Thu, 25 Jul, 04:12
zenglong chen Can pyspark use --archives to upload self-defined module than --py-files? Thu, 25 Jul, 09:53
zenglong chen spark config about spark.yarn.appMasterEnv Thu, 25 Jul, 11:15
Amit Sharma Core allocation is scattered Thu, 25 Jul, 12:23
15313776907 Re: Core allocation is scattered Fri, 26 Jul, 01:35
Srikanth Sriram Re: Core allocation is scattered Fri, 26 Jul, 02:21
Latha Appanna [spark standalone mode] force spark to launch driver in a specific worker in cluster mode Fri, 26 Jul, 04:43
Shamshad Ansari Re: [spark standalone mode] force spark to launch driver in a specific worker in cluster mode Fri, 26 Jul, 05:17
Abhishek Somani New Spark Datasource for Hive ACID tables Fri, 26 Jul, 12:37
naresh Goud Re: New Spark Datasource for Hive ACID tables Fri, 26 Jul, 13:38
Abhishek Somani Re: New Spark Datasource for Hive ACID tables Fri, 26 Jul, 14:47
Nicolas Paris Re: New Spark Datasource for Hive ACID tables Sat, 27 Jul, 20:24
naresh Goud Re: New Spark Datasource for Hive ACID tables Sat, 27 Jul, 22:34
naresh Goud Re: New Spark Datasource for Hive ACID tables Sat, 27 Jul, 23:11
Abhishek Somani Re: New Spark Datasource for Hive ACID tables Sun, 28 Jul, 02:20
naresh Goud Re: New Spark Datasource for Hive ACID tables Sun, 28 Jul, 02:22
Abhishek Somani Re: New Spark Datasource for Hive ACID tables Sun, 28 Jul, 03:14
Dhrubajyoti Hati Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 06:22
Jörn Franke Re: Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 07:07
Dhrubajyoti Hati Re: Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 09:20
Sean Owen Re: Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 13:15
Dhrubajyoti Hati Re: Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 14:03
Sean Owen Re: Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 14:12
Dhrubajyoti Hati Re: Logistic Regression Iterations causing High GC in Spark 2.3 Mon, 29 Jul, 14:53
Muthu Jayakumar Number of tasks... Tue, 30 Jul, 00:53
Gourav Sengupta repartitionByRange and number of tasks Tue, 30 Jul, 01:05
zenglong chen Spark checkpoint problem for python api Tue, 30 Jul, 03:02
Spico Florin Kafka Integration libraries put in the fat jar Tue, 30 Jul, 13:38
Nick Dawes Spark Image resizing Tue, 30 Jul, 20:17
Nick Dawes Re: Spark Image resizing Wed, 31 Jul, 10:22
Spico Florin Re: Kafka Integration libraries put in the fat jar Wed, 31 Jul, 12:20
Muthu Jayakumar Re: Core allocation is scattered Wed, 31 Jul, 14:16
Patrick McCarthy Re: Spark Image resizing Wed, 31 Jul, 14:44
Terry Kim Announcing .NET for Apache Spark 0.4.0 Wed, 31 Jul, 17:23
Message list« Previous · 1 · 2Thread · Author · Date
Box list
Jan 2020101
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137