spark-user mailing list archives: March 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
, Roy spark-submit config via file Fri, 24 Mar, 11:38
446463...@qq.com spark 2.1.0 foreachRDD write slowly to HDFS Mon, 27 Mar, 03:17
446463...@qq.com spark streaming write orc suddenly slow? Tue, 28 Mar, 02:05
任弘迪 Re: spark sql: full outer join optimization Fri, 03 Mar, 07:53
任弘迪 Re: how to call recommend method from ml.recommendation.ALS Thu, 16 Mar, 02:46
李斌松 Spark thriff server hiveStatement.getQueryLog return empty Sun, 12 Mar, 14:37
颜发才(Yan Facai) Re: Sharing my DataFrame (DataSet) cheat sheet. Sun, 05 Mar, 11:38
颜发才(Yan Facai) Re: org.apache.spark.SparkException: Task not serializable Sat, 11 Mar, 11:48
颜发才(Yan Facai) Re: How to improve performance of saveAsTextFile() Sat, 11 Mar, 11:53
颜发才(Yan Facai) Re: how to retain part of the features in LogisticRegressionModel (spark2.0) Tue, 21 Mar, 05:19
颜发才(Yan Facai) Re: How does preprocessing fit into Spark MLlib pipeline Tue, 21 Mar, 05:33
颜发才(Yan Facai) Re: Spark data frame map problem Thu, 23 Mar, 05:41
Dinko Srkoč Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 08:28
Jiří Syrový org.apache.spark.ui.jobs.UIData$TaskMetricsUIData Fri, 17 Mar, 10:17
Jörn Franke Re: Custom Spark data source in Java Wed, 22 Mar, 21:13
Facundo Domínguez Apparent memory leak involving count Wed, 08 Mar, 17:02
Facundo Domínguez Re: Apparent memory leak involving count Thu, 09 Mar, 14:24
Facundo Domínguez Re: Apparent memory leak involving count Fri, 10 Mar, 18:28
Kristinn Rúnarsson Problems when submitting a spark job via the REST API Fri, 03 Mar, 13:22
Kristoffer Sjögren Sorted partition ranges without overlap Mon, 13 Mar, 13:34
Reynier González Tejeda Re: Local spark context on an executor Wed, 22 Mar, 12:43
Szuromi Tamás Re: How best we can store streaming data on dashboards for real time user experience? Thu, 30 Mar, 13:01
萝卜丝炒饭 Re: Failed to connect to master ... Fri, 10 Mar, 07:32
萝卜丝炒饭 Re: org.apache.spark.SparkException: Task not serializable Sat, 11 Mar, 07:51
萝卜丝炒饭 Re: java.io.NotSerializableException: org.apache.spark.streaming.StreamingContext Sat, 11 Mar, 08:10
萝卜丝炒饭 RDD can not convert to df, thanks Fri, 17 Mar, 03:48
萝卜丝炒饭 Re: RDD can not convert to df, thanks Fri, 17 Mar, 05:52
萝卜丝炒饭 Re: RDD can not convert to df, thanks Mon, 20 Mar, 01:36
萝卜丝炒饭 Re: How to use ManualClock with Spark streaming Tue, 21 Mar, 05:58
Jörn Franke Re: using spark to load a data warehouse in real time Wed, 01 Mar, 07:25
Jörn Franke Re: kafka and zookeeper set up in prod for spark streaming Fri, 03 Mar, 08:29
Jörn Franke Re: Spark Beginner: Correct approach for use case Mon, 06 Mar, 07:05
Jörn Franke Re: Spark JDBC reads Tue, 07 Mar, 11:19
Jörn Franke Re: How to unit test spark streaming? Tue, 07 Mar, 14:50
Jörn Franke Re: Apparent memory leak involving count Thu, 09 Mar, 14:36
Jörn Franke Re: Which streaming platform is best? Kafka or Spark Streaming? Thu, 09 Mar, 20:04
Jörn Franke Re: Spark and continuous integration Mon, 13 Mar, 13:18
Jörn Franke Re: Spark and continuous integration Tue, 14 Mar, 11:56
Jörn Franke Re: [Spark CSV]: Use Custom TextInputFormat to Prevent Exceptions Wed, 15 Mar, 17:11
Jörn Franke Re: Custom Spark data source in Java Wed, 22 Mar, 20:00
Jörn Franke Re: Persist RDD doubt Thu, 23 Mar, 09:55
Jörn Franke Re: Upgrade the scala code using the most updated Spark version Mon, 27 Mar, 20:45
Jörn Franke Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 19:43
AShaita...@nz.imshealth.com Check if dataframe is empty Tue, 07 Mar, 03:52
AShaita...@nz.imshealth.com RE: Check if dataframe is empty Tue, 07 Mar, 04:13
Adaryl Wakefield RE: using spark to load a data warehouse in real time Sat, 04 Mar, 19:28
Adaryl Wakefield RE: using spark to load a data warehouse in real time Sat, 04 Mar, 19:32
Adaryl Wakefield RE: using spark to load a data warehouse in real time Tue, 07 Mar, 17:32
Adaryl Wakefield finding Spark Master Tue, 07 Mar, 23:27
Adaryl Wakefield RE: finding Spark Master Wed, 08 Mar, 01:44
Adaryl Wakefield RE: finding Spark Master Wed, 08 Mar, 01:53
Adaryl Wakefield kafka and spark integration Wed, 22 Mar, 07:08
Aditya Borde Merging Schema while reading Parquet files Tue, 21 Mar, 14:53
Adline Dsilva Re: Structured Streaming - Can I start using it? Tue, 14 Mar, 10:26
Afshartous, Nick [ Spark Streaming & Kafka 0.10 ] Possible bug Wed, 22 Mar, 17:18
Alex Re: keep or remove sc.stop() coz of RpcEnv already stopped error Mon, 13 Mar, 14:53
Alex Sulimanov Distinct for Avro Key/Value PairRDD Thu, 09 Mar, 20:24
Allan Richards Spark Beginner: Correct approach for use case Sun, 05 Mar, 20:49
Allan Richards Re: Spark Beginner: Correct approach for use case Wed, 08 Mar, 20:58
Alonso Isidoro Roman Re: How best we can store streaming data on dashboards for real time user experience? Thu, 30 Mar, 07:25
Alonso Isidoro Roman Re: How best we can store streaming data on dashboards for real time user experience? Thu, 30 Mar, 14:56
Amjad ALSHABANI Re: (python) Spark .textFile(s3://…) access denied 403 with valid credentials Tue, 07 Mar, 16:56
Anahita Talebi How to run a spark on Pycharm Fri, 03 Mar, 14:43
Anahita Talebi Re: How to run a spark on Pycharm Fri, 03 Mar, 15:05
Anahita Talebi Upgrade the scala code using the most updated Spark version Mon, 27 Mar, 19:25
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 16:20
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 19:41
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 20:10
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 21:10
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 21:13
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Tue, 28 Mar, 22:52
Anahita Talebi Re: Upgrade the scala code using the most updated Spark version Wed, 29 Mar, 09:28
Ankur Srivastava Spark 2.0 issue with left_outer join Wed, 01 Mar, 21:28
Ankur Srivastava Re: Spark 2.0 issue with left_outer join Sat, 04 Mar, 03:32
Ankur Srivastava Re: Spark 2.0 issue with left_outer join Sun, 05 Mar, 01:05
Ankur Srivastava Re: org.apache.spark.SparkException: Task not serializable Mon, 06 Mar, 21:20
Ankur Srivastava Spark Jobs under Cluster Manager Tue, 07 Mar, 02:40
Artur R How to redistribute dataset without full shuffle Fri, 17 Mar, 21:52
Artur R Re: Persist RDD doubt Thu, 23 Mar, 10:06
Arvind Kandaswamy httpclient conflict in spark Wed, 29 Mar, 13:42
Arvind Kandaswamy Re: httpclient conflict in spark Thu, 30 Mar, 17:59
Aseem Bansal Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Thu, 02 Mar, 11:04
Aseem Bansal spark keeps on creating executors and each one fails with "TransportClient has not yet been set." Thu, 02 Mar, 12:04
Aseem Bansal Re: spark keeps on creating executors and each one fails with "TransportClient has not yet been set." Fri, 03 Mar, 07:31
Aseem Bansal Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 09:14
Aseem Bansal Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Sat, 04 Mar, 16:38
Aseem Bansal Does spark's random forest need categorical features to be one hot encoded? Thu, 23 Mar, 14:34
Asher Krim Re: KMean clustering resulting Skewed Issue Sun, 26 Mar, 11:46
Asher Krim Re: KMean clustering resulting Skewed Issue Wed, 29 Mar, 22:14
Ashic Mahtab Easily creating custom encoders Tue, 21 Mar, 17:13
Ashwin Sai Shankar Spark shuffle files Mon, 27 Mar, 19:38
Ashwin Sai Shankar Re: Spark shuffle files Mon, 27 Mar, 22:13
AssafMendelson Adding metrics to spark datasource Mon, 13 Mar, 12:59
Aviral Agarwal Spark SQL Skip and Log bad records Wed, 15 Mar, 07:01
Aviral Agarwal [SparkSQL] Project using NamedExpression Tue, 21 Mar, 20:15
Bahubali Jain Dataset : Issue with Save Thu, 16 Mar, 17:39
Bahubali Jain Re: Dataset : Issue with Save Fri, 17 Mar, 02:34
Bahubali Jain Re: Dataset : Issue with Save Fri, 17 Mar, 03:41
Bartosz Konieczny [Spark Streaming] Checkpoint backup (.bk) file purpose Thu, 16 Mar, 19:16
Behroz Sikander [Worker Crashing] OutOfMemoryError: GC overhead limit execeeded Thu, 23 Mar, 10:46
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
May 2019272
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137