spark-user mailing list archives: February 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Re: Spark 2.1.0 issue with spark-shell and pyspark
jerrytim   Re: Spark 2.1.0 issue with spark-shell and pyspark Mon, 13 Feb, 22:23
romain.jouin   Re: Spark 2.1.0 issue with spark-shell and pyspark Mon, 27 Feb, 10:17
vbegar How to specify default value for StructField? Mon, 13 Feb, 22:54
smartzjp   Re: How to specify default value for StructField? Tue, 14 Feb, 15:32
Begar, Veena     RE: How to specify default value for StructField? Tue, 14 Feb, 15:37
Yong Zhang     Re: How to specify default value for StructField? Wed, 15 Feb, 01:30
Begar, Veena       RE: How to specify default value for StructField? Wed, 15 Feb, 15:16
Yong Zhang         Re: How to specify default value for StructField? Wed, 15 Feb, 16:42
颜发才(Yan Facai)           Re: How to specify default value for StructField? Fri, 17 Feb, 23:59
Begar, Veena             RE: How to specify default value for StructField? Tue, 21 Feb, 15:14
Anis Nasir Handling Skewness and Heterogeneity Tue, 14 Feb, 08:01
Galen Marchetti   Re: Handling Skewness and Heterogeneity Tue, 14 Feb, 11:19
Anis Nasir     Re: Handling Skewness and Heterogeneity Tue, 14 Feb, 13:09
Galen Marchetti       Re: Handling Skewness and Heterogeneity Tue, 14 Feb, 14:45
Henry Tremblay wholeTextfiles not parallel, runs out of memory Tue, 14 Feb, 08:36
Jörn Franke   Re: wholeTextfiles not parallel, runs out of memory Tue, 14 Feb, 09:09
Koert Kuipers   Re: wholeTextfiles not parallel, runs out of memory Tue, 14 Feb, 12:21
Henry Tremblay     Re: wholeTextfiles not parallel, runs out of memory Tue, 14 Feb, 15:53
Gourav Sengupta   Re: wholeTextfiles not parallel, runs out of memory Tue, 14 Feb, 13:05
Mendelson, Assaf fault tolerant dataframe write with overwrite Tue, 14 Feb, 10:22
Jörn Franke   Re: fault tolerant dataframe write with overwrite Tue, 14 Feb, 10:54
Mendelson, Assaf     RE: fault tolerant dataframe write with overwrite Tue, 14 Feb, 11:12
Steve Loughran       Re: fault tolerant dataframe write with overwrite Tue, 14 Feb, 13:24
Mendelson, Assaf         RE: fault tolerant dataframe write with overwrite Tue, 14 Feb, 16:43
Jörn Franke           Re: fault tolerant dataframe write with overwrite Tue, 14 Feb, 21:38
Amlan Jyoti Different Results When Performing PCA with Spark and R Tue, 14 Feb, 10:45
萝卜丝炒饭 how to fix the order of data Tue, 14 Feb, 11:41
Sam Elamin   Re: how to fix the order of data Tue, 14 Feb, 11:54
萝卜丝炒饭     Re: how to fix the order of data Tue, 14 Feb, 12:09
nimrodo NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.loadDynamicPartitions writing to Hive Tue, 14 Feb, 14:01
HiveContext on Spark 1.6 Linkage Error:ClassCastException
Enrico DUrso   HiveContext on Spark 1.6 Linkage Error:ClassCastException Tue, 14 Feb, 14:17
Enrico DUrso   HiveContext on Spark 1.6 Linkage Error:ClassCastException Tue, 14 Feb, 14:23
Aseem Bansal Dealing with missing columns in SPARK SQL in JSON Tue, 14 Feb, 14:30
Sam Elamin   Re: Dealing with missing columns in SPARK SQL in JSON Tue, 14 Feb, 14:43
Aseem Bansal     Re: Dealing with missing columns in SPARK SQL in JSON Tue, 14 Feb, 15:04
Sam Elamin       Re: Dealing with missing columns in SPARK SQL in JSON Tue, 14 Feb, 15:07
DandyDev Reusing HBase connection in transformations Tue, 14 Feb, 15:32
anatva My spark job runs faster in spark 1.6 and much slower in spark 2.0 Tue, 14 Feb, 20:25
Timur Shenkao   Re: My spark job runs faster in spark 1.6 and much slower in spark 2.0 Tue, 14 Feb, 23:03
Jörn Franke     Re: My spark job runs faster in spark 1.6 and much slower in spark 2.0 Tue, 14 Feb, 23:29
arun kumar Natva       Re: My spark job runs faster in spark 1.6 and much slower in spark 2.0 Wed, 15 Feb, 03:11
Mohammad Kargar streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 00:03
bryan.jeff...@gmail.com   Re: streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 00:44
Cody Koeninger   Re: streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 01:57
Cody Koeninger     Re: streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 02:54
Mohammad Kargar       Re: streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 03:06
Cody Koeninger         Re: streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 03:24
Mohammad Kargar           Re: streaming-kafka-0-8-integration (direct approach) and monitoring Wed, 15 Feb, 03:30
apu PySpark: use one column to index another (udf of two columns?) Wed, 15 Feb, 00:11
RE: Can't load a RandomForestClassificationModel in Spark job
Jianhong Xia   RE: Can't load a RandomForestClassificationModel in Spark job Wed, 15 Feb, 00:46
Hollin Wilkins     Re: Can't load a RandomForestClassificationModel in Spark job Wed, 15 Feb, 07:47
Jianhong Xia       RE: Can't load a RandomForestClassificationModel in Spark job Thu, 16 Feb, 23:42
Russell Jurney     Re: Can't load a RandomForestClassificationModel in Spark job Fri, 17 Feb, 00:23
kumar r Spark Thrift Server - Skip header when load data from local file Wed, 15 Feb, 05:01
ayan guha   Re: Spark Thrift Server - Skip header when load data from local file Wed, 15 Feb, 06:57
satishl Spark executor memory and jvm heap memory usage metric Wed, 15 Feb, 09:33
satishl What is the practical use of "Peak Execution Memory" in Spark App Resource tuning Wed, 15 Feb, 09:47
satishl extracting eventlogs saved snappy format. Wed, 15 Feb, 09:55
Jörn Franke   Re: extracting eventlogs saved snappy format. Wed, 15 Feb, 10:49
Sachin Aggarwal notebook connecting Spark On Yarn Wed, 15 Feb, 11:41
Jon Gregg   Re: notebook connecting Spark On Yarn Wed, 15 Feb, 18:24
Ahmed Kamal Abdelfatah Query data in subdirectories in Hive Partitions using Spark SQL Wed, 15 Feb, 12:47
颜发才(Yan Facai)   Re: Query data in subdirectories in Hive Partitions using Spark SQL Sat, 18 Feb, 00:02
Jon Gregg     Re: Query data in subdirectories in Hive Partitions using Spark SQL Sat, 18 Feb, 15:49
Dibyendu Bhattacharya Latest Release of Receiver based Kafka Consumer for Spark Streaming. Wed, 15 Feb, 15:57
Gaurav Agarwal Regarding transformation with dataframe Wed, 15 Feb, 17:24
Gaurav Agarwal Enrichment with static tables Wed, 15 Feb, 18:34
Sam Elamin   Re: Enrichment with static tables Wed, 15 Feb, 19:50
Gaurav Agarwal     Re: Enrichment with static tables Thu, 16 Feb, 10:09
Charles O. Bajomo [Spark Streaming WAL] custom java streaming receiver and the WAL Wed, 15 Feb, 21:21
KhajaAsmath Mohammed Remove .HiveStaging files Wed, 15 Feb, 23:05
Xiao Li   Re: Remove .HiveStaging files Thu, 16 Feb, 23:12
Chetan Khatri Spark Job Performance monitoring approaches Thu, 16 Feb, 05:15
Georg Heiler   Re: Spark Job Performance monitoring approaches Thu, 16 Feb, 07:00
Chetan Khatri     Re: Spark Job Performance monitoring approaches Thu, 16 Feb, 07:24
Re: physical memory usage keep increasing for spark app on Yarn
Yang Cao   Re: physical memory usage keep increasing for spark app on Yarn Thu, 16 Feb, 07:18
mzaharchenko Pyspark: out of memory exception during model training Thu, 16 Feb, 11:41
Gourav Sengupta skewed data in join Thu, 16 Feb, 16:11
Yong Zhang   Re: skewed data in join Thu, 16 Feb, 16:34
Anis Nasir     Re: skewed data in join Thu, 16 Feb, 16:54
Gourav Sengupta       Re: skewed data in join Thu, 16 Feb, 17:40
Jon Gregg         Re: skewed data in join Fri, 17 Feb, 15:27
Muthu Jayakumar Pretty print a dataframe... Thu, 16 Feb, 16:26
Michael Armbrust   Re: Pretty print a dataframe... Thu, 16 Feb, 20:41
Muthu Jayakumar     Re: Pretty print a dataframe... Fri, 17 Feb, 06:53
nancy henry scala.io.Source.fromFile protocol for hadoop Thu, 16 Feb, 16:54
Ji Yan Will Spark ever run the same task at the same time Thu, 16 Feb, 18:34
Steve Loughran   Re: Will Spark ever run the same task at the same time Mon, 20 Feb, 14:11
Mark Hamstra   Fwd: Will Spark ever run the same task at the same time Mon, 20 Feb, 20:56
Manish Tripathi Latent Dirichlet Allocation in Spark Thu, 16 Feb, 18:36
cherryii Spark on Mesos with Docker in bridge networking mode Thu, 16 Feb, 19:00
Michael Gummelt   Re: Spark on Mesos with Docker in bridge networking mode Fri, 17 Feb, 19:31
Debugging Spark application
Md. Rezaul Karim   Debugging Spark application Thu, 16 Feb, 22:00
Sam Elamin     Re: Debugging Spark application Thu, 16 Feb, 22:06
Md. Rezaul Karim       Re: Debugging Spark application Thu, 16 Feb, 22:11
shyla deshpande Spark standalone cluster on EC2 error .. Checkpoint.. Thu, 16 Feb, 22:40
Tathagata Das   Re: Spark standalone cluster on EC2 error .. Checkpoint.. Fri, 17 Feb, 20:35
shyla deshpande     Re: Spark standalone cluster on EC2 error .. Checkpoint.. Sat, 18 Feb, 02:04
jeremycod Spark Worker can't find jar submitted programmatically Fri, 17 Feb, 00:46
Cosmin Posteuca   Re: Spark Worker can't find jar submitted programmatically Mon, 20 Feb, 08:07
nancy henry how to give hdfs file path as argument to spark-submit Fri, 17 Feb, 09:12
Jörn Franke   Re: how to give hdfs file path as argument to spark-submit Fri, 17 Feb, 10:07
Aakash Basu How to convert RDD to DF for this case - Fri, 17 Feb, 09:37
Christophe Préaud   Re: How to convert RDD to DF for this case - Fri, 17 Feb, 10:47
Aakash Basu     Re: How to convert RDD to DF for this case - Fri, 17 Feb, 14:33
颜发才(Yan Facai)       Re: How to convert RDD to DF for this case - Fri, 17 Feb, 23:47
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
Jun 2019151
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137