spark-user mailing list archives: June 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
dgoldenberg Objects serialized before foreachRDD/foreachPartition ? Wed, 03 Jun, 12:55
Evo Eftimov   RE: Objects serialized before foreachRDD/foreachPartition ? Wed, 03 Jun, 13:27
Ted Yu     Re: Objects serialized before foreachRDD/foreachPartition ? Wed, 03 Jun, 13:43
Evo Eftimov       RE: Objects serialized before foreachRDD/foreachPartition ? Wed, 03 Jun, 13:58
Dmitry Goldenberg         Re: Objects serialized before foreachRDD/foreachPartition ? Wed, 03 Jun, 15:03
allonsy Equivalent to Storm's 'field grouping' in Spark. Wed, 03 Jun, 13:31
Matei Zaharia   Re: Equivalent to Storm's 'field grouping' in Spark. Wed, 03 Jun, 17:34
luke89     Re: Equivalent to Storm's 'field grouping' in Spark. Thu, 04 Jun, 09:15
kiran lonikar columnar structure of RDDs from Parquet or ORC files Wed, 03 Jun, 14:40
Cheng Lian   Re: columnar structure of RDDs from Parquet or ORC files Sun, 07 Jun, 14:09
kiran lonikar     Re: columnar structure of RDDs from Parquet or ORC files Mon, 08 Jun, 05:33
Cheng Lian       Re: columnar structure of RDDs from Parquet or ORC files Mon, 08 Jun, 11:07
kiran lonikar         Re: columnar structure of RDDs from Parquet or ORC files Mon, 08 Jun, 12:11
ayan guha           Re: columnar structure of RDDs from Parquet or ORC files Mon, 08 Jun, 14:32
Cheng Lian           Re: columnar structure of RDDs from Parquet or ORC files Mon, 08 Jun, 14:55
kiran lonikar             Re: columnar structure of RDDs from Parquet or ORC files Mon, 08 Jun, 16:09
lonikar Does Apache Spark maintain a columnar structure when creating RDDs from Parquet or ORC files? Wed, 03 Jun, 14:58
Cheng Lian   Re: Does Apache Spark maintain a columnar structure when creating RDDs from Parquet or ORC files? Sun, 07 Jun, 14:01
Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics?
Dmitry Goldenberg   Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 15:14
Evo Eftimov     RE: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 15:27
Dmitry Goldenberg       Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 15:45
Evo Eftimov         RE: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 15:49
Dmitry Goldenberg           Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 15:50
Dmitry Goldenberg           Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 16:01
Dmitry Goldenberg           Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 03 Jun, 16:51
Dmitry Goldenberg           Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Thu, 11 Jun, 14:19
Dmitry Goldenberg   Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Thu, 04 Jun, 13:20
Cody Koeninger     Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Thu, 04 Jun, 13:42
Dmitry Goldenberg       Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Wed, 10 Jun, 05:18
Cody Koeninger         Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Thu, 11 Jun, 14:30
Tathagata Das           Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Fri, 12 Jun, 03:08
Dmitry Goldenberg             Re: FW: Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Fri, 12 Jun, 03:38
Steve Loughran               Re: Autoscaling Spark cluster based on topic sizes/rate of growth in Kafka or Spark's metrics? Fri, 12 Jun, 13:31
linkstar350 . Example Page Java Function2 Wed, 03 Jun, 16:23
Sean Owen   Re: Example Page Java Function2 Wed, 03 Jun, 16:35
linkstar350 .     Re: Example Page Java Function2 Thu, 04 Jun, 01:42
dgoldenberg StreamingListener, anyone? Wed, 03 Jun, 16:39
Akhil Das   Re: StreamingListener, anyone? Thu, 04 Jun, 07:32
Shixiong Zhu   Re: StreamingListener, anyone? Thu, 04 Jun, 07:55
Dmitry Goldenberg     Re: StreamingListener, anyone? Thu, 04 Jun, 12:10
Re: Broadcast variables can be rebroadcast?
NB   Re: Broadcast variables can be rebroadcast? Wed, 03 Jun, 16:40
Doug Balog Spark 1.4.0-rc4 HiveContext.table("db.tbl") NoSuchTableException Wed, 03 Jun, 17:45
Yin Huai   Re: Spark 1.4.0-rc4 HiveContext.table("db.tbl") NoSuchTableException Thu, 04 Jun, 00:21
Doug Balog     Re: Spark 1.4.0-rc4 HiveContext.table("db.tbl") NoSuchTableException Thu, 04 Jun, 15:10
Yin Huai       Re: Spark 1.4.0-rc4 HiveContext.table("db.tbl") NoSuchTableException Thu, 04 Jun, 19:04
Yin Huai         Re: Spark 1.4.0-rc4 HiveContext.table("db.tbl") NoSuchTableException Fri, 05 Jun, 19:36
Doug Balog           Re: Spark 1.4.0-rc4 HiveContext.table("db.tbl") NoSuchTableException Fri, 05 Jun, 21:13
Mike Trienis Managing spark processes via supervisord Wed, 03 Jun, 18:46
Igor Berman   Re: Managing spark processes via supervisord Wed, 03 Jun, 19:29
Mike Trienis     Re: Managing spark processes via supervisord Sat, 06 Jun, 02:49
ayan guha       Re: Managing spark processes via supervisord Sat, 06 Jun, 05:25
Justin Spargur Python Image Library and Spark Wed, 03 Jun, 20:27
ayan guha   Re: Python Image Library and Spark Wed, 03 Jun, 21:54
Akhil Das   Re: Python Image Library and Spark Thu, 04 Jun, 07:57
Don Drake Problem reading Parquet from 1.2 to 1.3 Wed, 03 Jun, 20:39
Marcelo Vanzin   Re: Problem reading Parquet from 1.2 to 1.3 Wed, 03 Jun, 21:39
Marcelo Vanzin   Re: Problem reading Parquet from 1.2 to 1.3 Thu, 04 Jun, 16:38
Cheng Lian     Re: Problem reading Parquet from 1.2 to 1.3 Sun, 07 Jun, 13:51
Don Drake       Re: Problem reading Parquet from 1.2 to 1.3 Sun, 07 Jun, 18:03
Shivaram Venkataraman [ANNOUNCE] YARN support in Spark EC2 Wed, 03 Jun, 23:32
Andrew Leverentz RandomForest - subsamplingRate parameter Wed, 03 Jun, 23:40
Xiangrui Meng   Re: RandomForest - subsamplingRate parameter Wed, 17 Jun, 23:23
Piero Cinquegrana Standard Scaler taking 1.5hrs Wed, 03 Jun, 23:53
DB Tsai   Re: Standard Scaler taking 1.5hrs Thu, 04 Jun, 04:53
Piero Cinquegrana     Re: Standard Scaler taking 1.5hrs Thu, 04 Jun, 05:24
DB Tsai       Re: Standard Scaler taking 1.5hrs Thu, 04 Jun, 05:32
Piero Cinquegrana         RE: Standard Scaler taking 1.5hrs Thu, 04 Jun, 16:50
Holden Karau           Re: Standard Scaler taking 1.5hrs Thu, 04 Jun, 16:55
Ashwin Shankar How to pass system properties in spark ? Thu, 04 Jun, 00:38
barmaley Adding new Spark workers on AWS EC2 - access error Thu, 04 Jun, 01:15
Akhil Das   Re: Adding new Spark workers on AWS EC2 - access error Thu, 04 Jun, 08:55
barmaley   Re: Adding new Spark workers on AWS EC2 - access error Thu, 04 Jun, 17:35
AlexG importerror using external library with pyspark Thu, 04 Jun, 01:24
Don Drake   Re: importerror using external library with pyspark Thu, 04 Jun, 15:41
Re: Spark Cluster Benchmarking Frameworks
Zhen Jia   Re: Spark Cluster Benchmarking Frameworks Thu, 04 Jun, 01:43
raggy TreeReduce Functionality in Spark Thu, 04 Jun, 02:10
Reza Zadeh   Re: TreeReduce Functionality in Spark Thu, 04 Jun, 17:28
Raghav Shankar     Re: TreeReduce Functionality in Spark Thu, 04 Jun, 17:46
DB Tsai       Re: TreeReduce Functionality in Spark Thu, 04 Jun, 18:31
Raghav Shankar         Re: TreeReduce Functionality in Spark Thu, 04 Jun, 19:06
DB Tsai           Re: TreeReduce Functionality in Spark Thu, 04 Jun, 22:47
Night Wolf Spark 1.4 HiveContext fails to initialise with native libs Thu, 04 Jun, 04:38
Yin Huai   Re: Spark 1.4 HiveContext fails to initialise with native libs Thu, 04 Jun, 04:46
Night Wolf     Re: Spark 1.4 HiveContext fails to initialise with native libs Thu, 04 Jun, 05:58
Yin Huai       Re: Spark 1.4 HiveContext fails to initialise with native libs Thu, 04 Jun, 15:10
patcharee NullPointerException SQLConf.setConf Thu, 04 Jun, 07:45
Cheng Lian   Re: NullPointerException SQLConf.setConf Sun, 07 Jun, 13:56
Sateesh Kavuri Spark ML decision list Thu, 04 Jun, 09:14
Reza Zadeh   Re: Spark ML decision list Thu, 04 Jun, 17:20
Sateesh Kavuri     Re: Spark ML decision list Fri, 05 Jun, 08:21
Debasish Das       Re: Spark ML decision list Sun, 07 Jun, 15:45
Jean-Charles RISCH Difference bewteen library dependencies version Thu, 04 Jun, 09:53
Ted Yu   Re: Difference bewteen library dependencies version Thu, 04 Jun, 13:42
Daniel Emaasit inlcudePackage() deprecated? Thu, 04 Jun, 10:10
Shivaram Venkataraman   Re: inlcudePackage() deprecated? Thu, 04 Jun, 18:48
Daniel Emaasit     Re: inlcudePackage() deprecated? Thu, 04 Jun, 18:52
Tom Seddon SparkSQL DF.explode with Nulls Thu, 04 Jun, 11:05
Tom Seddon   Re: SparkSQL DF.explode with Nulls Fri, 05 Jun, 06:52
Yifan LI large shuffling => executor lost? Thu, 04 Jun, 11:24
James Aley Optimisation advice for Avro->Parquet merge job Thu, 04 Jun, 13:29
Eugen Cepoi   Re: Optimisation advice for Avro->Parquet merge job Thu, 04 Jun, 14:00
James Aley     Re: Optimisation advice for Avro->Parquet merge job Thu, 04 Jun, 15:27
kiran lonikar       Re: Optimisation advice for Avro->Parquet merge job Mon, 08 Jun, 07:00
kiran lonikar         Re: Optimisation advice for Avro->Parquet merge job Mon, 08 Jun, 16:34
James Aley           Re: Optimisation advice for Avro->Parquet merge job Fri, 12 Jun, 14:20
Hao Ren Big performance difference when joining 3 tables in different order Thu, 04 Jun, 14:10
Giuseppe Sarno Scaling spark jobs returning large amount of data Thu, 04 Jun, 14:30
Igor Berman   Re: Scaling spark jobs returning large amount of data Thu, 04 Jun, 15:20
Richard Marscher     Re: Scaling spark jobs returning large amount of data Thu, 04 Jun, 15:40
Chao Chen Spark Job always cause a node to reboot Thu, 04 Jun, 14:59
Ruslan Dautkhanov   Re: Spark Job always cause a node to reboot Thu, 04 Jun, 17:20
Steve Loughran   Re: Spark Job always cause a node to reboot Fri, 05 Jun, 10:51
ÐΞ...@Ҝ (๏̯͡๏) How to speed up Spark Job? Thu, 04 Jun, 15:04
Justin Steigel Setting S3 output file grantees for spark output files Thu, 04 Jun, 15:10
Akhil Das   Re: Setting S3 output file grantees for spark output files Fri, 05 Jun, 08:02
Justin Steigel     Re: Setting S3 output file grantees for spark output files Fri, 05 Jun, 14:02
lbierman Deduping events using Spark Thu, 04 Jun, 17:10
Richard Marscher   Re: Deduping events using Spark Thu, 04 Jun, 18:43
William Briggs   Re: Deduping events using Spark Fri, 05 Jun, 03:01
Saiph Kappa How to run spark streaming application on YARN? Thu, 04 Jun, 17:20
Sandy Ryza   Re: How to run spark streaming application on YARN? Thu, 04 Jun, 17:26
Saiph Kappa     Re: How to run spark streaming application on YARN? Thu, 04 Jun, 17:30
Sandy Ryza       Re: How to run spark streaming application on YARN? Thu, 04 Jun, 17:32
Saiph Kappa       Re: How to run spark streaming application on YARN? Thu, 04 Jun, 18:13
Sandy Ryza         Re: How to run spark streaming application on YARN? Thu, 04 Jun, 18:14
Saiph Kappa           Re: How to run spark streaming application on YARN? Thu, 04 Jun, 18:20
Saiph Kappa             Re: How to run spark streaming application on YARN? Sat, 06 Jun, 01:04
franco barrientos TF-IDF Question Thu, 04 Jun, 17:46
Somnath Pandeya   RE: TF-IDF Question Fri, 05 Jun, 04:56
Re: Required settings for permanent HDFS Spark on EC2
barmaley   Re: Required settings for permanent HDFS Spark on EC2 Thu, 04 Jun, 18:46
Nicholas Chammas     Re: Required settings for permanent HDFS Spark on EC2 Fri, 05 Jun, 15:24
Re: Roadmap for Spark with Kafka on Scala 2.11?
algermissen1971   Re: Roadmap for Spark with Kafka on Scala 2.11? Thu, 04 Jun, 20:24
Tathagata Das     Re: Roadmap for Spark with Kafka on Scala 2.11? Thu, 04 Jun, 23:22
Joseph Washington Error running sbt package on Windows 7 for Spark 1.3.1 and SimpleApp.scala Thu, 04 Jun, 20:55
dgoldenberg How to share large resources like dictionaries while processing data with Spark ? Thu, 04 Jun, 21:49
Huang, Roger   RE: How to share large resources like dictionaries while processing data with Spark ? Thu, 04 Jun, 22:21
Olivier Girardot   Re: How to share large resources like dictionaries while processing data with Spark ? Thu, 04 Jun, 22:35
Yiannis Gkoufas     Re: How to share large resources like dictionaries while processing data with Spark ? Thu, 04 Jun, 22:44
Dmitry Goldenberg       Re: How to share large resources like dictionaries while processing data with Spark ? Thu, 04 Jun, 23:12
Evo Eftimov         RE: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 10:04
Charles Earl           Re: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 11:09
Evo Eftimov             RE: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 11:19
Dmitry Goldenberg           Re: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 14:15
Charles Earl             Re: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 14:27
Evo Eftimov             RE: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 14:27
Evo Eftimov             RE: How to share large resources like dictionaries while processing data with Spark ? Fri, 05 Jun, 14:29
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137