spark-user mailing list archives: February 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Udo Fholl Spark Streaming - 1.6.0: mapWithState Kinesis huge memory usage Wed, 03 Feb, 17:52
Shixiong(Ryan) Zhu   Re: Spark Streaming - 1.6.0: mapWithState Kinesis huge memory usage Thu, 04 Feb, 19:14
Udo Fholl     Re: Spark Streaming - 1.6.0: mapWithState Kinesis huge memory usage Fri, 05 Feb, 00:14
Shixiong(Ryan) Zhu       Re: Spark Streaming - 1.6.0: mapWithState Kinesis huge memory usage Fri, 05 Feb, 01:31
Udo Fholl         Re: Spark Streaming - 1.6.0: mapWithState Kinesis huge memory usage Fri, 05 Feb, 10:44
Udo Fholl           Re: Spark Streaming - 1.6.0: mapWithState Kinesis huge memory usage Sat, 06 Feb, 16:16
Wayne Song Connect to two different HDFS servers with different usernames Wed, 03 Feb, 19:11
Re: Product similarity with TF/IDF and Cosine similarity (DIMSUM)
Karl Higley   Re: Product similarity with TF/IDF and Cosine similarity (DIMSUM) Wed, 03 Feb, 19:28
Nirav Patel Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 19:46
Marcelo Vanzin   Re: Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 19:50
Nirav Patel     Re: Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 19:53
Marcelo Vanzin       Re: Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 20:02
Rishabh Wadhawan         Re: Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 20:08
Rishabh Wadhawan         Re: Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 20:09
Nirav Patel           Re: Spark 1.5.2 Yarn Application Master - resiliencey Wed, 03 Feb, 20:45
Younes Naguib Low latency queries much slower in 1.6.0 Wed, 03 Feb, 20:17
Rishabh Wadhawan   Re: Low latency queries much slower in 1.6.0 Wed, 03 Feb, 21:35
Jorge Rodriguez Spark Streaming: My kafka receivers are not consuming in parallel Wed, 03 Feb, 20:44
Jorge Rodriguez   Re: Spark Streaming: My kafka receivers are not consuming in parallel Wed, 03 Feb, 23:08
Sung Hwan Chung Parquet StringType column readable as plain-text despite being Gzipped Wed, 03 Feb, 21:16
FrankFlaherty Cassandra BEGIN BATCH Wed, 03 Feb, 21:45
Ted Yu   Re: Cassandra BEGIN BATCH Wed, 03 Feb, 22:54
Mohammed Guller     RE: Cassandra BEGIN BATCH Wed, 03 Feb, 23:21
apu mishra . rr Nearest neighbors in Spark with Annoy Wed, 03 Feb, 22:04
Yiannis Gkoufas SparkOscope: Enabling Spark Optimization through Cross-stack Monitoring and Visualization Thu, 04 Feb, 00:44
Gavin Yue How parquet file decide task number? Thu, 04 Feb, 01:05
Gavin Yue   Re: How parquet file decide task number? Thu, 04 Feb, 02:10
fightf...@163.com clear cache using spark sql cli Thu, 04 Feb, 03:16
Ted Yu   Re: clear cache using spark sql cli Thu, 04 Feb, 03:22
fightf...@163.com   Re: Re: clear cache using spark sql cli Thu, 04 Feb, 03:35
Ted Yu     Re: Re: clear cache using spark sql cli Thu, 04 Feb, 03:49
fightf...@163.com   Re: Re: clear cache using spark sql cli Thu, 04 Feb, 03:58
DaeJin Jung Is there a any plan to develop SPARK with c++?? Thu, 04 Feb, 05:49
Benjamin Kim   Re: Is there a any plan to develop SPARK with c++?? Thu, 04 Feb, 06:22
fightf...@163.com About cache table performance in spark sql Thu, 04 Feb, 05:55
Prabhu Joseph   Re: About cache table performance in spark sql Thu, 04 Feb, 06:05
fightf...@163.com     Re: Re: About cache table performance in spark sql Thu, 04 Feb, 06:16
Takeshi Yamamuro       Re: Re: About cache table performance in spark sql Thu, 04 Feb, 08:01
fightf...@163.com   Re: Re: About cache table performance in spark sql Thu, 04 Feb, 08:04
Re: spark streaming web ui not showing the events - direct kafka api
vimal dinakaran   Re: spark streaming web ui not showing the events - direct kafka api Thu, 04 Feb, 06:07
Cody Koeninger     Re: spark streaming web ui not showing the events - direct kafka api Thu, 04 Feb, 16:39
Arunkumar Pillai Need to user univariate summary stats Thu, 04 Feb, 09:22
Lohith Samaga M   RE: Need to user univariate summary stats Thu, 04 Feb, 09:42
Divya Gehlot add new column in the schema + Dataframe Thu, 04 Feb, 09:28
Mohammed Guller   RE: add new column in the schema + Dataframe Thu, 04 Feb, 22:43
Arunkumar Pillai [Spark 1.6] Univariate Stats using apache spark Thu, 04 Feb, 09:34
Valentin Popov library dependencies to run spark local mode Thu, 04 Feb, 10:49
Ted Yu   Re: library dependencies to run spark local mode Thu, 04 Feb, 10:51
Valentin Popov     Re: library dependencies to run spark local mode Thu, 04 Feb, 11:08
Valentin Popov     Re: library dependencies to run spark local mode Thu, 04 Feb, 11:12
Arunkumar Pillai [Spark 1.6] Mismatch in kurtosis values Thu, 04 Feb, 11:21
Sean Owen   Re: [Spark 1.6] Mismatch in kurtosis values Thu, 04 Feb, 11:28
Devesh Raj Singh problem in creating function in sparkR for dummy handling Thu, 04 Feb, 11:51
Vishnu Viswanath Question on RDD caching Thu, 04 Feb, 13:58
Yuval.Itzchakov PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 14:56
Shixiong(Ryan) Zhu   Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 18:21
Yuval Itzchakov     Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 19:11
Tathagata Das       Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 19:16
Yuval Itzchakov         Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 19:37
Sachin Aggarwal           Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 19:44
Sachin Aggarwal             Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 19:45
Sachin Aggarwal               Re: PairDStreamFunctions.mapWithState fails in case timeout is set without updating State[S] Thu, 04 Feb, 19:47
Matthias Niehoff Using jar bundled log4j.xml on worker nodes Thu, 04 Feb, 17:06
Ted Yu   Re: Using jar bundled log4j.xml on worker nodes Thu, 04 Feb, 17:20
Matthias Niehoff     Re: Using jar bundled log4j.xml on worker nodes Fri, 05 Feb, 09:40
Flaherty, Frank Spark Cassandra Atomic Inserts Thu, 04 Feb, 17:45
ARUN.BONG...@cognizant.com Memory tuning in spark sql Thu, 04 Feb, 17:48
Ted Yu   Re: Memory tuning in spark sql Thu, 04 Feb, 18:07
Ted Yu     Re: Memory tuning in spark sql Thu, 04 Feb, 18:46
Akhilesh Pathodia Reading large set of files in Spark Thu, 04 Feb, 18:58
Ted Yu   Re: Reading large set of files in Spark Thu, 04 Feb, 19:08
Lin, Hao sc.textFile the number of the workers to parallelize Thu, 04 Feb, 20:04
Takeshi Yamamuro   Re: sc.textFile the number of the workers to parallelize Fri, 05 Feb, 04:41
Koert Kuipers     Re: sc.textFile the number of the workers to parallelize Fri, 05 Feb, 04:47
raj.kumar Dataset Encoders for SparseVector Thu, 04 Feb, 20:22
Michael Armbrust   Re: Dataset Encoders for SparseVector Thu, 04 Feb, 21:09
Re: Broadcast join on multiple dataframes
Srikanth   Re: Broadcast join on multiple dataframes Thu, 04 Feb, 20:54
habitats Recommended storage solution for my setup (~5M items, 10KB pr.) Thu, 04 Feb, 20:58
Ted Yu   Re: Recommended storage solution for my setup (~5M items, 10KB pr.) Thu, 04 Feb, 21:14
Patrick Skjennum     Re: Recommended storage solution for my setup (~5M items, 10KB pr.) Thu, 04 Feb, 21:23
Nick Pentreath       Re: Recommended storage solution for my setup (~5M items, 10KB pr.) Fri, 05 Feb, 05:11
AlexG cause of RPC error? Thu, 04 Feb, 21:34
AlexG   Re: cause of RPC error? Thu, 04 Feb, 21:35
alexeyy3 submit spark job with spcified file for driver Thu, 04 Feb, 22:17
Mohammed Guller   RE: submit spark job with spcified file for driver Thu, 04 Feb, 22:55
Ted Yu   Re: submit spark job with spcified file for driver Thu, 04 Feb, 22:55
SRK Driver not able to restart the job automatically after the application of Streaming with Kafka Direct went down Fri, 05 Feb, 01:30
swetha kasireddy   Re: Driver not able to restart the job automatically after the application of Streaming with Kafka Direct went down Fri, 05 Feb, 16:54
Steve Annessa Unit test with sqlContext Fri, 05 Feb, 01:36
Silvio Fiorito   Re: Unit test with sqlContext Fri, 05 Feb, 04:25
Holden Karau     Re: Unit test with sqlContext Fri, 05 Feb, 04:34
Rishi Mishra       Re: Unit test with sqlContext Fri, 05 Feb, 04:50
Steve Annessa         Re: Unit test with sqlContext Fri, 05 Feb, 19:43
Diwakar Dhanuskodi kafkaDirectStream usage error Fri, 05 Feb, 01:58
Cody Koeninger   Re: kafkaDirectStream usage error Fri, 05 Feb, 16:44
Diwakar Dhanuskodi Kafka directsream receiving rate Fri, 05 Feb, 02:03
Diwakar Dhanuskodi   RE: Kafka directsream receiving rate Fri, 05 Feb, 02:13
Cody Koeninger     Re: Kafka directsream receiving rate Fri, 05 Feb, 16:37
Li Ming Tsai Slowness in Kmeans calculating fastSquaredDistance Fri, 05 Feb, 02:56
Li Ming Tsai   Re: Slowness in Kmeans calculating fastSquaredDistance Sun, 07 Feb, 02:03
Li Ming Tsai   Re: Slowness in Kmeans calculating fastSquaredDistance Wed, 10 Feb, 04:43
Li Ming Tsai Add Singapore meetup Fri, 05 Feb, 03:07
Ruslan Dautkhanov spark.storage.memoryFraction for shuffle-only jobs Fri, 05 Feb, 03:14
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Sep 2021109
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137