spark-user mailing list archives: February 2016

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · Next »Thread · Author · Date
aafri Spark Streaming:Could not compute split Tue, 02 Feb, 09:30
Игорь Ляхов Re: How to train and predict in parallel via Spark MLlib? Thu, 18 Feb, 14:47
أنس الليثي Re: Apache Spark data locality when integrating with Kafka Sun, 07 Feb, 20:37
刘虓 Re: Restrictions on SQL operations on Spark temporary tables Sat, 27 Feb, 14:15
Jan Štěrba Running executors missing in sparkUI Thu, 25 Feb, 12:28
Jan Štěrba Re: Running executors missing in sparkUI Thu, 25 Feb, 16:50
Jan Štěrba Re: [Help]: DataframeNAfunction fill method throwing exception Fri, 26 Feb, 07:15
Michał Zieliński Re: Inserting column to DataFrame Thu, 11 Feb, 10:53
Michał Zieliński Re: Checking for null values when mapping Sat, 20 Feb, 08:59
Michał Zieliński Re: How to get the code for class in spark Sat, 20 Feb, 09:01
Michał Zieliński Re: Using functional programming rather than SQL Tue, 23 Feb, 07:36
Michał Zieliński Re: Performing multiple aggregations over the same data Wed, 24 Feb, 06:40
Michał Zieliński Re: How to Exploding a Map[String,Int] column in a DataFrame (Scala) Thu, 25 Feb, 00:05
Michał Zieliński Re: Spark SQL support for sub-queries Fri, 26 Feb, 09:42
Michał Zieliński Re: Spark SQL support for sub-queries Fri, 26 Feb, 09:54
Michał Zieliński Re: Recommendation for a good book on Spark, beginner to moderate knowledge Sun, 28 Feb, 21:53
Michał Zieliński Re: Flattening Data within DataFrames Mon, 29 Feb, 17:40
Fabian Böhnlein Scala types to StructType Thu, 11 Feb, 14:20
Fabian Böhnlein Re: Scala types to StructType Mon, 15 Feb, 08:09
Fabian Böhnlein PySpark Pickle reading does not find module Tue, 23 Feb, 09:45
Iulian Dragoș Re: Memory problems and missing heartbeats Tue, 16 Feb, 14:14
Iulian Dragoș Re: Spark runs only on Mesos v0.21? Tue, 16 Feb, 14:26
Johannes Haaß How to add a typesafe config file which is located on HDFS to spark-submit (cluster-mode)? Tue, 23 Feb, 07:42
Jorge Sánchez Re: an error when I read data from parquet Mon, 22 Feb, 15:26
Martin Skøtt Frustration over Spark and Jackson Tue, 16 Feb, 17:08
Zsolt Tóth Inserting column to DataFrame Thu, 11 Feb, 10:12
Zsolt Tóth Re: Inserting column to DataFrame Fri, 12 Feb, 10:45
Zsolt Tóth Re: Inserting column to DataFrame Fri, 12 Feb, 12:25
Sea 回复: Shuffle memory woes Sun, 07 Feb, 14:28
Sea 回复:off-heap certain operations Fri, 12 Feb, 07:06
Sea Deadlock between UnifiedMemoryManager and BlockManager Mon, 29 Feb, 12:48
陈宇航 Kafka partition increased while Spark Streaming is running Wed, 24 Feb, 08:15
开心延年 a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 11:14
开心延年 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 12:27
开心延年 回复: 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 14:03
开心延年 回复: 回复: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 14:12
平平 回复:a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 11:46
沈阳延云云计算 回复:a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 11:47
zml张明磊 Is there some open source tools which implements draggable widget and make the app runing in a form of DAG ? Tue, 02 Feb, 04:57
Jörn Franke Re: how to introduce spark to your colleague if he has no background about *** spark related Mon, 01 Feb, 06:35
Jörn Franke Re: Spark with SAS Wed, 03 Feb, 18:09
Jörn Franke Re: Handling Hive Table With large number of rows Mon, 08 Feb, 06:23
Jörn Franke Re: How to parallel read files in a directory Fri, 12 Feb, 11:25
Jörn Franke Re: Unrecognized VM option 'MaxPermSize=512M' Sat, 13 Feb, 16:23
Jörn Franke Re: Best practises of share Spark cluster over few applications Sat, 13 Feb, 17:38
Jörn Franke Re: Stored proc with spark Tue, 16 Feb, 09:42
Jörn Franke Re: Concurreny does not improve for Spark Jobs with Same Spark Context Fri, 19 Feb, 06:36
Jörn Franke Re: Spark JDBC connection - data writing success or failure cases Fri, 19 Feb, 08:25
Jörn Franke Re: Spark on Windows platform Mon, 29 Feb, 13:34
Pavel Sýkora Spark 1.5 Streaming + Kafka 0.9.0 Wed, 03 Feb, 15:56
@Sanjiv Singh Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 03:27
@Sanjiv Singh Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 03:57
@Sanjiv Singh Re: Spark SQL is not returning records for hive bucketed tables on HDP Mon, 22 Feb, 06:09
@Sanjiv Singh Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 06:27
@Sanjiv Singh Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 07:05
@Sanjiv Singh Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 08:45
@Sanjiv Singh Re: Spark SQL is not returning records for hive bucketed tables on HDP Tue, 23 Feb, 09:19
ARUN.BONG...@cognizant.com Memory tuning in spark sql Thu, 04 Feb, 17:48
ARUN.BONG...@cognizant.com RE: Spark execuotr Memory profiling Thu, 11 Feb, 16:08
ARUN.BONG...@cognizant.com Memory issues on spark Thu, 18 Feb, 01:02
Abhishek Anand Re: Repartition taking place for all previous windows even after checkpointing Mon, 01 Feb, 10:31
Abhishek Anand Stateful Operation on JavaPairDStream Help Needed !! Thu, 11 Feb, 20:40
Abhishek Anand Re: Stateful Operation on JavaPairDStream Help Needed !! Sat, 13 Feb, 20:05
Abhishek Anand Re: Worker's BlockManager Folder not getting cleared Sun, 14 Feb, 07:04
Abhishek Anand Re: Stateful Operation on JavaPairDStream Help Needed !! Mon, 15 Feb, 17:38
Abhishek Anand Saving Kafka Offsets to Cassandra at begining of each batch in Spark Streaming Tue, 16 Feb, 07:15
Abhishek Anand Re: Saving Kafka Offsets to Cassandra at begining of each batch in Spark Streaming Wed, 17 Feb, 06:25
Abhishek Anand Spark Streaming with Kafka Use Case Wed, 17 Feb, 06:57
Abhishek Anand Re: Worker's BlockManager Folder not getting cleared Wed, 17 Feb, 08:58
Abhishek Anand Re: Stateful Operation on JavaPairDStream Help Needed !! Mon, 22 Feb, 13:47
Abhishek Anand java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Mon, 22 Feb, 14:12
Abhishek Anand Re: Stateful Operation on JavaPairDStream Help Needed !! Mon, 22 Feb, 20:25
Abhishek Anand Query Kafka Partitions from Spark SQL Tue, 23 Feb, 12:52
Abhishek Anand Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Fri, 26 Feb, 07:51
Abhishek Anand Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Sat, 27 Feb, 07:05
Abhishek Anand Re: Stateful Operation on JavaPairDStream Help Needed !! Sat, 27 Feb, 21:17
Abhishek Anand Re: java.io.IOException: java.lang.reflect.InvocationTargetException on new spark machines Mon, 29 Feb, 09:34
Abhishek Anand Re: Stateful Operation on JavaPairDStream Help Needed !! Mon, 29 Feb, 09:39
Abhishek Modi Abnormally large deserialisation time for some tasks Tue, 16 Feb, 08:50
Abhishek Modi Unusually large deserialisation time Tue, 16 Feb, 09:12
Abhishek Modi Re: Re: Unusually large deserialisation time Tue, 16 Feb, 17:49
Abhishek Modi Re: Re: Unusually large deserialisation time Tue, 16 Feb, 17:50
Abhisheks Re: Left/Right Outer join on multiple Columns Mon, 22 Feb, 20:41
Abhisheks Re: Left/Right Outer join on multiple Columns Wed, 24 Feb, 20:05
Ajay Gupta Spark UI documentaton needed Tue, 23 Feb, 02:54
Ajinkya Kale Re: Logistic Regression using ML Pipeline Fri, 19 Feb, 08:41
Akhil Das Re: Need help :Does anybody has HDP cluster on EC2? Mon, 15 Feb, 08:37
Akhil Das Re: Need help :Does anybody has HDP cluster on EC2? Mon, 15 Feb, 09:04
Akhil Das Re: How to start spark streaming application with recent past timestamp for replay of old batches? Mon, 22 Feb, 07:53
Akhil Das Re: [Example] : read custom schema from file Mon, 22 Feb, 10:18
Akhil Das Re: Sample project on Image Processing Mon, 22 Feb, 11:08
Akhil Das Re: a new FileFormat 5x~100x faster than parquet Mon, 22 Feb, 12:12
Akhilesh Pathodia Reading large set of files in Spark Thu, 04 Feb, 18:58
Aleksandr Modestov Re: Scala from Jupyter Tue, 16 Feb, 12:43
Alex Dzhagriev cartesian with Dataset Wed, 17 Feb, 09:08
Alex Dzhagriev Re: Importing csv files into Hive ORC target table Wed, 17 Feb, 22:58
Alex Dzhagriev Re: Importing csv files into Hive ORC target table Thu, 18 Feb, 21:00
Alex Dzhagriev an OOM while persist as DISK_ONLY Mon, 22 Feb, 14:12
Alex Dzhagriev Re: Can we load csv partitioned data into one DF? Mon, 22 Feb, 15:32
Alex Dzhagriev reasonable number of executors Tue, 23 Feb, 14:49
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · Next »Thread · Author · Date
Box list
Oct 201948
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137