spark-user mailing list archives: July 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · Next »Thread · Author · Date
Davies Liu Re: PySpark without PySpark Wed, 08 Jul, 17:36
Davies Liu Re: Language support for Spark libraries Mon, 13 Jul, 23:53
Davies Liu Re: Running foreach on a list of rdds in parallel Thu, 16 Jul, 06:18
Davies Liu Re: pyspark 1.4 udf change date values Thu, 16 Jul, 17:09
Davies Liu Re: Spark and SQL Server Sat, 18 Jul, 07:45
Davies Liu Re: PySpark Nested Json Parsing Mon, 20 Jul, 16:06
Davies Liu Re: PySpark Nested Json Parsing Mon, 20 Jul, 16:07
Davies Liu Re: Spark and SQL Server Mon, 20 Jul, 16:08
Dean Wampler Please add the Chicago Spark Users' Group to the community page Tue, 07 Jul, 02:06
Dean Wampler Re: Breaking lineage and reducing stages in Spark Streaming Thu, 09 Jul, 12:46
Dean Wampler Re: Breaking lineage and reducing stages in Spark Streaming Thu, 09 Jul, 13:36
Dean Wampler Re: Silly question about building Spark 1.4.1 Mon, 20 Jul, 20:05
Dean Wampler Re: Spark Streaming Checkpointing solutions Tue, 21 Jul, 15:50
Dean Wampler Re: Mesos + Spark Wed, 22 Jul, 14:51
Dean Wampler Re: Spark-hive parquet schema evolution Wed, 22 Jul, 15:00
Dean Wampler Re: Programmatically launch several hundred Spark Streams in parallel Fri, 24 Jul, 17:39
Dean Wampler Re: Mesos + Spark Fri, 24 Jul, 21:52
Dean Wampler Re: Mesos + Spark Sat, 25 Jul, 03:01
Dean Wampler Re: Comparison between Standalone mode and YARN mode Mon, 27 Jul, 13:49
Dean Wampler Re: Clustetr setup for SPARK standalone application: Tue, 28 Jul, 13:37
Dean Wampler Re: Multiple operations on same DStream in Spark Streaming Tue, 28 Jul, 13:50
Dean Wampler Re: Spark - Eclipse IDE - Maven Wed, 29 Jul, 16:07
Dean Wampler Re: How to set log level in spark-submit ? Thu, 30 Jul, 12:57
Dean Wampler [POWERED BY] Please add Typesafe to the list of organizations Fri, 31 Jul, 16:29
Debasish Das Re: Subsecond queries possible? Wed, 01 Jul, 16:47
Debasish Das Re: Few basic spark questions Tue, 14 Jul, 14:40
Debasish Das Re: Spark application with a RESTful API Tue, 14 Jul, 16:54
Debasish Das Re: Package Release Annoucement: Spark SQL on HBase "Astro" Thu, 23 Jul, 03:35
Debasish Das RE: Package Release Annoucement: Spark SQL on HBase "Astro" Tue, 28 Jul, 05:01
Debasish Das Re: Package Release Annoucement: Spark SQL on HBase "Astro" Tue, 28 Jul, 07:13
Deepak Jain Re: Efficiency of leftOuterJoin a cassandra rdd Wed, 15 Jul, 06:33
Denny Lee Re: 1.4.0 regression: out-of-memory errors on small data Mon, 06 Jul, 00:59
Denny Lee Re: 1.4.0 regression: out-of-memory errors on small data Mon, 06 Jul, 11:07
Denny Lee Re: Spark SQL queries hive table, real time ? Mon, 06 Jul, 11:21
Denny Lee Re: Please add the Chicago Spark Users' Group to the community page Tue, 07 Jul, 04:30
Denny Lee Re: SQL Server to Spark Thu, 23 Jul, 10:25
Devarajan Srinivasan java.io.IOException: No space left on device--regd. Mon, 06 Jul, 05:14
Devi P.V Count of distinct values in each column Wed, 29 Jul, 13:38
Dibyendu Bhattacharya Some BlockManager Doubts Thu, 09 Jul, 11:17
Dibyendu Bhattacharya Re: spark streaming get kafka individual message's offset and partition no Tue, 28 Jul, 13:03
Diogo B. Friend recommendation using collaborative filtering? Thu, 09 Jul, 19:17
Dirk Nachbar pyspark/py4j tree error Tue, 28 Jul, 08:04
Dmitry Goldenberg Re: Best practice for using singletons on workers (seems unanswered) ? Wed, 08 Jul, 13:05
Dmitry Goldenberg Re: Best practice for using singletons on workers (seems unanswered) ? Wed, 08 Jul, 13:41
Dmitry Goldenberg Re: foreachRDD vs. forearchPartition ? Wed, 08 Jul, 14:18
Dmitry Goldenberg Re: foreachRDD vs. forearchPartition ? Wed, 08 Jul, 15:24
Dmitry Goldenberg Re: foreachRDD vs. forearchPartition ? Wed, 08 Jul, 15:25
Dmitry Goldenberg Re: Best practice for using singletons on workers (seems unanswered) ? Wed, 08 Jul, 22:16
Dmitry Goldenberg Re: What is a best practice for passing environment variables to Spark workers? Fri, 10 Jul, 12:34
Dmitry Goldenberg Checkpointing doesn't appear to be working for direct streaming from Kafka Fri, 31 Jul, 17:16
Dmitry Goldenberg Re: Checkpointing doesn't appear to be working for direct streaming from Kafka Fri, 31 Jul, 17:55
Dmitry Goldenberg Re: Checkpointing doesn't appear to be working for direct streaming from Kafka Fri, 31 Jul, 18:34
Dogtail Ray How to build Spark with my own version of Hadoop? Wed, 22 Jul, 03:11
Dogtail Ray Comparison between Standalone mode and YARN mode Wed, 22 Jul, 23:56
Doug Balog Re: Local Repartition Mon, 20 Jul, 13:17
Edmon Begoli Small-cluster deployment modes Sat, 25 Jul, 02:00
Eduardo Spark Standalone Mode not working in a cluster Sun, 12 Jul, 23:04
Eduardo Re: Spark Standalone Mode not working in a cluster Mon, 13 Jul, 13:02
Edward Sargisson Experience with centralised logging for Spark? Fri, 03 Jul, 18:34
Elkhan Dadashov Re: Pyspark not working on yarn-cluster mode Fri, 10 Jul, 17:02
Elkhan Dadashov Does Spark driver talk to NameNode directly or Yarn Resource Manager talks to NameNode to know the nodes which has required input blocks and informs Spark Driver ? (for launching Executors on nodes which has required input data blocks) Mon, 13 Jul, 17:10
Elkhan Dadashov Re: Does Spark driver talk to NameNode directly or Yarn Resource Manager talks to NameNode to know the nodes which has required input blocks and informs Spark Driver ? (for launching Executors on nodes which has required input data blocks) Mon, 13 Jul, 22:54
Elkhan Dadashov ProcessBuilder in SparkLauncher is memory inefficient for launching new process Tue, 14 Jul, 16:39
Elkhan Dadashov Why does SparkSubmit process takes so much virtual memory in yarn-cluster mode ? Tue, 14 Jul, 16:53
Elkhan Dadashov Re: Why does SparkSubmit process takes so much virtual memory in yarn-cluster mode ? Tue, 14 Jul, 22:42
Elkhan Dadashov Has anyone run Python Spark application on Yarn-cluster mode ? (which has 3rd party Python modules (i.e., numpy) to be shipped with) Fri, 17 Jul, 18:23
Elkhan Dadashov Re: Command builder problem when running worker in Windows Fri, 17 Jul, 22:00
Elkhan Dadashov Re: Command builder problem when running worker in Windows Fri, 17 Jul, 22:35
Elkhan Dadashov Re: Command builder problem when running worker in Windows Fri, 17 Jul, 22:54
Elkhan Dadashov [ Potential bug ] Spark terminal logs say that job has succeeded even though job has failed in Yarn cluster mode Thu, 23 Jul, 23:43
Elkhan Dadashov Re: [ Potential bug ] Spark terminal logs say that job has succeeded even though job has failed in Yarn cluster mode Mon, 27 Jul, 18:11
Elkhan Dadashov Re: [ Potential bug ] Spark terminal logs say that job has succeeded even though job has failed in Yarn cluster mode Tue, 28 Jul, 18:17
Elkhan Dadashov Re: [ Potential bug ] Spark terminal logs say that job has succeeded even though job has failed in Yarn cluster mode Tue, 28 Jul, 19:10
Elkhan Dadashov Re: [ Potential bug ] Spark terminal logs say that job has succeeded even though job has failed in Yarn cluster mode Tue, 28 Jul, 19:23
Elkhan Dadashov Re: [ Potential bug ] Spark terminal logs say that job has succeeded even though job has failed in Yarn cluster mode Tue, 28 Jul, 20:44
Elkhan Dadashov Re: SparkLauncher not notified about finished job - hangs infinitely. Fri, 31 Jul, 17:02
Elkhan Dadashov Re: SparkLauncher not notified about finished job - hangs infinitely. Fri, 31 Jul, 17:13
Emmanuel Spark Streaming Checkpointing solutions Tue, 21 Jul, 15:43
Emmanuel Fortin Re: Spark Streaming Checkpointing solutions Tue, 21 Jul, 16:34
Enno Shioji Re: Twitter4J streaming question Thu, 23 Jul, 20:17
Enno Shioji Re: Twitter4J streaming question Thu, 23 Jul, 20:29
Enno Shioji Re: Twitter streaming with apache spark stream only a small amount of tweets Wed, 29 Jul, 18:23
Eric Friedman KMeans questions Thu, 02 Jul, 00:53
Eric Friedman projection optimization? Tue, 28 Jul, 14:47
Eric Pederson Re: Subsecond queries possible? Wed, 01 Jul, 02:29
Eric Pederson Re: Subsecond queries possible? Wed, 01 Jul, 23:02
Eric Pederson Re: Error when connecting to Spark SQL via Hive JDBC driver Tue, 07 Jul, 15:35
Eric Pederson Communication between driver, cluster and HiveServer Wed, 08 Jul, 18:27
Eric Pederson Re: Communication between driver, cluster and HiveServer Thu, 09 Jul, 00:46
Erik Erlandson Re: Spark serialization in closure Thu, 09 Jul, 16:11
Eskilson,Aleksander User Defined Functions - Execution on Clusters Mon, 06 Jul, 19:55
Eskilson,Aleksander Re: User Defined Functions - Execution on Clusters Tue, 07 Jul, 12:42
Eskilson,Aleksander Re: Broadcast variables in R Mon, 20 Jul, 21:12
Eskilson,Aleksander PySpark MLlib Numpy Dependency Tue, 28 Jul, 14:34
Eugen Cepoi Re: map vs foreach for sending data to external system Thu, 02 Jul, 16:37
Eugen Cepoi Re: map vs foreach for sending data to external system Thu, 02 Jul, 17:07
Eugene Morozov Kryo Serializer on Worker doesn't work by default. Wed, 08 Jul, 14:40
Eugene Morozov Re: Kryo Serializer on Worker doesn't work by default. Wed, 08 Jul, 15:25
Eugene Morozov Re: Sorted Multiple Outputs Wed, 15 Jul, 13:04
Eugene Morozov Re: spark 1.3.1 : unable to access s3n:// urls (no file system for scheme s3n:) Wed, 22 Jul, 20:22
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · Next »Thread · Author · Date
Box list
Sep 202071
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137