spark-user mailing list archives: June 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Sergio Jiménez Barrio Job with spark Wed, 17 Jun, 12:24
Ashish Soni Twitter Heron: Stream Processing at Scale - Does Spark Address all the issues Wed, 17 Jun, 12:47
V Dineshkumar Is HiveContext Thread Safe? Wed, 17 Jun, 13:43
Cheng, Hao   RE: Is HiveContext Thread Safe? Wed, 17 Jun, 13:49
Corey Nolet Using spark.hadoop.* to set Hadoop properties Wed, 17 Jun, 14:03
Re: Loading lots of parquet files into dataframe from s3
arnonrgo   Re: Loading lots of parquet files into dataframe from s3 Wed, 17 Jun, 14:57
lovelylavs   Re: Loading lots of parquet files into dataframe from s3 Thu, 18 Jun, 15:19
jcai Web UI vs History Server Bugs Wed, 17 Jun, 18:10
Akhil Das   Re: Web UI vs History Server Bugs Thu, 18 Jun, 09:48
Steve Loughran   Re: Web UI vs History Server Bugs Sat, 20 Jun, 10:47
Jonathon Cai     Re: Web UI vs History Server Bugs Mon, 22 Jun, 15:37
Steve Loughran       Re: Web UI vs History Server Bugs Mon, 22 Jun, 18:22
Evo Eftimov         RE: Web UI vs History Server Bugs Tue, 23 Jun, 09:59
Re: Can we increase the space of spark standalone cluster
maxdml   Re: Can we increase the space of spark standalone cluster Wed, 17 Jun, 18:37
maxdml     Re: Can we increase the space of spark standalone cluster Wed, 17 Jun, 18:41
Michal Čizmazia Serial batching with Spark Streaming Wed, 17 Jun, 19:22
Tathagata Das   Re: Serial batching with Spark Streaming Wed, 17 Jun, 21:25
Michal Čizmazia     Re: Serial batching with Spark Streaming Thu, 18 Jun, 17:49
Binh Nguyen Van       Re: Serial batching with Spark Streaming Thu, 18 Jun, 18:29
Michal Čizmazia         Re: Serial batching with Spark Streaming Thu, 18 Jun, 20:55
Michal Čizmazia         Re: Serial batching with Spark Streaming Fri, 19 Jun, 18:33
Tathagata Das           Re: Serial batching with Spark Streaming Fri, 19 Jun, 20:58
Michal Čizmazia             Re: Serial batching with Spark Streaming Fri, 19 Jun, 22:16
Tathagata Das               Re: Serial batching with Spark Streaming Sat, 20 Jun, 21:21
Michal Čizmazia                 Re: Serial batching with Spark Streaming Sat, 20 Jun, 22:00
Hive query execution from Spark(through HiveContext) failing with Apache Sentry
Nitin kak   Hive query execution from Spark(through HiveContext) failing with Apache Sentry Wed, 17 Jun, 19:47
ayan guha     Re: Hive query execution from Spark(through HiveContext) failing with Apache Sentry Wed, 17 Jun, 23:18
Nitin kak       Re: Hive query execution from Spark(through HiveContext) failing with Apache Sentry Wed, 17 Jun, 23:54
Nitin kak         Re: Hive query execution from Spark(through HiveContext) failing with Apache Sentry Fri, 19 Jun, 18:34
Nitin kak           Re: Hive query execution from Spark(through HiveContext) failing with Apache Sentry Mon, 22 Jun, 16:07
Nitin kak       Re: Hive query execution from Spark(through HiveContext) failing with Apache Sentry Thu, 18 Jun, 00:12
nitinkak001   Hive query execution from Spark(through HiveContext) failing with Apache Sentry Wed, 17 Jun, 21:24
Ajay     Re: Hive query execution from Spark(through HiveContext) failing with Apache Sentry Wed, 17 Jun, 22:11
pawel.jurczenko Shuffled vs non-shuffled coalesce in Apache Spark Wed, 17 Jun, 20:30
Re: MLLib: instance weight
Xiangrui Meng   Re: MLLib: instance weight Wed, 17 Jun, 21:54
Corey Nolet Executor memory allocations Wed, 17 Jun, 22:02
Richard Marscher   Re: Executor memory allocations Thu, 18 Jun, 14:07
Re: Parallel parameter tuning: distributed execution of MLlib algorithms
Xiangrui Meng   Re: Parallel parameter tuning: distributed execution of MLlib algorithms Wed, 17 Jun, 22:58
Peter Rudenko     Re: Parallel parameter tuning: distributed execution of MLlib algorithms Wed, 17 Jun, 23:22
Re: Collabrative Filtering
Xiangrui Meng   Re: Collabrative Filtering Wed, 17 Jun, 23:03
Re: Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0
Xiangrui Meng   Re: Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0 Wed, 17 Jun, 23:06
Justin Yip     Re: Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0 Thu, 18 Jun, 00:56
Re: spark mlib variance analysis
Xiangrui Meng   Re: spark mlib variance analysis Wed, 17 Jun, 23:10
Reading maprfs from Spark
Bikrant Neupane   Reading maprfs from Spark Wed, 17 Jun, 23:25
B Neupane   Reading maprfs from Spark Wed, 17 Jun, 23:54
Sweeney, Matt deployment options for Spark and YARN w/ many app jar library dependencies Wed, 17 Jun, 23:47
Sandy Ryza   Re: deployment options for Spark and YARN w/ many app jar library dependencies Thu, 18 Jun, 00:00
Sweeney, Matt   Re: deployment options for Spark and YARN w/ many app jar library dependencies Thu, 18 Jun, 11:30
Sean Bollin Where are my log4j or exception output on EMR? Thu, 18 Jun, 00:24
Bozeman, Christopher   RE: Where are my log4j or exception output on EMR? Thu, 18 Jun, 03:35
Elkhan Dadashov Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ? Thu, 18 Jun, 00:29
Corey Nolet   Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ? Thu, 18 Jun, 00:51
Elkhan Dadashov     Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ? Thu, 18 Jun, 01:01
Guru Medasani       Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ? Thu, 18 Jun, 02:44
Corey Nolet       Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ? Thu, 18 Jun, 19:13
Matt Forbes Union of many RDDs taking a long time Thu, 18 Jun, 00:53
Tomasz Fruboes   Re: Union of many RDDs taking a long time Mon, 29 Jun, 10:07
Nathan McCarthy Spark SQL DATE_ADD function - Spark 1.3.1 & 1.4.0 Thu, 18 Jun, 01:05
Mike Fang understanding on the "waiting batches" and "scheduling delay" in Streaming UI Thu, 18 Jun, 01:59
Akhil Das   Re: understanding on the "waiting batches" and "scheduling delay" in Streaming UI Thu, 18 Jun, 10:05
Tathagata Das     Re: understanding on the "waiting batches" and "scheduling delay" in Streaming UI Fri, 19 Jun, 01:48
Mike Fang       Re: understanding on the "waiting batches" and "scheduling delay" in Streaming UI Tue, 23 Jun, 08:43
Fang, Mike     Re: understanding on the "waiting batches" and "scheduling delay" in Streaming UI Mon, 22 Jun, 13:24
Issue with PySpark UDF on a column of Vectors
Colin Alstad   Issue with PySpark UDF on a column of Vectors Thu, 18 Jun, 02:47
calstad   Issue with PySpark UDF on a column of Vectors Thu, 18 Jun, 13:41
Xiangrui Meng     Re: Issue with PySpark UDF on a column of Vectors Thu, 18 Jun, 16:29
Shiyao Ma Why does driver transfer application jar to executors? Thu, 18 Jun, 02:48
Jeff Zhang   Re: Why does driver transfer application jar to executors? Thu, 18 Jun, 03:18
Dick Davies   Re: Why does driver transfer application jar to executors? Thu, 18 Jun, 07:29
Nipun Arora Iterative Programming by keeping data across micro-batches in spark-streaming? Thu, 18 Jun, 02:51
Silvio Fiorito   Re: Iterative Programming by keeping data across micro-batches in spark-streaming? Thu, 18 Jun, 02:52
Nipun Arora     Re: Iterative Programming by keeping data across micro-batches in spark-streaming? Thu, 18 Jun, 03:15
afarahat Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 03:15
Ganelin, Ilya   RE: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 04:00
Nick Pentreath     RE: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 05:13
Sabarish Sasidharan       Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 05:35
Ayman Farahat         Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 15:20
Debasish Das           Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 15:38
Debasish Das             Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 15:40
Debasish Das               Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 15:42
Ayman Farahat                 Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 18:54
Nick Pentreath                   Re: Matrix Multiplication and mllib.recommendation Thu, 18 Jun, 19:41
Ayman Farahat                 Re: Matrix Multiplication and mllib.recommendation Sat, 27 Jun, 18:03
Ilya Ganelin                   Re: Matrix Multiplication and mllib.recommendation Sun, 28 Jun, 15:24
Ilya Ganelin                     Re: Matrix Multiplication and mllib.recommendation Sun, 28 Jun, 15:26
Ayman Farahat                     Re: Matrix Multiplication and mllib.recommendation Sun, 28 Jun, 15:34
Ilya Ganelin                       Re: Matrix Multiplication and mllib.recommendation Sun, 28 Jun, 15:40
bhavyateja Pyspark combination Thu, 18 Jun, 04:10
bhavyateja Pyspark RDD search Thu, 18 Jun, 04:16
ayan guha   Re: Pyspark RDD search Thu, 18 Jun, 08:21
Pa Rö benchmark my application on hadoop cluster Thu, 18 Jun, 08:59
texol Machine Learning on GraphX Thu, 18 Jun, 09:03
Akhil Das   Re: Machine Learning on GraphX Thu, 18 Jun, 09:19
Timothée Rebours     Re: Machine Learning on GraphX Thu, 18 Jun, 09:43
andy petrella       Re: Machine Learning on GraphX Thu, 18 Jun, 09:50
Evo Eftimov       RE: Machine Learning on GraphX Thu, 18 Jun, 09:54
Fwd: mllib from sparkR
Elena Scardovi   Fwd: mllib from sparkR Thu, 18 Jun, 10:11
Nipun Arora [Spark Streaming] Iterative programming on an ordered spark stream using Java? Thu, 18 Jun, 10:36
twinkle sachdeva   Re: [Spark Streaming] Iterative programming on an ordered spark stream using Java? Thu, 18 Jun, 15:26
Nipun Arora     Re: [Spark Streaming] Iterative programming on an ordered spark stream using Java? Thu, 18 Jun, 15:40
Nipun Arora       Re: [Spark Streaming] Iterative programming on an ordered spark stream using Java? Thu, 18 Jun, 15:51
Ralph Bergmann connect mobile app with Spark backend Thu, 18 Jun, 11:03
Akhil Das   Re: connect mobile app with Spark backend Thu, 18 Jun, 12:25
Groupme Got the exception when joining RDD with spark streamRDD Thu, 18 Jun, 11:25
Davies Liu   Re: Got the exception when joining RDD with spark streamRDD Thu, 18 Jun, 18:06
Guillaume Pitel Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 11:36
Eugen Cepoi   Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 12:07
Guillaume Pitel     Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 12:27
Eugen Cepoi       Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 13:14
Guillaume Pitel         Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 13:17
Eugen Cepoi           Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 13:32
Eugen Cepoi             Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Thu, 18 Jun, 13:34
Guillaume Pitel             Re: Accumulators / Accumulables : thread-local, task-local, executor-local ? Tue, 23 Jun, 21:26
abellet Best way to randomly distribute elements Thu, 18 Jun, 11:37
Guillaume Pitel   Re: Best way to randomly distribute elements Thu, 18 Jun, 11:59
ayan guha     Re: Best way to randomly distribute elements Thu, 18 Jun, 12:07
Himanshu Mehra   Re: Best way to randomly distribute elements Thu, 18 Jun, 13:02
abellet     Re: Best way to randomly distribute elements Fri, 19 Jun, 12:39
Bartek Radziszewski kafka spark streaming working example Thu, 18 Jun, 12:29
Akhil Das   Re: kafka spark streaming working example Thu, 18 Jun, 12:37
Klaus Schaefers Spark and Google Cloud Storage Thu, 18 Jun, 13:31
Nick Pentreath   Re: Spark and Google Cloud Storage Thu, 18 Jun, 13:35
Re: Spark-sql(yarn-client) java.lang.NoClassDefFoundError: org/apache/spark/deploy/yarn/ExecutorLauncher
Yin Huai   Re: Spark-sql(yarn-client) java.lang.NoClassDefFoundError: org/apache/spark/deploy/yarn/ExecutorLauncher Thu, 18 Jun, 15:20
Sea   Spark-sql(yarn-client) java.lang.NoClassDefFoundError: org/apache/spark/deploy/yarn/ExecutorLauncher Fri, 19 Jun, 02:05
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
Oct 2020186
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137