spark-user mailing list archives: September 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
gtinside flattening a list in spark sql Tue, 02 Sep, 20:26
Michael Armbrust   Re: flattening a list in spark sql Tue, 02 Sep, 22:21
gtinside     Re: flattening a list in spark sql Wed, 03 Sep, 01:35
Michael Armbrust       Re: flattening a list in spark sql Wed, 03 Sep, 03:37
gtinside         Re: flattening a list in spark sql Wed, 10 Sep, 15:30
gtinside           Re: flattening a list in spark sql Wed, 10 Sep, 16:19
Re: Spark Streaming with Kafka, building project with 'sbt assembly' is extremely slow
Daniil Osipov   Re: Spark Streaming with Kafka, building project with 'sbt assembly' is extremely slow Tue, 02 Sep, 21:13
Aris     Re: Spark Streaming with Kafka, building project with 'sbt assembly' is extremely slow Thu, 04 Sep, 20:46
Matt Narrell       Re: Spark Streaming with Kafka, building project with 'sbt assembly' is extremely slow Mon, 08 Sep, 16:58
cjwang Creating an RDD in another RDD causes deadlock Tue, 02 Sep, 21:14
Sean Owen   Re: Creating an RDD in another RDD causes deadlock Tue, 02 Sep, 21:17
cjwang     Re: Creating an RDD in another RDD causes deadlock Tue, 02 Sep, 21:27
I am looking for a Java sample of a Partitioner
Steve Lewis   I am looking for a Java sample of a Partitioner Tue, 02 Sep, 21:27
Steve Lewis   I am looking for a Java sample of a Partitioner Tue, 02 Sep, 23:18
salemi Spark Streaming - how to implement multiple calculation using the same data set Tue, 02 Sep, 21:54
Tobias Pfeiffer   Re: Spark Streaming - how to implement multiple calculation using the same data set Wed, 03 Sep, 02:05
Alireza Salemi     Re: Spark Streaming - how to implement multiple calculation using the same data set Wed, 03 Sep, 03:36
RE: [Streaming] Akka-based receiver with messages defined in uploaded jar
Anton Brazhnyk   RE: [Streaming] Akka-based receiver with messages defined in uploaded jar Tue, 02 Sep, 22:54
Tathagata Das     Re: [Streaming] Akka-based receiver with messages defined in uploaded jar Tue, 02 Sep, 23:31
Re: [PySpark] large # of partitions causes OOM
Matthew Farrellee   Re: [PySpark] large # of partitions causes OOM Wed, 03 Sep, 00:12
Tao Xiao What is the appropriate privileges needed for writting files into checkpoint directory? Wed, 03 Sep, 02:28
Tao Xiao   Re: What is the appropriate privileges needed for writting files into checkpoint directory? Thu, 04 Sep, 01:25
Deep Pradhan Number of elements in ArrayBuffer Wed, 03 Sep, 04:43
Madabhattula Rajesh Kumar   Re: Number of elements in ArrayBuffer Wed, 03 Sep, 04:55
Deep Pradhan     Re: Number of elements in ArrayBuffer Wed, 03 Sep, 05:42
Sean Owen       Re: Number of elements in ArrayBuffer Wed, 03 Sep, 08:12
gavin zhang Memcached error when using during map Wed, 03 Sep, 08:13
Jianshi Huang .sparkrc for Spark shell? Wed, 03 Sep, 08:47
Prashant Sharma   Re: .sparkrc for Spark shell? Wed, 03 Sep, 11:05
Dimension Data, LLC.     Re: .sparkrc for Spark shell? Thu, 04 Sep, 05:36
Jianshi Huang     Re: .sparkrc for Spark shell? Thu, 04 Sep, 08:34
rapelly kartheek RDDs Wed, 03 Sep, 09:02
Tobias Pfeiffer   Re: RDDs Thu, 04 Sep, 00:55
Liu, Raymond   RE: RDDs Thu, 04 Sep, 02:03
Kartheek.R     RE: RDDs Thu, 04 Sep, 05:23
Liu, Raymond       RE: RDDs Thu, 04 Sep, 06:08
rapelly kartheek         Fwd: RDDs Thu, 04 Sep, 06:24
Tathagata Das         Re: RDDs Thu, 04 Sep, 06:27
Kartheek.R   Re: RDDs Thu, 04 Sep, 10:35
Samay SparkSQL TPC-H query 3 joining multiple tables Wed, 03 Sep, 09:12
Michael Armbrust   Re: SparkSQL TPC-H query 3 joining multiple tables Wed, 03 Sep, 17:16
Dominik Hübner Exchanging data between pyspark and scala Wed, 03 Sep, 09:42
Re: Invalid Class Exception
niranda   Re: Invalid Class Exception Wed, 03 Sep, 10:00
oppokui Support R in Spark Wed, 03 Sep, 10:19
oppokui   Re: Support R in Spark Thu, 04 Sep, 04:24
Shivaram Venkataraman     Re: Support R in Spark Thu, 04 Sep, 17:58
oppokui       Re: Support R in Spark Sat, 06 Sep, 09:53
oppokui         Re: Support R in Spark Thu, 18 Sep, 14:49
Shivaram Venkataraman           Re: Support R in Spark Thu, 18 Sep, 16:58
oppokui             Re: Support R in Spark Fri, 19 Sep, 14:59
Christopher Nguyen       Re: Support R in Spark Sat, 06 Sep, 12:08
oppokui         Re: Support R in Spark Sat, 06 Sep, 17:44
Christopher Nguyen           Re: Support R in Spark Sat, 06 Sep, 20:50
Jianshi Huang How to list all registered tables in a sql context? Wed, 03 Sep, 11:03
Jianshi Huang   Re: How to list all registered tables in a sql context? Fri, 05 Sep, 16:40
Tobias Pfeiffer     Re: How to list all registered tables in a sql context? Mon, 08 Sep, 01:28
Jianshi Huang       Re: How to list all registered tables in a sql context? Mon, 08 Sep, 06:53
godraude parsing json in spark streaming Wed, 03 Sep, 11:52
Kevin Jung How to clear broadcast variable from driver memory? Wed, 03 Sep, 11:56
Andrew Or   Re: How to clear broadcast variable from driver memory? Wed, 03 Sep, 21:28
Oleg Ruchovets pyspark on yarn hdp hortonworks Wed, 03 Sep, 12:03
Andrew Or   Re: pyspark on yarn hdp hortonworks Wed, 03 Sep, 21:19
Greg Hill   Re: pyspark on yarn hdp hortonworks Fri, 05 Sep, 19:22
laxmanvemula Message Passing among workers Wed, 03 Sep, 14:28
Evan R. Sparks   Re: Message Passing among workers Wed, 03 Sep, 15:38
Re: [GraphX] how to set memory configurations to avoid OutOfMemoryError "GC overhead limit exceeded"
Yifan LI   Re: [GraphX] how to set memory configurations to avoid OutOfMemoryError "GC overhead limit exceeded" Wed, 03 Sep, 15:58
Ankur Dave     Re: [GraphX] how to set memory configurations to avoid OutOfMemoryError "GC overhead limit exceeded" Wed, 03 Sep, 20:42
Yifan LI       Re: [GraphX] how to set memory configurations to avoid OutOfMemoryError "GC overhead limit exceeded" Fri, 05 Sep, 10:13
Ankur Dave         Re: [GraphX] how to set memory configurations to avoid OutOfMemoryError "GC overhead limit exceeded" Tue, 09 Sep, 06:28
Daniel, Ronald (ELS-SDG) Accessing neighboring elements in an RDD Wed, 03 Sep, 17:33
Victor Tso-Guillen   Re: Accessing neighboring elements in an RDD Wed, 03 Sep, 17:40
Chris Gore     Re: Accessing neighboring elements in an RDD Wed, 03 Sep, 17:53
Daniel, Ronald (ELS-SDG)     RE: Accessing neighboring elements in an RDD Wed, 03 Sep, 18:30
Xiangrui Meng       Re: Accessing neighboring elements in an RDD Wed, 03 Sep, 20:19
Daniel, Ronald (ELS-SDG)         RE: Accessing neighboring elements in an RDD Wed, 03 Sep, 21:53
Re: Low Level Kafka Consumer for Spark
Dibyendu Bhattacharya   Re: Low Level Kafka Consumer for Spark Wed, 03 Sep, 17:38
Tathagata Das     Re: Low Level Kafka Consumer for Spark Fri, 05 Sep, 17:44
Dibyendu Bhattacharya       Re: Low Level Kafka Consumer for Spark Sun, 07 Sep, 18:38
Dibyendu Bhattacharya         Re: Low Level Kafka Consumer for Spark Wed, 10 Sep, 16:12
Alon Pe'er         Re: Low Level Kafka Consumer for Spark Mon, 15 Sep, 11:18
Dibyendu Bhattacharya           Re: Low Level Kafka Consumer for Spark Mon, 15 Sep, 11:33
Tim Smith             Re: Low Level Kafka Consumer for Spark Mon, 15 Sep, 17:03
Dibyendu Bhattacharya               Re: Low Level Kafka Consumer for Spark Mon, 15 Sep, 17:24
Tim Smith       Re: Low Level Kafka Consumer for Spark Mon, 08 Sep, 23:32
Zhanfeng Huo How can I start history-server with kerberos HDFS ? Wed, 03 Sep, 18:00
Marcelo Vanzin   Re: How can I start history-server with kerberos HDFS ? Wed, 03 Sep, 18:14
Andrew Or     Re: How can I start history-server with kerberos HDFS ? Wed, 03 Sep, 23:52
Zhanfeng Huo   Re: Re: How can I start history-server with kerberos HDFS ? Thu, 04 Sep, 04:57
Greg Hill spark history server trying to hit port 8021 Wed, 03 Sep, 18:56
Greg Hill   Re: spark history server trying to hit port 8021 Wed, 03 Sep, 19:14
Andrew Or     Re: spark history server trying to hit port 8021 Wed, 03 Sep, 21:10
Ruebenacker, Oliver A Web UI Wed, 03 Sep, 19:12
Wonha Ryu   Re: Web UI Wed, 03 Sep, 19:36
Ruebenacker, Oliver A     RE: Web UI Wed, 03 Sep, 19:58
Wonha Ryu       Re: Web UI Wed, 03 Sep, 20:27
Ruebenacker, Oliver A         RE: Web UI Wed, 03 Sep, 20:54
Akhil Das           Re: Web UI Thu, 04 Sep, 07:09
Ruebenacker, Oliver A             RE: Web UI Thu, 04 Sep, 12:28
Andrew Or               Re: Web UI Thu, 04 Sep, 18:10
Ruebenacker, Oliver A                 RE: Web UI Fri, 05 Sep, 13:50
Andrew Or                   Re: Web UI Fri, 05 Sep, 18:07
kpeng1 Spark Streaming into HBase Wed, 03 Sep, 21:05
Ted Yu   Re: Spark Streaming into HBase Wed, 03 Sep, 21:36
Sean Owen     Re: Spark Streaming into HBase Wed, 03 Sep, 21:42
kpeng1       Re: Spark Streaming into HBase Wed, 03 Sep, 21:54
Kevin Peng     Re: Spark Streaming into HBase Wed, 03 Sep, 23:24
Tathagata Das       Re: Spark Streaming into HBase Thu, 04 Sep, 02:57
kpeng1         Re: Spark Streaming into HBase Thu, 04 Sep, 17:25
Tathagata Das           Re: Spark Streaming into HBase Fri, 05 Sep, 08:09
Yan Fang How do you debug with the logs ? Wed, 03 Sep, 21:05
Ruebenacker, Oliver A If master is local, where are master and workers? Wed, 03 Sep, 22:12
Marcelo Vanzin   Re: If master is local, where are master and workers? Wed, 03 Sep, 22:32
Ruebenacker, Oliver A     RE: If master is local, where are master and workers? Wed, 03 Sep, 22:43
Marcelo Vanzin       Re: If master is local, where are master and workers? Wed, 03 Sep, 22:43
Re: Running Wordcount on large file stucks and throws OOM exception
Zhan Zhang   Re: Running Wordcount on large file stucks and throws OOM exception Wed, 03 Sep, 23:43
Yana Kadiyska [MLib] How do you normalize features? Thu, 04 Sep, 00:10
Xiangrui Meng   Re: [MLib] How do you normalize features? Thu, 04 Sep, 01:42
Tobias Pfeiffer Multi-tenancy for Spark (Streaming) Applications Thu, 04 Sep, 01:30
Tathagata Das   Re: Multi-tenancy for Spark (Streaming) Applications Thu, 04 Sep, 01:33
Tobias Pfeiffer     Re: Multi-tenancy for Spark (Streaming) Applications Tue, 09 Sep, 02:26
Tobias Pfeiffer       Re: Multi-tenancy for Spark (Streaming) Applications Thu, 11 Sep, 08:12
남윤민 Why spark on yarn applicationmaster cannot get a proper resourcemanager address from yarnconfiguration? Thu, 04 Sep, 02:15
Guodong Wang   Re: Why spark on yarn applicationmaster cannot get a proper resourcemanager address from yarnconfiguration? Thu, 04 Sep, 02:49
Re: Is there any way to control the parallelism in LogisticRegression
Jiusheng Chen   Re: Is there any way to control the parallelism in LogisticRegression Thu, 04 Sep, 02:18
Xiangrui Meng     Re: Is there any way to control the parallelism in LogisticRegression Thu, 04 Sep, 02:34
DB Tsai       Re: Is there any way to control the parallelism in LogisticRegression Thu, 04 Sep, 03:02
Jiusheng Chen         Re: Is there any way to control the parallelism in LogisticRegression Thu, 04 Sep, 04:28
DB Tsai           Re: Is there any way to control the parallelism in LogisticRegression Thu, 04 Sep, 06:48
Jiusheng Chen             Re: Is there any way to control the parallelism in LogisticRegression Fri, 05 Sep, 03:06
DB Tsai               Re: Is there any way to control the parallelism in LogisticRegression Sat, 06 Sep, 19:30
牛兆捷 resize memory size for caching RDD Thu, 04 Sep, 03:29
Liu, Raymond   RE: resize memory size for caching RDD Thu, 04 Sep, 04:24
gavin zhang How to use memcached with spark Thu, 04 Sep, 03:50
Re: memory size for caching RDD
Patrick Wendell   Re: memory size for caching RDD Thu, 04 Sep, 05:45
牛兆捷     Re: memory size for caching RDD Thu, 04 Sep, 06:27
牛兆捷       Re: memory size for caching RDD Thu, 04 Sep, 06:31
Liu, Raymond       RE: memory size for caching RDD Thu, 04 Sep, 06:32
牛兆捷         Re: memory size for caching RDD Thu, 04 Sep, 06:57
Liu, Raymond           RE: memory size for caching RDD Thu, 04 Sep, 07:05
牛兆捷             Re: memory size for caching RDD Thu, 04 Sep, 07:18
Denny Lee Starting Thriftserver via hostname on Spark 1.1 RC4? Thu, 04 Sep, 05:47
Gurvinder Singh   Re: Starting Thriftserver via hostname on Spark 1.1 RC4? Thu, 04 Sep, 17:12
Cheng Lian   Re: Starting Thriftserver via hostname on Spark 1.1 RC4? Thu, 04 Sep, 17:27
Denny Lee     Re: Starting Thriftserver via hostname on Spark 1.1 RC4? Thu, 04 Sep, 17:59
Vicky Kak Programatically running of the Spark Jobs. Thu, 04 Sep, 06:39
Matt Chu   Re: Programatically running of the Spark Jobs. Thu, 04 Sep, 06:45
Ruebenacker, Oliver A     RE: Programatically running of the Spark Jobs. Thu, 04 Sep, 12:06
Vicky Kak       Re: Programatically running of the Spark Jobs. Thu, 04 Sep, 13:01
ericacm     Re: Programatically running of the Spark Jobs. Fri, 05 Sep, 02:05
Vicky Kak       Re: Programatically running of the Spark Jobs. Fri, 05 Sep, 05:20
Guru Medasani     Re: Programatically running of the Spark Jobs. Fri, 05 Sep, 03:03
Vicky Kak       Re: Programatically running of the Spark Jobs. Fri, 05 Sep, 04:57
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · Next »Thread · Author · Date
Box list
Sep 202191
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137