spark-user mailing list archives: August 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Fwd: ORC Transaction Table - Spark
Aviral Agarwal   Fwd: ORC Transaction Table - Spark Tue, 22 Aug, 12:40
Akhil Das     Re: ORC Transaction Table - Spark Thu, 24 Aug, 09:41
Aviral Agarwal       Re: ORC Transaction Table - Spark Thu, 24 Aug, 12:10
Sun, Keith A bug in spark or hadoop RPC with kerberos authentication? Tue, 22 Aug, 15:48
周康   Re: A bug in spark or hadoop RPC with kerberos authentication? Wed, 23 Aug, 03:22
Sun, Keith     RE: A bug in spark or hadoop RPC with kerberos authentication? Wed, 23 Aug, 11:12
Sun, Keith   RE: A bug in spark or hadoop RPC with kerberos authentication? Wed, 23 Aug, 11:01
Re: Spark submit OutOfMemory Error in local mode
shitijkuls   Re: Spark submit OutOfMemory Error in local mode Tue, 22 Aug, 18:16
U..@Moosheimer.com     Re: Spark submit OutOfMemory Error in local mode Tue, 22 Aug, 19:26
Naga G       Re: Spark submit OutOfMemory Error in local mode Tue, 22 Aug, 20:57
muthu     Re: Spark submit OutOfMemory Error in local mode Tue, 29 Aug, 15:48
shyla deshpande What is the right way to stop a streaming application? Tue, 22 Aug, 18:29
[Streaming][Structured Streaming] Understanding dynamic allocation in streaming jobs
Karthik Palaniappan   [Streaming][Structured Streaming] Understanding dynamic allocation in streaming jobs Tue, 22 Aug, 19:24
cbowden   Re: [Streaming][Structured Streaming] Understanding dynamic allocation in streaming jobs Fri, 25 Aug, 02:01
Karthik Palaniappan   Re: [Streaming][Structured Streaming] Understanding dynamic allocation in streaming jobs Fri, 25 Aug, 21:15
Karthik Palaniappan [Spark Streaming] Streaming Dynamic Allocation is broken (at least on YARN) Tue, 22 Aug, 20:38
Akhil Das   Re: [Spark Streaming] Streaming Dynamic Allocation is broken (at least on YARN) Thu, 24 Aug, 09:34
Karthik Palaniappan   RE: [Spark Streaming] Streaming Dynamic Allocation is broken (at least on YARN) Fri, 25 Aug, 16:15
Kalvin Chau Spark Authentication on Mesos Client Mode Tue, 22 Aug, 22:17
Sea aj Training A ML Model on a Huge Dataframe Wed, 23 Aug, 12:27
Suzen, Mehmet   Re: Training A ML Model on a Huge Dataframe Wed, 23 Aug, 12:59
Sea aj     Re: Training A ML Model on a Huge Dataframe Wed, 23 Aug, 16:22
Suzen, Mehmet       Re: Training A ML Model on a Huge Dataframe Wed, 23 Aug, 23:07
Yanbo Liang         Re: Training A ML Model on a Huge Dataframe Thu, 24 Aug, 11:18
AlexanderModestov filter function works incorretly (Python) Wed, 23 Aug, 15:40
JG Perrin Joining 2 dataframes, getting result as nested list/structure in dataframe Wed, 23 Aug, 18:30
Michael Armbrust   Re: Joining 2 dataframes, getting result as nested list/structure in dataframe Wed, 23 Aug, 21:32
JG Perrin     RE: Joining 2 dataframes, getting result as nested list/structure in dataframe Thu, 24 Aug, 13:19
SRK ReduceByKeyAndWindow checkpoint recovery issues in Spark Streaming Wed, 23 Aug, 19:26
Brian Wylie PySpark, Structured Streaming and Kafka Wed, 23 Aug, 20:41
Riccardo Ferrari   Re: PySpark, Structured Streaming and Kafka Wed, 23 Aug, 22:45
Shixiong(Ryan) Zhu   Re: PySpark, Structured Streaming and Kafka Wed, 23 Aug, 22:51
Brian Wylie     Re: PySpark, Structured Streaming and Kafka Thu, 24 Aug, 00:21
Brian Wylie     Re: PySpark, Structured Streaming and Kafka Thu, 24 Aug, 17:55
ayan guha Livy with Spark package Thu, 24 Aug, 00:11
Saisai Shao   Re: Livy with Spark package Thu, 24 Aug, 02:01
ayan guha     Re: Livy with Spark package Thu, 24 Aug, 03:36
Likith_Kailas SparkStreaming connection exception Thu, 24 Aug, 13:05
Lionel Luffy NoSuchMethodError CatalogTable.copy Thu, 24 Aug, 13:32
Alexander Czech Restarting the SparkContext in pyspark Thu, 24 Aug, 15:59
Irfan Kabli SWOT Analysis on Apache Spark Thu, 24 Aug, 18:49
Alexandr Porunov [Spark] Can Apache Spark be used with time series processing? Thu, 24 Aug, 20:52
kanth...@gmail.com   Re: [Spark] Can Apache Spark be used with time series processing? Wed, 30 Aug, 15:50
Irving Duran     Re: [Spark] Can Apache Spark be used with time series processing? Wed, 30 Aug, 18:21
vaquar khan       Re: [Spark] Can Apache Spark be used with time series processing? Thu, 31 Aug, 02:10
Re: unable to stream kafka messages
cbowden   Re: unable to stream kafka messages Fri, 25 Aug, 02:45
SRK Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Fri, 25 Aug, 19:19
Cody Koeninger   Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Fri, 25 Aug, 19:28
swetha kasireddy     Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Sat, 26 Aug, 00:04
swetha kasireddy       Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Sat, 26 Aug, 00:26
Cody Koeninger       Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Mon, 28 Aug, 14:43
swetha kasireddy         Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Mon, 28 Aug, 18:27
swetha kasireddy           Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Mon, 28 Aug, 18:56
swetha kasireddy             Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Tue, 29 Aug, 00:06
Cody Koeninger               Re: Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster Tue, 29 Aug, 14:37
Hugo Reinwald Why do checkpoints work the way they do? Sat, 26 Aug, 02:41
Tathagata Das   Re: Why do checkpoints work the way they do? Wed, 30 Aug, 05:19
张万新     Re: Why do checkpoints work the way they do? Thu, 31 Aug, 06:20
pyspark on windows (Upgrade from 1.6 to 2.0.2): sqlContext.read.format fails
Shiv Onkar Kumar   pyspark on windows (Upgrade from 1.6 to 2.0.2): sqlContext.read.format fails Sat, 26 Aug, 04:13
Julia Wistance Kafka Consumer Pre Fetch Messages + Async commits Sat, 26 Aug, 06:07
Cody Koeninger   Re: Kafka Consumer Pre Fetch Messages + Async commits Mon, 28 Aug, 14:38
Julia Wistance     Re: Kafka Consumer Pre Fetch Messages + Async commits Tue, 29 Aug, 14:44
刘虓 spark dataframe jdbc Amazon RDS problem Sat, 26 Aug, 17:00
刘虓   Re: spark dataframe jdbc Amazon RDS problem Sat, 26 Aug, 17:02
Simone Pallotta different behaviour linux/Unix vs windows when load spark context in scala method called from R function using rscala package Sun, 27 Aug, 07:46
Georg Heiler   Re: different behaviour linux/Unix vs windows when load spark context in scala method called from R function using rscala package Sun, 27 Aug, 17:18
KhajaAsmath Mohammed Kill Spark Streaming JOB from Spark UI or Yarn Sun, 27 Aug, 17:27
Matei Zaharia   Re: Kill Spark Streaming JOB from Spark UI or Yarn Mon, 28 Aug, 01:40
李书明 [Spark Streaming] One Batch hangs always and others process correctly Mon, 28 Aug, 07:27
Gerard Maas   Re: [Spark Streaming] One Batch hangs always and others process correctly Mon, 28 Aug, 08:19
Imran Rajjad Oracle Table not resolved [Spark 2.1.1] Mon, 28 Aug, 08:06
Naga G   Re: Oracle Table not resolved [Spark 2.1.1] Mon, 28 Aug, 11:55
Imran Rajjad     Re: Oracle Table not resolved [Spark 2.1.1] Tue, 29 Aug, 05:41
Michael Artz add me to email list Mon, 28 Aug, 12:43
JG Perrin   RE: add me to email list Mon, 28 Aug, 14:55
madhu phatak Time window on Processing Time Mon, 28 Aug, 12:46
Tathagata Das   Re: Time window on Processing Time Wed, 30 Aug, 05:14
madhu phatak     Re: Time window on Processing Time Thu, 31 Aug, 04:06
Anton Puzanov Predicate Pushdown Doesn't Work With Data Source API Mon, 28 Aug, 12:48
daniel williams Spark 2.2 structured streaming with mapGroupsWithState + window functions Mon, 28 Aug, 14:06
kant kodali   Re: Spark 2.2 structured streaming with mapGroupsWithState + window functions Wed, 30 Aug, 16:07
Patrick Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 14:47
Georg Heiler   Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 17:10
Patrick     Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 18:13
Georg Heiler       Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 18:32
Patrick         Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 18:54
Georg Heiler           Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Tue, 29 Aug, 10:22
Vadim Semenov   Re: Collecting Multiple Aggregation query result on one Column as collectAsMap Mon, 28 Aug, 18:52
Michael Artz Spark SQL vs HiveQL Mon, 28 Aug, 14:50
Michael Artz   Re: Spark SQL vs HiveQL Mon, 28 Aug, 17:25
Imran Rajjad     Re: Spark SQL vs HiveQL Mon, 28 Aug, 17:58
Michael Artz       Re: Spark SQL vs HiveQL Mon, 28 Aug, 23:03
Everett Anderson Help taking last value in each group (aggregates) Mon, 28 Aug, 16:19
Everett Anderson   Re: Help taking last value in each group (aggregates) Mon, 28 Aug, 22:05
Re: apache thrift server
MidwestMike   Re: apache thrift server Mon, 28 Aug, 16:26
JG Perrin from_json() Mon, 28 Aug, 16:57
Sam Elamin   Re: from_json() Mon, 28 Aug, 18:14
JG Perrin     RE: from_json() Mon, 28 Aug, 18:29
JG Perrin       RE: from_json() Wed, 30 Aug, 13:52
Davide.Mandrini [Spark Streaming] Application is stopped after stopping a worker Mon, 28 Aug, 19:36
Mikhailau, Alex Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Mon, 28 Aug, 20:43
Vadim Semenov   Re: Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Mon, 28 Aug, 21:18
Mikhailau, Alex     Re: Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Mon, 28 Aug, 21:41
Vadim Semenov       Re: Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Tue, 29 Aug, 15:49
Mikhailau, Alex         Re: Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? Tue, 29 Aug, 17:43
purna pradeep use WithColumn with external function in a java jar Tue, 29 Aug, 01:23
Praneeth Gayam   Re: use WithColumn with external function in a java jar Tue, 29 Aug, 02:22
purna pradeep     Re: use WithColumn with external function in a java jar Wed, 30 Aug, 00:17
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 202196
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137