spark-user mailing list archives: July 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Fwd: None.get on Redact in DataSourceScanExec
Russell Spitzer   Fwd: None.get on Redact in DataSourceScanExec Fri, 14 Jul, 00:06
Russell Spitzer None.get on Redact in DataSourceScanExec Fri, 14 Jul, 01:48
Re: calculate diff of value and median in a group
roni   Re: calculate diff of value and median in a group Fri, 14 Jul, 21:53
SRK Memory consumption and checkpointed data seems to increase incrementally when reduceByKeyAndWIndow with inverse function is used with mapWithState in Stateful streaming Sat, 15 Jul, 00:04
Patrick Querying on Deeply Nested JSON Structures Sat, 15 Jul, 17:41
Matt Deaver   Re: Querying on Deeply Nested JSON Structures Sat, 15 Jul, 17:45
Burak Yavuz     Re: Querying on Deeply Nested JSON Structures Sun, 16 Jul, 14:22
nayan sharma splitting columns into new columns Sun, 16 Jul, 18:25
ayan guha   Re: splitting columns into new columns Sun, 16 Jul, 21:59
nayan sharma     Re: splitting columns into new columns Mon, 17 Jul, 08:25
Pralabh Kumar       Re: splitting columns into new columns Mon, 17 Jul, 11:24
nayan sharma         Re: splitting columns into new columns Mon, 17 Jul, 17:15
ayan guha           Re: splitting columns into new columns Mon, 17 Jul, 19:01
Matthew cao to_json not working with selectExpr Mon, 17 Jul, 01:24
Burak Yavuz   Re: to_json not working with selectExpr Mon, 17 Jul, 04:05
Matthew cao     Re: to_json not working with selectExpr Wed, 19 Jul, 14:02
Hyukjin Kwon       Re: to_json not working with selectExpr Wed, 19 Jul, 14:35
Matthew cao         Re: to_json not working with selectExpr Thu, 20 Jul, 02:31
Hyukjin Kwon           Re: to_json not working with selectExpr Thu, 20 Jul, 02:43
Matthew cao             Re: to_json not working with selectExpr Thu, 20 Jul, 02:47
Matthew cao             Re: to_json not working with selectExpr Thu, 20 Jul, 03:04
zzcclp Spark 2.1.1 Error:java.lang.NoSuchMethodError: org.apache.spark.network.client.TransportClient.getChannel()Lio/netty/channel/Channel; Mon, 17 Jul, 09:49
vaquar khan   Re: Spark 2.1.1 Error:java.lang.NoSuchMethodError: org.apache.spark.network.client.TransportClient.getChannel()Lio/netty/channel/Channel; Mon, 17 Jul, 13:38
恩爸     回复: Spark 2.1.1 Error:java.lang.NoSuchMethodError: org.apache.spark.network.client.TransportClient.getChannel()Lio/netty/channel/Channel; Mon, 17 Jul, 14:35
FN Reading Hive tables Parallel in Spark Mon, 17 Jul, 12:12
Pralabh Kumar   Re: Reading Hive tables Parallel in Spark Mon, 17 Jul, 12:26
Fretz Nuson     Re: Reading Hive tables Parallel in Spark Mon, 17 Jul, 15:43
Matteo Cossu   Re: Reading Hive tables Parallel in Spark Mon, 17 Jul, 12:26
Simon Kitching   Re: Reading Hive tables Parallel in Spark Mon, 17 Jul, 12:28
Rick Moritz     Re: Reading Hive tables Parallel in Spark Mon, 17 Jul, 12:48
Fretz Nuson     Re: Reading Hive tables Parallel in Spark Mon, 17 Jul, 15:46
Matteo Cossu       Re: Reading Hive tables Parallel in Spark Tue, 18 Jul, 12:50
Mich Talebzadeh running spark job with fat jar file Mon, 17 Jul, 15:41
Marcelo Vanzin   Re: running spark job with fat jar file Mon, 17 Jul, 16:17
ayan guha     Re: running spark job with fat jar file Mon, 17 Jul, 17:18
Mich Talebzadeh       Re: running spark job with fat jar file Mon, 17 Jul, 17:45
Marcelo Vanzin         Re: running spark job with fat jar file Mon, 17 Jul, 17:46
Mich Talebzadeh           Re: running spark job with fat jar file Mon, 17 Jul, 17:47
Marcelo Vanzin             Re: running spark job with fat jar file Mon, 17 Jul, 18:10
ayan guha               Re: running spark job with fat jar file Mon, 17 Jul, 18:34
Mich Talebzadeh                 Re: running spark job with fat jar file Mon, 17 Jul, 19:46
ayan guha                   Re: running spark job with fat jar file Mon, 17 Jul, 19:57
Luciano Resende [ANNOUNCE] Apache Bahir 2.1.1 Released Mon, 17 Jul, 19:59
Pascal Stammer Running Spark und YARN on AWS EMR Mon, 17 Jul, 20:18
Takashi Sasaki   Re: Running Spark und YARN on AWS EMR Mon, 17 Jul, 20:59
Pascal Stammer     Re: Running Spark und YARN on AWS EMR Mon, 17 Jul, 21:47
Josh Holbrook     Re: Running Spark und YARN on AWS EMR Mon, 17 Jul, 21:48
Takashi Sasaki       Re: Running Spark und YARN on AWS EMR Mon, 17 Jul, 21:57
Re: Slowness of Spark Thrift Server
Maciej Bryński   Re: Slowness of Spark Thrift Server Mon, 17 Jul, 20:30
Jean-Francois Gosselin Spark Streaming handling Kafka exceptions Mon, 17 Jul, 21:05
saatvikshah1994 Spark UI crashes on Large Workloads Tue, 18 Jul, 00:49
Riccardo Ferrari   Re: Spark UI crashes on Large Workloads Tue, 18 Jul, 06:49
Saatvik Shah     Re: Spark UI crashes on Large Workloads Tue, 18 Jul, 13:30
Riccardo Ferrari       Re: Spark UI crashes on Large Workloads Tue, 18 Jul, 13:59
Saatvik Shah         Re: Spark UI crashes on Large Workloads Tue, 18 Jul, 15:12
Chetan Khatri Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:05
Georg Heiler   Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:08
Chetan Khatri     Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:10
刘虓   Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:09
Chetan Khatri     Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:11
Richard Xin       Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:44
Georg Heiler         Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 06:48
Chetan Khatri           Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 08:57
lucas.g...@gmail.com             Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 16:46
Riccardo Ferrari               Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 17:29
Michael Armbrust                 Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 18:03
lucas.g...@gmail.com                   Re: Flatten JSON to multiple columns in Spark Tue, 18 Jul, 18:13
Chetan Khatri                     Re: Flatten JSON to multiple columns in Spark Wed, 19 Jul, 10:00
Chetan Khatri                       Re: Flatten JSON to multiple columns in Spark Thu, 20 Jul, 03:46
Spark history server running on Mongo
Ivan Sadikov   Spark history server running on Mongo Tue, 18 Jul, 08:01
Marcelo Vanzin   Re: Spark history server running on Mongo Tue, 18 Jul, 16:18
Ivan Sadikov     Re: Spark history server running on Mongo Tue, 18 Jul, 16:44
Ivan Sadikov       Re: Spark history server running on Mongo Wed, 19 Jul, 02:21
Marcelo Vanzin         Re: Spark history server running on Mongo Wed, 19 Jul, 17:52
Ivan Sadikov           Re: Spark history server running on Mongo Wed, 19 Jul, 18:06
Myrle Krantz Solutions.Hamburg conference Tue, 18 Jul, 10:25
Jacek Laskowski   Re: Solutions.Hamburg conference Tue, 18 Jul, 11:09
Myrle Krantz     Re: Solutions.Hamburg conference Tue, 18 Jul, 11:48
Jacek Laskowski       Re: Solutions.Hamburg conference Tue, 18 Jul, 13:23
Christopher Requesting feedback on Fluo+Spark Tue, 18 Jul, 16:34
Josh Holbrook [Spark Core] unhashable type: 'dict' during shuffle step Tue, 18 Jul, 19:17
Josh Holbrook   Re: [Spark Core] unhashable type: 'dict' during shuffle step Tue, 18 Jul, 21:07
Noppanit Charassinvichai [Spark Streaming] How to make this code work? Wed, 19 Jul, 00:54
ayan guha Azure key vault Wed, 19 Jul, 02:15
Karamba Structured Streaming: Row differences, e.g., with Window and lag() Wed, 19 Jul, 06:31
julio.ces...@free.fr Feature Generation for Large datasets composed of many time series Wed, 19 Jul, 11:30
Imran Rajjad Slow responce on Solr Cloud with Spark Wed, 19 Jul, 12:49
Anastasios Zouzias   Re: Slow responce on Solr Cloud with Spark Wed, 19 Jul, 14:28
qihuagao about aggregateByKey of pairrdd. Wed, 19 Jul, 12:50
Sumedh Wale   Re: about aggregateByKey of pairrdd. Wed, 19 Jul, 20:38
Aseem Bansal Regarding Logistic Regression changes in Spark 2.2.0 Wed, 19 Jul, 14:09
Nick Pentreath   Re: Regarding Logistic Regression changes in Spark 2.2.0 Wed, 19 Jul, 14:15
Mich Talebzadeh MPEG files optimisation with Spark Wed, 19 Jul, 14:39
Udit Mehrotra Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 18:19
Marcelo Vanzin   Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 18:21
Marcelo Vanzin     Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 19:03
Udit Mehrotra       Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 19:47
Marcelo Vanzin         Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 19:51
Udit Mehrotra           Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 20:10
Marcelo Vanzin             Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 20:13
Udit Mehrotra               Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 21:58
Marcelo Vanzin                 Re: Question regarding Sparks new Internal authentication mechanism Wed, 19 Jul, 22:14
Udit Mehrotra                   Re: Question regarding Sparks new Internal authentication mechanism Thu, 20 Jul, 21:06
Marcelo Vanzin                     Re: Question regarding Sparks new Internal authentication mechanism Thu, 20 Jul, 23:25
Marcelo Vanzin                       Re: Question regarding Sparks new Internal authentication mechanism Thu, 20 Jul, 23:32
Udit Mehrotra                         Re: Question regarding Sparks new Internal authentication mechanism Fri, 21 Jul, 00:26
how does spark handle compressed files
Ashok Kumar   how does spark handle compressed files Wed, 19 Jul, 20:22
Jörn Franke     Re: how does spark handle compressed files Wed, 19 Jul, 20:32
Noppanit Charassinvichai ClassNotFoundException for Workers Wed, 19 Jul, 22:12
周康   Re: ClassNotFoundException for Workers Tue, 25 Jul, 08:17
Noppanit Charassinvichai     Re: ClassNotFoundException for Workers Mon, 31 Jul, 18:26
ctang How to insert a dataframe as a static partition to a partitioned table Wed, 19 Jul, 22:13
Ryan   Re: How to insert a dataframe as a static partition to a partitioned table Thu, 20 Jul, 02:53
Vadim Semenov   Re: How to insert a dataframe as a static partition to a partitioned table Thu, 20 Jul, 14:56
Chaoyu Tang     Re: How to insert a dataframe as a static partition to a partitioned table Thu, 20 Jul, 16:04
Cassa L Spark 2.0 and Oracle 12.1 error Thu, 20 Jul, 06:10
ayan guha   Re: Spark 2.0 and Oracle 12.1 error Thu, 20 Jul, 06:35
Xiao Li   Re: Spark 2.0 and Oracle 12.1 error Fri, 21 Jul, 15:21
Cassa L     Re: Spark 2.0 and Oracle 12.1 error Fri, 21 Jul, 16:40
Xiao Li       Re: Spark 2.0 and Oracle 12.1 error Fri, 21 Jul, 17:12
Cassa L         Re: Spark 2.0 and Oracle 12.1 error Fri, 21 Jul, 20:50
Cassa L           Re: Spark 2.0 and Oracle 12.1 error Mon, 24 Jul, 20:32
Cassa L Spark-2.0 and Oracle 12.1 error: Unsupported type -101 Thu, 20 Jul, 06:21
Aseem Bansal Setting initial weights of ml.classification.LogisticRegression similar to mllib.classification.LogisticRegressionWithLBFGS Thu, 20 Jul, 06:36
Nick Pentreath   Re: Setting initial weights of ml.classification.LogisticRegression similar to mllib.classification.LogisticRegressionWithLBFGS Thu, 20 Jul, 07:20
Aseem Bansal     Re: Setting initial weights of ml.classification.LogisticRegression similar to mllib.classification.LogisticRegressionWithLBFGS Thu, 20 Jul, 08:21
Nick Pentreath       Re: Setting initial weights of ml.classification.LogisticRegression similar to mllib.classification.LogisticRegressionWithLBFGS Thu, 20 Jul, 08:23
Chetan Khatri Issue: Hive Table Stored as col(array) instead of Columns with Spark Thu, 20 Jul, 08:38
Chetan Khatri   Re: Issue: Hive Table Stored as col(array) instead of Columns with Spark Thu, 20 Jul, 12:09
Imran Rajjad solr data source not working Thu, 20 Jul, 08:51
Cyanny LIANG What does spark.python.worker.memory affect? Thu, 20 Jul, 09:06
Kaushal Shriyan Failed to find Spark jars directory Thu, 20 Jul, 12:34
ayan guha   Re: Failed to find Spark jars directory Thu, 20 Jul, 14:12
Kaushal Shriyan     Re: Failed to find Spark jars directory Thu, 20 Jul, 14:17
ayan guha       Re: Failed to find Spark jars directory Thu, 20 Jul, 14:21
Kaushal Shriyan         Re: Failed to find Spark jars directory Thu, 20 Jul, 14:24
Gokula Krishnan D Spark sc.textFile() files with more partitions Vs files with less partitions Thu, 20 Jul, 12:46
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 202186
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137