spark-user mailing list archives: September 2018

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Re: DStream reduceByKeyAndWindow not using checkpointed data for inverse reducing old data
N B   Re: DStream reduceByKeyAndWindow not using checkpointed data for inverse reducing old data Sat, 01 Sep, 09:19
Re: read snappy compressed files in spark
yujhe.li   Re: read snappy compressed files in spark Sun, 02 Sep, 01:24
Mich Talebzadeh Reading mongoDB collection in Spark with arrays Sun, 02 Sep, 10:09
Mich Talebzadeh   Re: Reading mongoDB collection in Spark with arrays Sun, 02 Sep, 16:38
V0lleyBallJunki3 Set can be passed in as an input argument but not as output Tue, 04 Sep, 03:47
Swapnil Chougule Spark hive udf: no handler for UDAF analysis exception Tue, 04 Sep, 10:50
Swapnil Chougule   Re: Spark hive udf: no handler for UDAF analysis exception Wed, 05 Sep, 13:13
David Hesson Seeing a framework registration loop with Spark 2.3.1 on DCOS 1.10.0 Wed, 05 Sep, 00:01
Mich Talebzadeh getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:11
Jungtaek Lim   Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:17
Mich Talebzadeh     Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:23
Jungtaek Lim       Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:30
Jungtaek Lim         Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:32
Jungtaek Lim           Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:41
Mich Talebzadeh             Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:49
Mich Talebzadeh               Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 09:00
Deepak Sharma                 Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 09:09
Mich Talebzadeh                   Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 12:30
Mich Talebzadeh                     Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 22:24
Manu Zhang                       Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 02:38
Mich Talebzadeh                         Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 08:56
Jungtaek Lim                           Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 09:10
Mich Talebzadeh                             Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 09:24
Mich Talebzadeh                               Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 16:44
Guillermo Ortiz Fernández deploy-mode cluster. FileNotFoundException Wed, 05 Sep, 09:11
Guillermo Ortiz Fernández   Re: deploy-mode cluster. FileNotFoundException Wed, 05 Sep, 09:17
Marcelo Vanzin     Re: deploy-mode cluster. FileNotFoundException Wed, 05 Sep, 16:28
Matteo Durighetto Padova Apache Spark Meetup Wed, 05 Sep, 12:44
Re: Unsubscribe
Sunil Prabhakara   Re: Unsubscribe Wed, 05 Sep, 13:43
Anu B Nair   Unsubscribe Thu, 06 Sep, 07:03
Fiona Chow     Unsubscribe Fri, 07 Sep, 10:05
Bibudh Lahiri   Unsubscribe Fri, 07 Sep, 10:04
Pekka Lehtonen   Unsubscribe Thu, 13 Sep, 14:17
Mohan Palavancha     Re: Unsubscribe Fri, 14 Sep, 13:18
Iryna Kharaborkina   Unsubscribe Wed, 26 Sep, 08:48
Hasunie Adikari   Unsubscribe Thu, 27 Sep, 10:47
Aleksander Eskilson [ML] Setting Non-Transform Params for a Pipeline & PipelineModel Wed, 05 Sep, 14:16
Prashant Sharma Spark Streaming RDD Cleanup too slow Thu, 06 Sep, 04:13
mithril How to make pyspark use custom python? Thu, 06 Sep, 06:21
Hyukjin Kwon   Re: How to make pyspark use custom python? Thu, 06 Sep, 06:58
Patrick McCarthy     Re: How to make pyspark use custom python? Thu, 06 Sep, 14:07
mithril       Re: How to make pyspark use custom python? Fri, 07 Sep, 01:25
Femi Anthony         Re: [External Sender] Re: How to make pyspark use custom python? Fri, 07 Sep, 02:54
mithril           Re: [External Sender] Re: How to make pyspark use custom python? Fri, 07 Sep, 10:04
Re: CBO not working for Parquet Files
emlyn   Re: CBO not working for Parquet Files Thu, 06 Sep, 09:56
Aakash Basu XGBoost Not distributing on cluster having more than 1 worker Thu, 06 Sep, 10:05
Aakash Basu   Re: XGBoost Not distributing on cluster having more than 1 worker Thu, 06 Sep, 11:16
dimitris plakas Error in show() Thu, 06 Sep, 22:11
Apostolos N. Papadopoulos   Re: Error in show() Fri, 07 Sep, 06:52
Sonal Goyal     Re: Error in show() Sat, 08 Sep, 14:23
Prakash Joshi   Re: Error in show() Sat, 08 Sep, 15:22
James Starks How to debug Spark job Fri, 07 Sep, 09:47
Femi Anthony   Re: [External Sender] How to debug Spark job Fri, 07 Sep, 10:32
James Starks     Re: [External Sender] How to debug Spark job Fri, 07 Sep, 13:05
Sonal Goyal       Re: [External Sender] How to debug Spark job Sat, 08 Sep, 14:17
Marco Mistroni   Re: How to debug Spark job Sat, 08 Sep, 17:43
James Starks Spark job's driver programe consums too much memory Fri, 07 Sep, 14:04
Apostolos N. Papadopoulos   Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 14:15
James Starks     Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 14:39
Apostolos N. Papadopoulos       Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 14:46
James Starks         Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 15:09
Harel Gliksman Driver OutOfMemoryError in MapOutputTracker$.serializeMapStatuses for 40 TB shuffle. Fri, 07 Sep, 14:34
Vadim Semenov   Re: Driver OutOfMemoryError in MapOutputTracker$.serializeMapStatuses for 40 TB shuffle. Fri, 07 Sep, 15:28
Harel Gliksman     Re: Driver OutOfMemoryError in MapOutputTracker$.serializeMapStatuses for 40 TB shuffle. Fri, 07 Sep, 15:40
Rohit Menon [K8S] Driver and Executor Logging Fri, 07 Sep, 17:31
Garlapati, Suryanarayana (Nokia - IN/Bangalore)   RE: [K8S] Driver and Executor Logging Sat, 08 Sep, 16:03
Fwd: Using MongoDB as an Operational Data Store (ODS) with Spark Streaming
Mich Talebzadeh   Fwd: Using MongoDB as an Operational Data Store (ODS) with Spark Streaming Fri, 07 Sep, 18:34
Mich Talebzadeh     Re: Using MongoDB as an Operational Data Store (ODS) with Spark Streaming Sun, 09 Sep, 18:57
阎志涛 How to retreive data from nested json use dataframe Sat, 08 Sep, 14:38
Mich Talebzadeh   Re: How to retreive data from nested json use dataframe Sat, 08 Sep, 14:59
Hugh Hyndman DataSourceReader and SupportPushDownFilters for Short types Sat, 08 Sep, 23:17
Hugh Hyndman PushDown Filter Not Reset Sun, 09 Sep, 10:56
Stavros Kontopoulos custom sink & model transformation Mon, 10 Sep, 00:16
Re: Register UDF duration runtime
amittonge   Re: Register UDF duration runtime Mon, 10 Sep, 08:58
Rich Bowen Speakers needed for Apache DC Roadshow Tue, 11 Sep, 15:05
Mich Talebzadeh Drawing Big Data tech diagrams using Pen Tablets Tue, 11 Sep, 19:20
Gourav Sengupta   Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 17:34
Mich Talebzadeh     Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 18:31
Jörn Franke       Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 18:38
Mich Talebzadeh         Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 18:45
Gourav Sengupta           Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 20:46
ayan guha             Re: Drawing Big Data tech diagrams using Pen Tablets Thu, 13 Sep, 00:38
Aakash Basu [Help] Set nThread in Spark cluster Wed, 12 Sep, 08:40
Stephen Boesch Fixing NullType for parquet files Wed, 12 Sep, 17:26
Guillermo Ortiz Fernández Trying to improve performance of the driver. Thu, 13 Sep, 15:48
Jonas Shomorony Python Dependencies Issue on EMR Fri, 14 Sep, 02:08
Patrick McCarthy   Re: Python Dependencies Issue on EMR Fri, 14 Sep, 15:02
Jonas Shomorony     Re: Python Dependencies Issue on EMR Fri, 21 Sep, 00:21
Aakash Basu Local vs Cluster Fri, 14 Sep, 08:21
Mich Talebzadeh   Re: Local vs Cluster Fri, 14 Sep, 08:35
Apostolos N. Papadopoulos   Re: Local vs Cluster Fri, 14 Sep, 08:38
kant kodali Is there any open source framework that converts Cypher to SparkSQL? Fri, 14 Sep, 09:42
Matei Zaharia   Re: Is there any open source framework that converts Cypher to SparkSQL? Sun, 16 Sep, 22:08
Guillermo Ortiz DAGScheduler in SparkStreaming Fri, 14 Sep, 10:35
Sergejs Andrejevs Spark2 DynamicAllocation doesn't release executors that used cache Fri, 14 Sep, 11:33
Sergejs Andrejevs   Re: Spark2 DynamicAllocation doesn't release executors that used cache Fri, 21 Sep, 07:51
kathleen li What is the best way for Spark to read HDF5@scale? Fri, 14 Sep, 14:26
Saurav Sinha   Re: What is the best way for Spark to read HDF5@scale? Mon, 17 Sep, 07:13
Re: StackOverflow Error when run ALS with 100 iterations
LeoB   Re: StackOverflow Error when run ALS with 100 iterations Fri, 14 Sep, 17:10
Daniele Foroni [SparkSQL] Count Distinct issue Fri, 14 Sep, 18:54
kathleen li   Re: [SparkSQL] Count Distinct issue Tue, 18 Sep, 05:39
johkelly [Spark SQL] Catalyst ScalaReflection/ExpressionEncoder fail with relocated (shaded) classes Fri, 14 Sep, 23:49
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Dec 201960
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137