spark-user mailing list archives: September 2018

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
N B Re: DStream reduceByKeyAndWindow not using checkpointed data for inverse reducing old data Sat, 01 Sep, 09:19
yujhe.li Re: read snappy compressed files in spark Sun, 02 Sep, 01:24
Mich Talebzadeh Reading mongoDB collection in Spark with arrays Sun, 02 Sep, 10:09
Mich Talebzadeh Re: Reading mongoDB collection in Spark with arrays Sun, 02 Sep, 16:38
V0lleyBallJunki3 Set can be passed in as an input argument but not as output Tue, 04 Sep, 03:47
Swapnil Chougule Spark hive udf: no handler for UDAF analysis exception Tue, 04 Sep, 10:50
David Hesson Seeing a framework registration loop with Spark 2.3.1 on DCOS 1.10.0 Wed, 05 Sep, 00:01
Mich Talebzadeh getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:11
Jungtaek Lim Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:17
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:23
Jungtaek Lim Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:30
Jungtaek Lim Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:32
Jungtaek Lim Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:41
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 08:49
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 09:00
Deepak Sharma Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 09:09
Guillermo Ortiz Fernández deploy-mode cluster. FileNotFoundException Wed, 05 Sep, 09:11
Guillermo Ortiz Fernández Re: deploy-mode cluster. FileNotFoundException Wed, 05 Sep, 09:17
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 12:30
Matteo Durighetto Padova Apache Spark Meetup Wed, 05 Sep, 12:44
Swapnil Chougule Re: Spark hive udf: no handler for UDAF analysis exception Wed, 05 Sep, 13:13
Sunil Prabhakara Re: Unsubscribe Wed, 05 Sep, 13:43
Aleksander Eskilson [ML] Setting Non-Transform Params for a Pipeline & PipelineModel Wed, 05 Sep, 14:16
Marcelo Vanzin Re: deploy-mode cluster. FileNotFoundException Wed, 05 Sep, 16:28
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Wed, 05 Sep, 22:24
Manu Zhang Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 02:38
Prashant Sharma Spark Streaming RDD Cleanup too slow Thu, 06 Sep, 04:13
mithril How to make pyspark use custom python? Thu, 06 Sep, 06:21
Hyukjin Kwon Re: How to make pyspark use custom python? Thu, 06 Sep, 06:58
Anu B Nair Unsubscribe Thu, 06 Sep, 07:03
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 08:56
Jungtaek Lim Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 09:10
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 09:24
emlyn Re: CBO not working for Parquet Files Thu, 06 Sep, 09:56
Aakash Basu XGBoost Not distributing on cluster having more than 1 worker Thu, 06 Sep, 10:05
Aakash Basu Re: XGBoost Not distributing on cluster having more than 1 worker Thu, 06 Sep, 11:16
Patrick McCarthy Re: How to make pyspark use custom python? Thu, 06 Sep, 14:07
Mich Talebzadeh Re: getting error: value toDF is not a member of Seq[columns] Thu, 06 Sep, 16:44
dimitris plakas Error in show() Thu, 06 Sep, 22:11
mithril Re: How to make pyspark use custom python? Fri, 07 Sep, 01:25
Femi Anthony Re: [External Sender] Re: How to make pyspark use custom python? Fri, 07 Sep, 02:54
Apostolos N. Papadopoulos Re: Error in show() Fri, 07 Sep, 06:52
James Starks How to debug Spark job Fri, 07 Sep, 09:47
mithril Re: [External Sender] Re: How to make pyspark use custom python? Fri, 07 Sep, 10:04
Bibudh Lahiri Unsubscribe Fri, 07 Sep, 10:04
Fiona Chow Unsubscribe Fri, 07 Sep, 10:05
Femi Anthony Re: [External Sender] How to debug Spark job Fri, 07 Sep, 10:32
James Starks Re: [External Sender] How to debug Spark job Fri, 07 Sep, 13:05
James Starks Spark job's driver programe consums too much memory Fri, 07 Sep, 14:04
Apostolos N. Papadopoulos Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 14:15
Harel Gliksman Driver OutOfMemoryError in MapOutputTracker$.serializeMapStatuses for 40 TB shuffle. Fri, 07 Sep, 14:34
James Starks Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 14:39
Apostolos N. Papadopoulos Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 14:46
James Starks Re: Spark job's driver programe consums too much memory Fri, 07 Sep, 15:09
Vadim Semenov Re: Driver OutOfMemoryError in MapOutputTracker$.serializeMapStatuses for 40 TB shuffle. Fri, 07 Sep, 15:28
Harel Gliksman Re: Driver OutOfMemoryError in MapOutputTracker$.serializeMapStatuses for 40 TB shuffle. Fri, 07 Sep, 15:40
Rohit Menon [K8S] Driver and Executor Logging Fri, 07 Sep, 17:31
Mich Talebzadeh Fwd: Using MongoDB as an Operational Data Store (ODS) with Spark Streaming Fri, 07 Sep, 18:34
Sonal Goyal Re: [External Sender] How to debug Spark job Sat, 08 Sep, 14:17
Sonal Goyal Re: Error in show() Sat, 08 Sep, 14:23
阎志涛 How to retreive data from nested json use dataframe Sat, 08 Sep, 14:38
Mich Talebzadeh Re: How to retreive data from nested json use dataframe Sat, 08 Sep, 14:59
Prakash Joshi Re: Error in show() Sat, 08 Sep, 15:22
Garlapati, Suryanarayana (Nokia - IN/Bangalore) RE: [K8S] Driver and Executor Logging Sat, 08 Sep, 16:03
Marco Mistroni Re: How to debug Spark job Sat, 08 Sep, 17:43
Hugh Hyndman DataSourceReader and SupportPushDownFilters for Short types Sat, 08 Sep, 23:17
Hugh Hyndman PushDown Filter Not Reset Sun, 09 Sep, 10:56
Mich Talebzadeh Re: Using MongoDB as an Operational Data Store (ODS) with Spark Streaming Sun, 09 Sep, 18:57
Stavros Kontopoulos custom sink & model transformation Mon, 10 Sep, 00:16
amittonge Re: Register UDF duration runtime Mon, 10 Sep, 08:58
Rich Bowen Speakers needed for Apache DC Roadshow Tue, 11 Sep, 15:05
Mich Talebzadeh Drawing Big Data tech diagrams using Pen Tablets Tue, 11 Sep, 19:20
Aakash Basu [Help] Set nThread in Spark cluster Wed, 12 Sep, 08:40
Stephen Boesch Fixing NullType for parquet files Wed, 12 Sep, 17:26
Gourav Sengupta Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 17:34
Mich Talebzadeh Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 18:31
Jörn Franke Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 18:38
Mich Talebzadeh Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 18:45
Gourav Sengupta Re: Drawing Big Data tech diagrams using Pen Tablets Wed, 12 Sep, 20:46
ayan guha Re: Drawing Big Data tech diagrams using Pen Tablets Thu, 13 Sep, 00:38
Pekka Lehtonen Unsubscribe Thu, 13 Sep, 14:17
Guillermo Ortiz Fernández Trying to improve performance of the driver. Thu, 13 Sep, 15:48
Jonas Shomorony Python Dependencies Issue on EMR Fri, 14 Sep, 02:08
Aakash Basu Local vs Cluster Fri, 14 Sep, 08:21
Mich Talebzadeh Re: Local vs Cluster Fri, 14 Sep, 08:35
Apostolos N. Papadopoulos Re: Local vs Cluster Fri, 14 Sep, 08:38
kant kodali Is there any open source framework that converts Cypher to SparkSQL? Fri, 14 Sep, 09:42
Guillermo Ortiz DAGScheduler in SparkStreaming Fri, 14 Sep, 10:35
Sergejs Andrejevs Spark2 DynamicAllocation doesn't release executors that used cache Fri, 14 Sep, 11:33
Mohan Palavancha Re: Unsubscribe Fri, 14 Sep, 13:18
kathleen li What is the best way for Spark to read HDF5@scale? Fri, 14 Sep, 14:26
Patrick McCarthy Re: Python Dependencies Issue on EMR Fri, 14 Sep, 15:02
LeoB Re: StackOverflow Error when run ALS with 100 iterations Fri, 14 Sep, 17:10
Daniele Foroni [SparkSQL] Count Distinct issue Fri, 14 Sep, 18:54
johkelly [Spark SQL] Catalyst ScalaReflection/ExpressionEncoder fail with relocated (shaded) classes Fri, 14 Sep, 23:49
Erik Erlandson Should python-2 be supported in Spark 3.0? Sat, 15 Sep, 18:09
Erik Erlandson Re: Should python-2 be supported in Spark 3.0? Sat, 15 Sep, 18:46
ddukek FlatMapGroupsFunction Without Running Out of Memory For Large Groups Sat, 15 Sep, 20:49
Garlapati, Suryanarayana (Nokia - IN/Bangalore) Support STS to run in k8s deployment with spark deployment mode as cluster Sun, 16 Sep, 04:45
Or Rappel-Kroyzer unsubscribe Sun, 16 Sep, 05:28
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Aug 2019107
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137