spark-user mailing list archives: May 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
880f0464 UnresolvedException: Invalid call to dataType on unresolved object Tue, 01 May, 11:14
880f0464 spark.python.worker.reuse not working as expected Tue, 01 May, 11:17
880f0464 PySpark.sql.filter not performing as it should Tue, 01 May, 11:19
☼ R Nair (रविशंकर नायर) Re: Spark Structured Streaming is giving error “org.apache.spark.sql.AnalysisException: Inner join between two streaming DataFrames/Datasets is not supported;” Sat, 12 May, 19:35
☼ R Nair (रविशंकर नायर) Re: Spark Structured Streaming is giving error “org.apache.spark.sql.AnalysisException: Inner join between two streaming DataFrames/Datasets is not supported;” Tue, 15 May, 15:36
付涛 stage blocked sometimes Sun, 06 May, 14:22
崔苗 what defines dataset partition number in spark sql Sat, 26 May, 06:24
Jiří Syrový [Structured streaming, V2] commit on ContinuousReader Thu, 03 May, 17:43
David Ignjić Fwd: Array[Double] two time slower then DenseVector Wed, 09 May, 14:23
Guillermo Ortiz Fernández Measure performance time in some spark transformations. Sat, 12 May, 22:31
王 纯超 Watch Zookeeper in Spark Closure Mon, 07 May, 08:38
정유선님(JUNG YOUSUN) RE: How to Spark can solve this example Fri, 18 May, 09:12
Jörn Franke Re: ordered ingestion not guaranteed Sat, 12 May, 05:34
Jörn Franke Re: Measure performance time in some spark transformations. Sun, 13 May, 08:43
Jörn Franke Re: spark sql StackOverflow Tue, 15 May, 09:54
Jörn Franke Re: [Java] impact of java 10 on spark dev Wed, 16 May, 08:44
Jörn Franke Re: Wed, 16 May, 09:41
Jörn Franke Re: Time series data Thu, 24 May, 07:01
Jörn Franke Re: Why Spark JDBC Writing in a sequential order Fri, 25 May, 14:50
ARAVIND ARUMUGHAM Sethurathnam SPARK SQL: returns null for a column, while HIVE query returns data for the same column Fri, 11 May, 19:24
ARAVIND ARUMUGHAM Sethurathnam Re: SPARK SQL: returns null for a column, while HIVE query returns data for the same column Fri, 11 May, 20:08
Aakash Basu XGBoost on PySpark Sat, 19 May, 06:51
Aakash Basu Fwd: XGBoost on PySpark Wed, 23 May, 06:02
Aakash Basu [Query] Weight of evidence on Spark Fri, 25 May, 17:42
Aakash Basu Spark 2.3 Memory Leak on Executor Sat, 26 May, 12:43
Aakash Basu Spark 2.3 Tree Error Sat, 26 May, 12:46
Aakash Basu Silly question on Dropping Temp Table Sat, 26 May, 15:26
Aakash Basu Re: Silly question on Dropping Temp Table Sat, 26 May, 15:53
Aakash Basu Re: Silly question on Dropping Temp Table Sat, 26 May, 15:54
Aakash Basu Re: Spark 2.3 Tree Error Sat, 26 May, 16:15
Aakash Basu Re: Spark 2.3 Tree Error Sat, 26 May, 16:25
Aakash Basu Spark AsyncEventQueue doubt Sun, 27 May, 07:45
Aakash Basu [Suggestions needed] Weight of Evidence PySpark Thu, 31 May, 09:50
Aakash Basu [Help] PySpark Dynamic mean calculation Thu, 31 May, 10:10
Aakash Basu Fwd: [Help] PySpark Dynamic mean calculation Thu, 31 May, 11:53
Agostino Calamita spark.executor.extraJavaOptions inside application code Wed, 02 May, 10:59
Ajay Re: UDTF registration fails for hiveEnabled SQLContext Tue, 15 May, 12:40
Ajay Re: Does Spark shows logical or physical plan when executing job on the yarn cluster Sun, 20 May, 07:26
Ajay Re: Bulk / Fast Read and Write with MSSQL Server and Spark Wed, 23 May, 19:09
Ajay Re: Blockmgr directories intermittently not being cleaned up Wed, 30 May, 15:54
Alchemist Malformed URL Exception when connecting to Phoenix to Spark Wed, 09 May, 12:38
Alchemist Spark UNEVENLY distributing data Sat, 19 May, 22:40
Alchemist Write data from Hbase using Spark Failing with NPE Thu, 24 May, 03:47
Alessandro Solimando Re: spark sql StackOverflow Tue, 15 May, 06:56
Alessandro Solimando Re: spark sql StackOverflow Tue, 15 May, 09:48
Alonso Isidoro Roman Re: is it possible to create one KafkaDirectStream (Dstream) per topic? Mon, 21 May, 08:44
Alonso Isidoro Roman Re: [Spark2.1] SparkStreaming to Cassandra performance problem Mon, 21 May, 10:01
Anastasios Zouzias Re: Fastest way to drop useless columns Thu, 31 May, 08:50
Anirudh Ramanathan Re: Spark driver pod eviction Kubernetes Tue, 22 May, 19:15
Anirudh Ramanathan Re: Spark driver pod garbage collection Wed, 23 May, 18:20
Anirudh Ramanathan Re: Spark 2.3 error on Kubernetes Tue, 29 May, 22:28
Anirudh Ramanathan Re: Spark 2.3 error on Kubernetes Tue, 29 May, 23:07
Arun Hive Closing IPC connection Wed, 30 May, 17:55
Arun Hive Re: Unable to alter partition. The transaction for alter partition did not commit successfully. Wed, 30 May, 17:58
Arun Mahadevan Re: question on collect_list or say aggregations in general in structured streaming 2.3.0 Thu, 03 May, 16:55
Biplob Biswas Spark Jobs ends when assignment not found for Kafka Partition Thu, 17 May, 08:28
Bowden, Chris Re: [structured-streaming]How to reset Kafka offset in readStream and read from beginning Tue, 22 May, 14:39
Bruno Aranda Cannot make Spark to honour the spark.jars.ivySettings config Wed, 23 May, 18:16
Bryan Cutler Re: [Arrow][Dremio] Tue, 15 May, 17:06
Bryan Cutler Re: How to use StringIndexer for multiple input /output columns in Spark Java Wed, 16 May, 17:34
Bryan Cutler Re: OneHotEncoderEstimator - java.lang.NoSuchMethodError: org.apache.spark.sql.Dataset.withColumns Fri, 18 May, 17:13
Bryan Cutler Re: Pandas UDF for PySpark error. Big Dataset Wed, 30 May, 00:25
Chao Fang RDD does not have sc error Fri, 18 May, 15:37
Chetan Khatri Livy Failed error on Yarn with Spark Wed, 09 May, 20:18
Chetan Khatri Bulk / Fast Read and Write with MSSQL Server and Spark Wed, 23 May, 11:46
Chetan Khatri Re: Bulk / Fast Read and Write with MSSQL Server and Spark Wed, 23 May, 13:36
Chetan Khatri Re: Bulk / Fast Read and Write with MSSQL Server and Spark Wed, 23 May, 14:32
Chetan Khatri Re: Bulk / Fast Read and Write with MSSQL Server and Spark Fri, 25 May, 14:42
Chetan Khatri GroupBy in Spark / Scala without Agg functions Tue, 29 May, 18:21
Chetan Khatri Re: GroupBy in Spark / Scala without Agg functions Tue, 29 May, 18:44
Chetan Khatri Re: GroupBy in Spark / Scala without Agg functions Tue, 29 May, 18:47
Chetan Khatri Re: GroupBy in Spark / Scala without Agg functions Tue, 29 May, 18:51
Chetan Khatri Re: 答复: GroupBy in Spark / Scala without Agg functions Wed, 30 May, 03:05
Christopher Piggott Running apps over a VPN Wed, 02 May, 15:57
Christopher Piggott Free Column Reference with $ Fri, 04 May, 14:10
Cody Koeninger Re: [Structured-Streaming][Beginner] Out of order messages with Spark kafka readstream from a specific partition Thu, 10 May, 14:54
Corey Nolet PySpark API on top of Apache Arrow Wed, 23 May, 20:30
Corey Nolet Re: PySpark API on top of Apache Arrow Sat, 26 May, 19:41
Daniel Du [PySpark Pipeline XGboost] How to use XGboost in PySpark Pipeline Thu, 31 May, 08:25
Daniel Galvez Interest in adding ability to request GPU's to the spark client? Wed, 16 May, 05:58
Daniel Haviv Thrift server not exposing temp tables (spark.sql.hive.thriftServer.singleSession=true) Wed, 30 May, 16:13
Daniele Foroni Dataset Caching and Unpersisting Wed, 02 May, 11:19
Davide Brambilla [No Subject] Wed, 16 May, 09:36
Davide Brambilla Re: Wed, 16 May, 10:20
Debabrata Ghosh Help Required - Unable to run spark-submit on YARN client mode Tue, 08 May, 11:35
Deepak Sharma Re: Help Required - Unable to run spark-submit on YARN client mode Tue, 08 May, 11:46
Deepak Sharma Re: Big data visualization Mon, 28 May, 04:07
Dhaval Modi Advice on multiple streaming job Sat, 05 May, 15:09
Dhaval Modi Re: Advice on multiple streaming job Sun, 06 May, 17:57
Dhaval Modi Re: Advice on multiple streaming job Sun, 06 May, 17:59
Dhaval Modi Re: Advice on multiple streaming job Mon, 07 May, 09:08
Divya Gehlot Re: Fastest way to drop useless columns Thu, 31 May, 09:16
Donni Khan problem with saving RandomForestClassifier model - Saprk Java Tue, 22 May, 09:08
Esa Heikkinen How to Spark can solve this example Fri, 18 May, 07:20
Esa Heikkinen RE: How to Spark can solve this example Fri, 18 May, 07:59
Esa Heikkinen Execution model in Spark Mon, 28 May, 07:19
Fawze Abujaber native-lzo library not available Thu, 03 May, 12:06
Fawze Abujaber Re: native-lzo library not available Fri, 04 May, 05:39
Felix Cheung Re: all calculations finished, but "VCores Used" value remains at its max Tue, 01 May, 15:53
Filippo Balicchia [No Subject] Wed, 02 May, 15:03
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019252
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137