spark-user mailing list archives: April 2020

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Hamish Whittal MySQL query continually add IS NOT NULL onto a query even though I don't request it Wed, 01 Apr, 05:47
Hrishikesh Mishra Spark Streaming on Compact Kafka topic - consumers 1 message per partition per batch Wed, 01 Apr, 06:30
Jing Lu [ML] How to find the default hyperparameters for models in SparkML? Wed, 01 Apr, 23:43
psschwei [PySpark][K8s] Question about a file in `/etc/apache2` Thu, 02 Apr, 01:39
Manjunath Shetty H Spark 1.6 and ORC bucketed queries Thu, 02 Apr, 03:18
Waleed Fateem Re: Spark Streaming on Compact Kafka topic - consumers 1 message per partition per batch Thu, 02 Apr, 03:18
Hamish Whittal Re: MySQL query continually add IS NOT NULL onto a query even though I don't request it Thu, 02 Apr, 08:12
Alfredo Marquez unsubscribe Thu, 02 Apr, 13:16
Alfredo Marquez Unsubscribe Thu, 02 Apr, 13:59
Enrico Minack Re: Unablee to get to_timestamp with Timezone Information Thu, 02 Apr, 15:49
Aakash Basu INTERVAL function not working Thu, 02 Apr, 16:06
jane thorpe Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Fri, 03 Apr, 01:44
Aakash Basu unix_timestamp() equivalent in plain Spark SQL Query Fri, 03 Apr, 03:47
Denis DEBARBIEUX unsubscribe Fri, 03 Apr, 07:17
Marshall Markham Spark-3.0.0 GA Fri, 03 Apr, 12:17
Marshall Markham spark-submit exit status on k8s Fri, 03 Apr, 12:23
Masood Krohy Re: spark-submit exit status on k8s Sat, 04 Apr, 01:34
Marshall Markham RE: spark-submit exit status on k8s Sat, 04 Apr, 11:49
Masood Krohy Re: spark-submit exit status on k8s Sat, 04 Apr, 14:54
em...@yeikel.com Serialization or internal functions? Sat, 04 Apr, 18:07
jane thorpe (float(9)/5)*x + 32) when x = 12.8 Sun, 05 Apr, 03:33
Som Lima Re: Serialization or internal functions? Sun, 05 Apr, 06:21
Lian Jiang pandas_udf is very slow Sun, 05 Apr, 07:28
Silvio Fiorito Re: pandas_udf is very slow Sun, 05 Apr, 13:18
Sumit Agrawal Spark, read from Kafka stream failing AnalysisException Sun, 05 Apr, 15:09
Masood Krohy Re: spark-submit exit status on k8s Sun, 05 Apr, 15:24
Lian Jiang Re: pandas_udf is very slow Sun, 05 Apr, 16:50
Yinan Li Re: spark-submit exit status on k8s Sun, 05 Apr, 19:48
Tathagata Das Re: Spark, read from Kafka stream failing AnalysisException Sun, 05 Apr, 22:38
jane thorpe Fwd: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Mon, 06 Apr, 06:04
kant kodali How does spark sql evaluate case statements? Mon, 06 Apr, 07:55
simonhampe Security vulnerabilities due to Jackson Databind Mon, 06 Apr, 08:07
Gourav Sengupta Re: pandas_udf is very slow Mon, 06 Apr, 08:08
Som Lima Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Mon, 06 Apr, 11:36
Marshall Markham RE: spark-submit exit status on k8s Mon, 06 Apr, 14:51
Marshall Markham RE: spark-submit exit status on k8s Mon, 06 Apr, 14:53
Andrew Melo Scala version compatibility Mon, 06 Apr, 19:49
Koert Kuipers Re: Scala version compatibility Mon, 06 Apr, 20:07
Som Lima Re: Scala version compatibility Mon, 06 Apr, 20:10
Andrew Melo Re: Scala version compatibility Mon, 06 Apr, 20:15
Koert Kuipers Re: Scala version compatibility Mon, 06 Apr, 20:30
Andrew Melo Re: Scala version compatibility Mon, 06 Apr, 21:09
jane thorpe Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Tue, 07 Apr, 04:12
Vadim Vararu Lifecycle of a map function Tue, 07 Apr, 08:44
Zahid Rahman IDE suitable for Spark Tue, 07 Apr, 08:45
yeikel valdes Re: IDE suitable for Spark Tue, 07 Apr, 16:09
yeikel valdes Re: Serialization or internal functions? Tue, 07 Apr, 16:14
Stephen Boesch Re: IDE suitable for Spark Tue, 07 Apr, 16:18
Dennis Suhari Re:  IDE suitable for Spark Tue, 07 Apr, 16:18
Yi Huang Spark Union Breaks Caching Behaviour Tue, 07 Apr, 16:44
Luiz Camargo Re: IDE suitable for Spark Tue, 07 Apr, 17:26
Pat Ferrel Re: IDE suitable for Spark Tue, 07 Apr, 17:28
Nikaash Puri Re: IDE suitable for Spark Tue, 07 Apr, 17:32
Som Lima Re: Serialization or internal functions? Tue, 07 Apr, 18:52
Koert Kuipers Re: Scala version compatibility Tue, 07 Apr, 19:23
Som Lima Re: IDE suitable for Spark : Monitoring & Debugging Spark Jobs Tue, 07 Apr, 21:01
anbutech How to handle Null values in Array of struct elements in pyspark Wed, 08 Apr, 06:10
Hrishikesh Mishra Re: Spark Streaming on Compact Kafka topic - consumers 1 message per partition per batch Wed, 08 Apr, 11:13
Daniel Stojanov [Pyspark] - Spark uses all available memory; unrelated to size of dataframe Wed, 08 Apr, 12:58
Ruijing Li Can you view thread dumps on spark UI if job finished Wed, 08 Apr, 22:47
Zahid Rahman Re: Can you view thread dumps on spark UI if job finished Wed, 08 Apr, 23:01
Ruijing Li Re: Can you view thread dumps on spark UI if job finished Wed, 08 Apr, 23:50
Zahid Rahman Re: Can you view thread dumps on spark UI if job finished Thu, 09 Apr, 00:24
Qingsheng Ren [Spark MLlib]: Multiple input dataframes and non-linear ML pipeline Thu, 09 Apr, 08:36
Qingsheng Ren [Spark MLlib]: Multiple input dataframes and non-linear ML pipeline Thu, 09 Apr, 08:47
Vadim Semenov Re: Serialization or internal functions? Thu, 09 Apr, 13:56
amogh margoor Re: Read Hive ACID Managed table in Spark Thu, 09 Apr, 17:10
Prudhvi Chennuru (CONT) Driver pods stuck in running state indefinitely Thu, 09 Apr, 18:44
Wei Zhang Re: Driver pods stuck in running state indefinitely Fri, 10 Apr, 02:49
Yasir Elgohary Fwd: How to import PySpark into Jupyter Fri, 10 Apr, 11:04
Akchhaya S Re: How to import PySpark into Jupyter Fri, 10 Apr, 12:36
Ruijing Li Spark hangs while reading from jdbc - does nothing Fri, 10 Apr, 16:37
Prudhvi Chennuru (CONT) Re: [External Sender] Re: Driver pods stuck in running state indefinitely Fri, 10 Apr, 17:03
Debabrata Ghosh Spark Streaming not working Fri, 10 Apr, 17:34
Srinivas V Re: Spark Streaming not working Fri, 10 Apr, 17:44
Debabrata Ghosh Re: Spark Streaming not working Fri, 10 Apr, 18:00
Chenguang He Re: Spark Streaming not working Fri, 10 Apr, 18:22
Debabrata Ghosh Re: Spark Streaming not working Fri, 10 Apr, 18:25
Mich Talebzadeh Re: Spark hangs while reading from jdbc - does nothing Sat, 11 Apr, 17:49
jane thorpe Re: Spark hangs while reading from jdbc - does nothing Sun, 12 Apr, 03:33
jane thorpe COVID 19 data Sun, 12 Apr, 19:22
jane thorpe covid 19 Data [DISCUSSION] Sun, 12 Apr, 19:30
Shamshad Ansari Re: covid 19 Data [DISCUSSION] Sun, 12 Apr, 19:38
Teemu Heikkilä Re: covid 19 Data [DISCUSSION] Sun, 12 Apr, 21:33
Lian Jiang Spark interrupts S3 request backoff Mon, 13 Apr, 02:43
jane thorpe Re: covid 19 Data [DISCUSSION] Mon, 13 Apr, 05:02
Zhang Wei Re: [External Sender] Re: Driver pods stuck in running state indefinitely Mon, 13 Apr, 05:52
jane thorpe Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Mon, 13 Apr, 07:31
yeikel valdes What is the best way to take the top N entries from a hive table/data source? Tue, 14 Apr, 06:35
ZHANG Wei Re: Spark interrupts S3 request backoff Tue, 14 Apr, 09:20
jane thorpe Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 14 Apr, 09:31
ZHANG Wei Re: Spark Streaming not working Tue, 14 Apr, 09:44
zwithouta [Spark Core]: Does an executor only cache the partitions it requires for its computations or always the full RDD? Tue, 14 Apr, 10:28
Gabor Somogyi Re: Spark Streaming not working Tue, 14 Apr, 11:32
Gabor Somogyi Re: Spark Streaming not working Tue, 14 Apr, 11:34
Gerard Maas Re: Spark Streaming not working Tue, 14 Apr, 11:41
Gabor Somogyi Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 14 Apr, 11:48
Gabor Somogyi Re: Spark interrupts S3 request backoff Tue, 14 Apr, 13:15
Kaan Sancak Question on writing batch synchronized incremental graph algorithms Tue, 14 Apr, 16:57
Yeikel Is there any way to set the location of the history for the spark-shell per session? Tue, 14 Apr, 18:20
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2020221
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137