spark-user mailing list archives: April 2020

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Hamish Whittal MySQL query continually add IS NOT NULL onto a query even though I don't request it Wed, 01 Apr, 05:47
Hamish Whittal   Re: MySQL query continually add IS NOT NULL onto a query even though I don't request it Thu, 02 Apr, 08:12
Hrishikesh Mishra Spark Streaming on Compact Kafka topic - consumers 1 message per partition per batch Wed, 01 Apr, 06:30
Waleed Fateem   Re: Spark Streaming on Compact Kafka topic - consumers 1 message per partition per batch Thu, 02 Apr, 03:18
Hrishikesh Mishra     Re: Spark Streaming on Compact Kafka topic - consumers 1 message per partition per batch Wed, 08 Apr, 11:13
Jing Lu [ML] How to find the default hyperparameters for models in SparkML? Wed, 01 Apr, 23:43
psschwei [PySpark][K8s] Question about a file in `/etc/apache2` Thu, 02 Apr, 01:39
Manjunath Shetty H Spark 1.6 and ORC bucketed queries Thu, 02 Apr, 03:18
unsubscribe
Alfredo Marquez   unsubscribe Thu, 02 Apr, 13:16
Denis DEBARBIEUX   unsubscribe Fri, 03 Apr, 07:17
Jiang, Lan   unsubscribe Thu, 16 Apr, 09:44
sridhararao mutluri   unsubscribe Thu, 16 Apr, 17:25
Rong, Jialei   unsubscribe Thu, 16 Apr, 17:27
akram azarm   unsubscribe Thu, 23 Apr, 05:16
vijay krishna   unsubscribe Fri, 24 Apr, 17:14
David Aspegren   unsubscribe Sun, 26 Apr, 14:55
siqi chen   unsubscribe Sun, 26 Apr, 23:49
Hongbin Liu   unsubscribe Mon, 27 Apr, 13:20
Zeming Yu   unsubscribe Wed, 29 Apr, 07:53
Unsubscribe
Alfredo Marquez   Unsubscribe Thu, 02 Apr, 13:59
Natalie Ruiz   Unsubscribe Mon, 27 Apr, 14:04
Srinivasaraghavan, Vinod   Unsubscribe Tue, 28 Apr, 12:31
Deepak Sharma   Unsubscribe Wed, 29 Apr, 06:33
Yotto Koga   Unsubscribe Wed, 29 Apr, 07:15
Re: Unablee to get to_timestamp with Timezone Information
Enrico Minack   Re: Unablee to get to_timestamp with Timezone Information Thu, 02 Apr, 15:49
Chetan Khatri     Re: Unablee to get to_timestamp with Timezone Information Tue, 28 Apr, 23:27
Aakash Basu INTERVAL function not working Thu, 02 Apr, 16:06
Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt
jane thorpe   Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Fri, 03 Apr, 01:44
jane thorpe   Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Tue, 07 Apr, 04:12
Aakash Basu unix_timestamp() equivalent in plain Spark SQL Query Fri, 03 Apr, 03:47
Marshall Markham Spark-3.0.0 GA Fri, 03 Apr, 12:17
Marshall Markham   Re: Spark-3.0.0 GA Fri, 17 Apr, 11:30
Sean Owen     Re: Spark-3.0.0 GA Fri, 17 Apr, 13:12
Marshall Markham       Re: Spark-3.0.0 GA Mon, 20 Apr, 15:15
Marshall Markham spark-submit exit status on k8s Fri, 03 Apr, 12:23
Masood Krohy   Re: spark-submit exit status on k8s Sat, 04 Apr, 01:34
Marshall Markham     RE: spark-submit exit status on k8s Sat, 04 Apr, 11:49
Masood Krohy       Re: spark-submit exit status on k8s Sat, 04 Apr, 14:54
Masood Krohy         Re: spark-submit exit status on k8s Sun, 05 Apr, 15:24
Yinan Li           Re: spark-submit exit status on k8s Sun, 05 Apr, 19:48
Marshall Markham             RE: spark-submit exit status on k8s Mon, 06 Apr, 14:53
Marshall Markham           RE: spark-submit exit status on k8s Mon, 06 Apr, 14:51
em...@yeikel.com Serialization or internal functions? Sat, 04 Apr, 18:07
Som Lima   Re: Serialization or internal functions? Sun, 05 Apr, 06:21
yeikel valdes     Re: Serialization or internal functions? Tue, 07 Apr, 16:14
Som Lima       Re: Serialization or internal functions? Tue, 07 Apr, 18:52
Vadim Semenov   Re: Serialization or internal functions? Thu, 09 Apr, 13:56
(float(9)/5)*x + 32) when x = 12.8
jane thorpe   (float(9)/5)*x + 32) when x = 12.8 Sun, 05 Apr, 03:33
Lian Jiang pandas_udf is very slow Sun, 05 Apr, 07:28
Silvio Fiorito   Re: pandas_udf is very slow Sun, 05 Apr, 13:18
Lian Jiang     Re: pandas_udf is very slow Sun, 05 Apr, 16:50
Gourav Sengupta   Re: pandas_udf is very slow Mon, 06 Apr, 08:08
Sumit Agrawal Spark, read from Kafka stream failing AnalysisException Sun, 05 Apr, 15:09
Tathagata Das   Re: Spark, read from Kafka stream failing AnalysisException Sun, 05 Apr, 22:38
Fwd: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt
jane thorpe   Fwd: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Mon, 06 Apr, 06:04
Som Lima     Re: HDFS file hdfs://127.0.0.1:9000/hdfs/spark/examples/README.txt Mon, 06 Apr, 11:36
kant kodali How does spark sql evaluate case statements? Mon, 06 Apr, 07:55
Yeikel   Re: How does spark sql evaluate case statements? Tue, 14 Apr, 18:22
ZHANG Wei     Re: How does spark sql evaluate case statements? Fri, 17 Apr, 04:03
kant kodali       Re: How does spark sql evaluate case statements? Fri, 17 Apr, 14:21
simonhampe Security vulnerabilities due to Jackson Databind Mon, 06 Apr, 08:07
Andrew Melo Scala version compatibility Mon, 06 Apr, 19:49
Koert Kuipers   Re: Scala version compatibility Mon, 06 Apr, 20:07
Andrew Melo     Re: Scala version compatibility Mon, 06 Apr, 20:15
Koert Kuipers       Re: Scala version compatibility Mon, 06 Apr, 20:30
Andrew Melo         Re: Scala version compatibility Mon, 06 Apr, 21:09
Koert Kuipers           Re: Scala version compatibility Tue, 07 Apr, 19:23
Som Lima   Re: Scala version compatibility Mon, 06 Apr, 20:10
Vadim Vararu Lifecycle of a map function Tue, 07 Apr, 08:44
Zahid Rahman IDE suitable for Spark Tue, 07 Apr, 08:45
yeikel valdes   Re: IDE suitable for Spark Tue, 07 Apr, 16:09
Stephen Boesch     Re: IDE suitable for Spark Tue, 07 Apr, 16:18
Dennis Suhari     Re:  IDE suitable for Spark Tue, 07 Apr, 16:18
Luiz Camargo       Re: IDE suitable for Spark Tue, 07 Apr, 17:26
Pat Ferrel         Re: IDE suitable for Spark Tue, 07 Apr, 17:28
Som Lima           Re: IDE suitable for Spark : Monitoring & Debugging Spark Jobs Tue, 07 Apr, 21:01
Nikaash Puri         Re: IDE suitable for Spark Tue, 07 Apr, 17:32
Yi Huang Spark Union Breaks Caching Behaviour Tue, 07 Apr, 16:44
anbutech How to handle Null values in Array of struct elements in pyspark Wed, 08 Apr, 06:10
[Pyspark] - Spark uses all available memory; unrelated to size of dataframe
Daniel Stojanov   [Pyspark] - Spark uses all available memory; unrelated to size of dataframe Wed, 08 Apr, 12:58
Yeikel     Re: [Pyspark] - Spark uses all available memory; unrelated to size of dataframe Thu, 16 Apr, 03:17
jane thorpe   Re: [Pyspark] - Spark uses all available memory; unrelated to size of dataframe Thu, 16 Apr, 05:24
Ruijing Li Can you view thread dumps on spark UI if job finished Wed, 08 Apr, 22:47
Zahid Rahman   Re: Can you view thread dumps on spark UI if job finished Wed, 08 Apr, 23:01
Ruijing Li     Re: Can you view thread dumps on spark UI if job finished Wed, 08 Apr, 23:50
Zahid Rahman       Re: Can you view thread dumps on spark UI if job finished Thu, 09 Apr, 00:24
[Spark MLlib]: Multiple input dataframes and non-linear ML pipeline
Qingsheng Ren   [Spark MLlib]: Multiple input dataframes and non-linear ML pipeline Thu, 09 Apr, 08:36
Qingsheng Ren   [Spark MLlib]: Multiple input dataframes and non-linear ML pipeline Thu, 09 Apr, 08:47
Re: Read Hive ACID Managed table in Spark
amogh margoor   Re: Read Hive ACID Managed table in Spark Thu, 09 Apr, 17:10
Chetan Khatri     Re: Read Hive ACID Managed table in Spark Tue, 28 Apr, 23:29
Prudhvi Chennuru (CONT) Driver pods stuck in running state indefinitely Thu, 09 Apr, 18:44
Wei Zhang   Re: Driver pods stuck in running state indefinitely Fri, 10 Apr, 02:49
Prudhvi Chennuru (CONT)     Re: [External Sender] Re: Driver pods stuck in running state indefinitely Fri, 10 Apr, 17:03
Zhang Wei       Re: [External Sender] Re: Driver pods stuck in running state indefinitely Mon, 13 Apr, 05:52
Fwd: How to import PySpark into Jupyter
Yasir Elgohary   Fwd: How to import PySpark into Jupyter Fri, 10 Apr, 11:04
Akchhaya S     Re: How to import PySpark into Jupyter Fri, 10 Apr, 12:36
Spark hangs while reading from jdbc - does nothing
Ruijing Li   Spark hangs while reading from jdbc - does nothing Fri, 10 Apr, 16:37
Mich Talebzadeh     Re: Spark hangs while reading from jdbc - does nothing Sat, 11 Apr, 17:49
jane thorpe   Re: Spark hangs while reading from jdbc - does nothing Sun, 12 Apr, 03:33
jane thorpe     Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Mon, 13 Apr, 07:31
jane thorpe       Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 14 Apr, 09:31
Gabor Somogyi         Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 14 Apr, 11:48
Ruijing Li           Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Thu, 16 Apr, 07:20
Jungtaek Lim             Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Thu, 16 Apr, 07:36
ZHANG Wei               Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Thu, 16 Apr, 08:54
Ruijing Li                 Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 21 Apr, 16:58
Ruijing Li                   Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 21 Apr, 17:33
Ruijing Li                     Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Tue, 21 Apr, 17:38
Jungtaek Lim                       Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Wed, 22 Apr, 02:12
Ruijing Li                         Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Wed, 22 Apr, 02:50
Jungtaek Lim                           Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Wed, 22 Apr, 03:21
ZHANG Wei                           Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Thu, 23 Apr, 10:26
Waleed Fateem                           Re: Spark hangs while reading from jdbc - does nothing Removing Guess work from trouble shooting Fri, 24 Apr, 11:34
Debabrata Ghosh Spark Streaming not working Fri, 10 Apr, 17:34
Srinivas V   Re: Spark Streaming not working Fri, 10 Apr, 17:44
Debabrata Ghosh     Re: Spark Streaming not working Fri, 10 Apr, 18:00
Chenguang He       Re: Spark Streaming not working Fri, 10 Apr, 18:22
Debabrata Ghosh   Re: Spark Streaming not working Fri, 10 Apr, 18:25
ZHANG Wei     Re: Spark Streaming not working Tue, 14 Apr, 09:44
Gabor Somogyi       Re: Spark Streaming not working Tue, 14 Apr, 11:32
Gabor Somogyi         Re: Spark Streaming not working Tue, 14 Apr, 11:34
Gerard Maas   Re: Spark Streaming not working Tue, 14 Apr, 11:41
COVID 19 data
jane thorpe   COVID 19 data Sun, 12 Apr, 19:22
covid 19 Data [DISCUSSION]
jane thorpe   covid 19 Data [DISCUSSION] Sun, 12 Apr, 19:30
Shamshad Ansari     Re: covid 19 Data [DISCUSSION] Sun, 12 Apr, 19:38
Teemu Heikkilä     Re: covid 19 Data [DISCUSSION] Sun, 12 Apr, 21:33
jane thorpe       Re: covid 19 Data [DISCUSSION] Mon, 13 Apr, 05:02
Lian Jiang Spark interrupts S3 request backoff Mon, 13 Apr, 02:43
ZHANG Wei   Re: Spark interrupts S3 request backoff Tue, 14 Apr, 09:20
Gabor Somogyi     Re: Spark interrupts S3 request backoff Tue, 14 Apr, 13:15
yeikel valdes What is the best way to take the top N entries from a hive table/data source? Tue, 14 Apr, 06:35
Yeikel   Re: What is the best way to take the top N entries from a hive table/data source? Tue, 14 Apr, 18:45
ZHANG Wei     Re: What is the best way to take the top N entries from a hive table/data source? Tue, 21 Apr, 09:46
Yeikel       Re: What is the best way to take the top N entries from a hive table/data source? Wed, 22 Apr, 04:17
ZHANG Wei       Re: What is the best way to take the top N entries from a hive table/data source? Wed, 22 Apr, 11:45
zwithouta [Spark Core]: Does an executor only cache the partitions it requires for its computations or always the full RDD? Tue, 14 Apr, 10:28
ZHANG Wei   Re: [Spark Core]: Does an executor only cache the partitions it requires for its computations or always the full RDD? Thu, 16 Apr, 09:31
Kaan Sancak Question on writing batch synchronized incremental graph algorithms Tue, 14 Apr, 16:57
Yeikel Is there any way to set the location of the history for the spark-shell per session? Tue, 14 Apr, 18:20
ZHANG Wei   Re: Is there any way to set the location of the history for the spark-shell per session? Thu, 16 Apr, 07:20
Yeikel     Re: Is there any way to set the location of the history for the spark-shell per session? Thu, 16 Apr, 21:24
ZHANG Wei     Re: Is there any way to set the location of the history for the spark-shell per session? Fri, 17 Apr, 02:29
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 202081
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137