spark-user mailing list archives: June 2018

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
刘崇光 Fwd: array_contains in package org.apache.spark.sql.functions Thu, 14 Jun, 09:15
刘崇光 Re: array_contains in package org.apache.spark.sql.functions Thu, 14 Jun, 21:42
刘崇光 unsubscribe Fri, 15 Jun, 16:20
李斌松 If there is timestamp type data in DF, Spark 2.3 toPandas is much slower than spark 2.2. Thu, 07 Jun, 04:22
杜斌 Register UDF duration runtime Thu, 07 Jun, 10:32
Guillermo Ortiz Fernández Reset the offsets, Kafka 0.10 and Spark Thu, 07 Jun, 20:27
Zsolt Tóth withColumn on nested schema Wed, 13 Jun, 08:55
Jörn Franke Re: Sorting in Spark on multiple partitions Mon, 04 Jun, 05:17
Jörn Franke Re: [External] Re: Sorting in Spark on multiple partitions Mon, 04 Jun, 17:08
Jörn Franke Re: [External] Re: Sorting in Spark on multiple partitions Mon, 04 Jun, 17:28
Jörn Franke Re: [PySpark] Releasing memory after a spark job is finished Mon, 04 Jun, 19:41
Jörn Franke Re: [PySpark] Releasing memory after a spark job is finished Mon, 04 Jun, 20:18
Jörn Franke Re: [PySpark] Releasing memory after a spark job is finished Tue, 05 Jun, 05:15
Jörn Franke Re: Spark / Scala code not recognising the path? Sat, 09 Jun, 06:31
Jörn Franke Re: Spark / Scala code not recognising the path? Sat, 09 Jun, 07:40
Jörn Franke Re: Spark / Scala code not recognising the path? Sat, 09 Jun, 07:57
Jörn Franke Re: [Spark Optimization] Why is one node getting all the pressure? Mon, 11 Jun, 09:31
Jörn Franke Re: [Spark Optimization] Why is one node getting all the pressure? Mon, 11 Jun, 10:46
Jörn Franke Re: How to validate orc vectorization is working within spark application? Wed, 20 Jun, 03:51
Teemu Heikkilä Re: spark optimized pagination Mon, 11 Jun, 07:58
uğur sopaoğlu Re: Launch a pyspark Job From UI Mon, 11 Jun, 11:24
@Nan...@ Reg:- Py4JError in Windows 10 with Spark Tue, 05 Jun, 09:42
ARAVIND ARUMUGHAM Sethurathnam unsubscribe Fri, 15 Jun, 16:21
ARAVIND SETHURATHNAM Spark batch job: failed to compile: java.lang.NullPointerException Mon, 18 Jun, 20:56
ARAVIND SETHURATHNAM Re: Spark batch job: failed to compile: java.lang.NullPointerException Mon, 18 Jun, 22:56
Aakash Basu [Spark SQL] Efficiently calculating Weight of Evidence in PySpark Fri, 01 Jun, 08:14
Aakash Basu Re: Append In-Place to S3 Sat, 02 Jun, 17:22
Aakash Basu [Spark Streaming] Distinct Count on unrelated columns Wed, 06 Jun, 11:02
Aakash Basu Fundamental Question on Spark's distribution Thu, 07 Jun, 09:53
Aakash Basu Spark YARN job submission error (code 13) Fri, 08 Jun, 08:05
Aakash Basu Spark YARN Error - triggering spark-shell Fri, 08 Jun, 08:36
Aakash Basu Re: Spark YARN job submission error (code 13) Fri, 08 Jun, 09:14
Aakash Basu Re: Spark YARN Error - triggering spark-shell Fri, 08 Jun, 09:14
Aakash Basu Re: Spark YARN job submission error (code 13) Fri, 08 Jun, 11:03
Aakash Basu Re: Spark YARN Error - triggering spark-shell Fri, 08 Jun, 11:04
Aakash Basu Can't see Spark UI when submitting through YARN Fri, 08 Jun, 11:36
Aakash Basu [Spark Optimization] Why is one node getting all the pressure? Mon, 11 Jun, 09:13
Aakash Basu Re: [Spark Optimization] Why is one node getting all the pressure? Mon, 11 Jun, 10:22
Aakash Basu Re: [Spark Optimization] Why is one node getting all the pressure? Mon, 11 Jun, 10:46
Aakash Basu Re: [Spark Optimization] Why is one node getting all the pressure? Mon, 11 Jun, 12:53
Aakash Basu Re: [Spark Optimization] Why is one node getting all the pressure? Tue, 12 Jun, 08:09
Aakash Basu Query on Spark Driver CPU and Memory utilization Tue, 12 Jun, 11:41
Aakash Basu Re: [Spark Optimization] Why is one node getting all the pressure? Tue, 12 Jun, 12:43
Aakash Basu Inferring from Event Timeline Wed, 13 Jun, 08:58
Aakash Basu Re: Query on Spark Driver CPU and Memory utilization Wed, 13 Jun, 09:00
Aakash Basu Re: [Spark Optimization] Why is one node getting all the pressure? Wed, 13 Jun, 10:02
Aakash Basu Crosstab/AproxQuantile Performance on Spark Cluster Thu, 14 Jun, 06:31
Aakash Basu Using G1GC in Spark Thu, 14 Jun, 11:14
Aakash Basu Re: Using G1GC in Spark Thu, 14 Jun, 13:28
Aakash Basu Issue upgrading to Spark 2.3.1 (Maintenance Release) Fri, 15 Jun, 05:01
Aakash Basu Understanding Event Timeline of Spark UI Fri, 15 Jun, 09:19
Aakash Basu [Help] Codegen Stage grows beyond 64 KB Sat, 16 Jun, 20:27
Aakash Basu Re: [Help] Codegen Stage grows beyond 64 KB Sun, 17 Jun, 05:16
Aakash Basu StackOverFlow ERROR - Bulk interaction for many columns fail Mon, 18 Jun, 10:45
Aakash Basu Fwd: StackOverFlow ERROR - Bulk interaction for many columns fail Mon, 18 Jun, 11:28
Aakash Basu Re: Best way to process this dataset Tue, 19 Jun, 07:40
Aakash Basu G1GC vs ParallelGC Wed, 20 Jun, 06:18
Aakash Basu Way to avoid CollectAsMap in RandomForest Wed, 20 Jun, 06:58
Aakash Basu Re: [Help] Codegen Stage grows beyond 64 KB Wed, 20 Jun, 16:29
Abdeali Kothari Repartition not working on a csv file Mon, 18 Jun, 21:49
Abhijeet Kumar Spark / Scala code not recognising the path? Sat, 09 Jun, 06:07
Abhijeet Kumar Re: Spark / Scala code not recognising the path? Sat, 09 Jun, 06:34
Abhijeet Kumar Re: Spark / Scala code not recognising the path? Sat, 09 Jun, 07:44
Abhijeet Kumar Re: Spark / Scala code not recognising the path? Sat, 09 Jun, 07:59
Abhijeet Kumar Not able to overwrite cassandra table using Spark Wed, 27 Jun, 17:45
Alessandro Solimando Re: [Spark SQL] error in performing dataset union with complex data type (struct, list) Sun, 03 Jun, 14:35
Amiya Mishra Re: How to branch a Stream / have multiple Sinks / do multiple Queries on one Stream Wed, 13 Jun, 08:59
Amol Zambare spark kafka consumer with kerberos - login error Tue, 19 Jun, 15:32
Anastasios Zouzias Re: Dataframe from 1.5G json (non JSONL) Tue, 05 Jun, 18:55
Apostolos N. Papadopoulos Re: Increase no of tasks Fri, 22 Jun, 18:55
Apostolos N. Papadopoulos Re: Create an Empty dataframe Sat, 30 Jun, 15:51
Arbab Khalil Understanding Spark behavior when reading from Kafka in static dataframe Wed, 13 Jun, 06:19
Arjun kr Spark user classpath setting Thu, 14 Jun, 20:28
Arjun kr Re: Spark user classpath setting Thu, 14 Jun, 21:29
Becket Qin [Spark SQL] Is it possible to do stream to stream inner join without event time? Fri, 01 Jun, 10:10
Becket Qin Re: [Spark SQL] Is it possible to do stream to stream inner join without event time? Mon, 04 Jun, 04:13
Behroz Sikander [SparkLauncher] stateChanged event not received in standalone cluster mode Wed, 06 Jun, 12:18
Benjamin Kim Append In-Place to S3 Fri, 01 Jun, 16:00
Benjamin Kim Re: Append In-Place to S3 Sat, 02 Jun, 16:56
Benjamin Kim Re: Append In-Place to S3 Thu, 07 Jun, 14:56
Biplob Biswas Using newApiHadoopRDD for reading from HBase Thu, 28 Jun, 09:13
Biplob Biswas Re: Using newApiHadoopRDD for reading from HBase Fri, 29 Jun, 09:23
Bryan Jeffrey Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 15:25
Bryan Jeffrey Re: Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 20:22
Bryan Jeffrey Re: Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 20:33
Bryan Jeffrey Re: Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 21:15
Chawla,Sumit RepartitionByKey Behavior Thu, 21 Jun, 23:51
Chawla,Sumit Re: RepartitionByKey Behavior Thu, 21 Jun, 23:55
Chawla,Sumit Re: RepartitionByKey Behavior Wed, 27 Jun, 04:52
Chetan Khatri Apply Core Java Transformation UDF on DataFrame Mon, 04 Jun, 20:11
Chetan Khatri Re: Apply Core Java Transformation UDF on DataFrame Tue, 05 Jun, 20:52
Cody Koeninger Re: Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 20:00
Cody Koeninger Re: Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 20:24
Cody Koeninger Re: Kafka Offset Storage: Fetching Offsets Thu, 14 Jun, 21:01
Daniel Haviv Setting log level to DEBUG while keeping httpclient.wire on WARN Fri, 29 Jun, 07:16
Daniel Pires [Spark-sql Dataset] .as[SomeClass] not modifying Physical Plan Sun, 17 Jun, 20:48
Daniel Pires Re: [Spark SQL]: How to read Hive tables with Sub directories - is this supported? Wed, 20 Jun, 09:14
Daniel Pires Re: [Spark SQL]: How to read Hive tables with Sub directories - is this supported? Wed, 20 Jun, 23:02
Daniele Foroni [Spark Streaming] Measure latency Tue, 26 Jun, 09:50
Deepak Goel Re: spark optimized pagination Sun, 10 Jun, 12:10
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019207
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137