spark-user mailing list archives: March 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Shmuel Blitz Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Thu, 22 Mar, 15:05
Shmuel Blitz Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Thu, 22 Mar, 22:43
Shmuel Blitz Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Sun, 25 Mar, 07:34
Shmuel Blitz Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Sun, 25 Mar, 07:55
Shmuel Blitz Re: Open sourcing Sparklens: Qubole's Spark Tuning Tool Sun, 25 Mar, 20:08
Shmuel Blitz Re: the issue about the + in column,can we support the string please? Mon, 26 Mar, 07:31
Shmuel Blitz Re: Re: the issue about the + in column,can we support the string please? Mon, 26 Mar, 09:17
Shmuel Blitz Re: Class cast exception while using Data Frames Tue, 27 Mar, 06:51
Shuporno Choudhury Multiple columns using 'isin' command in pyspark Thu, 29 Mar, 15:52
Shuxin Yang how to kill application Tue, 27 Mar, 05:17
Sidney Feiner Stopping StreamingContext Thu, 29 Mar, 14:27
Silvio Fiorito Re: Writing a DataFrame is taking too long and huge space Fri, 09 Mar, 15:04
Silvio Fiorito Re: Custom metrics sink Sat, 17 Mar, 01:39
Stefano Pettini [Spark Core] Getting the number of stages a job is made of Fri, 23 Mar, 11:20
Stefano Pettini [Spark Core] details of persisting RDDs Fri, 23 Mar, 15:53
Subhash Sriram Spark & S3 - Introducing random values into key names Thu, 08 Mar, 16:42
Subhash Sriram Re: Spark & S3 - Introducing random values into key names Thu, 08 Mar, 17:19
Sunil Broadcast variables: destroy/unpersist unexpected behaviour Tue, 13 Mar, 08:55
Sunil Parmar Re: [Beginner] How to save Kafka Dstream data to parquet ? Fri, 02 Mar, 21:37
Sunil Parmar Re: [Beginner] How to save Kafka Dstream data to parquet ? Tue, 06 Mar, 05:48
Sunil Parmar Re: retention policy for spark structured streaming dataset Wed, 14 Mar, 19:51
Sunitha Chennareddy Unable to get results of intermediate dataset Thu, 29 Mar, 03:05
Sushrut Ikhar Re: Using Thrift with Dataframe Thu, 01 Mar, 20:35
Sushrut Ikhar Re: parquet vs orc files Thu, 01 Mar, 20:45
Swapnil Shinde Spark scala development in Sbt vs Maven Mon, 05 Mar, 15:47
Takeshi Yamamuro Re: Using CBO on Spark 2.3 with analyzed hive tables Fri, 23 Mar, 12:51
Takeshi Yamamuro Re: Using CBO on Spark 2.3 with analyzed hive tables Fri, 23 Mar, 23:39
Tathagata Das Re: [Beginner] Kafka 0.11 header support in Spark Structured Streaming Thu, 01 Mar, 02:06
Tathagata Das Re: [Beginner] How to save Kafka Dstream data to parquet ? Fri, 02 Mar, 22:57
Tathagata Das Re: CachedKafkaConsumer: CachedKafkaConsumer is not running in UninterruptibleThread warning Tue, 06 Mar, 19:34
Tathagata Das Re: what is the right syntax for self joins in Spark 2.3.0 ? Wed, 07 Mar, 02:25
Tathagata Das Re: CachedKafkaConsumer: CachedKafkaConsumer is not running in UninterruptibleThread warning Wed, 07 Mar, 09:10
Tathagata Das Re: what is the right syntax for self joins in Spark 2.3.0 ? Fri, 09 Mar, 02:14
Tathagata Das Re: Upgrades of streaming jobs Fri, 09 Mar, 22:24
Tathagata Das Re: what is the right syntax for self joins in Spark 2.3.0 ? Tue, 13 Mar, 01:24
Tathagata Das Re: Multiple Kafka Spark Streaming Dataframe Join query Wed, 14 Mar, 19:34
Tathagata Das Re: Multiple Kafka Spark Streaming Dataframe Join query Thu, 15 Mar, 16:44
Tathagata Das Re: [Structured Streaming] Application Updates in Production Thu, 22 Mar, 00:27
Tathagata Das Re: [Structured Streaming] Application Updates in Production Fri, 23 Mar, 03:00
Tathagata Das Re: Apache Spark Structured Streaming - Kafka Consumer cannot fetch records for offset exception Fri, 23 Mar, 03:15
Terry Hoo The last successful batch before stop re-execute after restart the DStreams with checkpoint Mon, 12 Mar, 04:54
Tin Vu [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 00:03
Tin Vu Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 05:38
Tin Vu Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Thu, 29 Mar, 14:46
Tin Vu Re: [SparkSQL] SparkSQL performance on small TPCDS tables is very low when compared to Drill or Presto Sat, 31 Mar, 18:47
Trevor Grant GOTO Chicago Talk / Discount Fri, 16 Mar, 16:51
Vadim Semenov Re: Can I get my custom spark strategy to run last? Fri, 02 Mar, 18:20
Vadim Semenov Re: OutOfDirectMemoryError for Spark 2.2 Tue, 06 Mar, 16:07
Vadim Semenov Re: Spark & S3 - Introducing random values into key names Thu, 08 Mar, 16:56
Vadim Semenov Re: Writing a DataFrame is taking too long and huge space Fri, 09 Mar, 14:42
Vadim Semenov Re: Writing a DataFrame is taking too long and huge space Fri, 09 Mar, 15:02
Vadim Semenov Re: Writing a DataFrame is taking too long and huge space Fri, 09 Mar, 15:04
Vadim Semenov Re: Spark Job Server application compilation issue Wed, 14 Mar, 17:49
Vinyas Shetty Spark Conf Wed, 14 Mar, 23:53
Vitaliy Pisarev Do values adjacent to exploded columns get duplicated? Wed, 07 Mar, 11:24
Vitaliy Pisarev Debugging a local spark executor in pycharm Sun, 11 Mar, 15:46
Vitaliy Pisarev Re: [EXT] Debugging a local spark executor in pycharm Wed, 14 Mar, 08:53
Vitaliy Pisarev Accessing a file that was passed via --files to spark submit Sun, 18 Mar, 08:06
Vitaliy Pisarev Why doesn't spark use broadcast join? Thu, 29 Mar, 12:41
Vitaliy Pisarev Best practices for optimizing the structure of parquet schema Thu, 29 Mar, 12:54
Xiao Li Re: ORC native in Spark 2.3, with zlib, gives java.nio.BufferUnderflowException during read Tue, 27 Mar, 23:13
Yinan Li Re: handling Remote dependencies for spark-submit in spark 2.3 with kubernetes Thu, 08 Mar, 21:36
Yinan Li Re: Spark 2.3 submit on Kubernetes error Mon, 12 Mar, 00:26
Yinan Li Re: Rest API for Spark2.3 submit on kubernetes(version 1.8.*) cluster Wed, 21 Mar, 03:50
Yong Zhang java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to Case class Fri, 23 Mar, 02:08
Yong Zhang Re: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to Case class Fri, 23 Mar, 17:34
Yong Zhang Re: java.lang.UnsupportedOperationException: CSV data source does not support struct/ERROR RetryingBlockFetcher Wed, 28 Mar, 12:14
Yong Zhang Re: how to create all possible combinations from an array? how to join and explode row array? Sat, 31 Mar, 02:24
Young Why fetchSize should be bigger than 0 in JDBCOptions.scala? Fri, 30 Mar, 07:43
ahmed alobaidi [Structured Streaming] HDFSBackedStateStoreProvider OutOfMemoryError Fri, 30 Mar, 15:59
arshanvit Distributed Nature of Spark and Time Series Temporal Dependence Tue, 06 Mar, 11:18
ayan guha Re: Pyspark Error: Unable to read a hive table with transactional property set as 'True' Fri, 02 Mar, 21:45
ayan guha Re: Hive to Oracle using Spark - Type(Date) conversion issue Mon, 19 Mar, 03:04
ayan guha Re: Need config params while doing rdd.foreach or map Thu, 22 Mar, 11:45
bsikander Re: Properly stop applications or jobs within the application Tue, 06 Mar, 09:36
bsikander Re: Properly stop applications or jobs within the application Thu, 08 Mar, 08:15
bsikander Re: Properly stop applications or jobs within the application Thu, 08 Mar, 10:33
bsikander Re: Properly stop applications or jobs within the application Thu, 08 Mar, 11:48
chandan prakash Spark Streaming logging on Yarn : issue with rolling in yarn-client mode for driver log Thu, 08 Mar, 05:31
dcam Re: [Structured Streaming] Commit protocol to move temp files to dest path only when complete, with code Tue, 20 Mar, 14:09
ey-chih chow Contextual bandits Fri, 09 Mar, 14:45
hemant singh Re: Access Table with Spark Dataframe Tue, 20 Mar, 15:09
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Wed, 07 Mar, 05:15
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Wed, 07 Mar, 05:16
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Wed, 07 Mar, 11:44
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Sat, 10 Mar, 08:14
kant kodali How to run spark shell using YARN Mon, 12 Mar, 23:42
kant kodali Re: How to run spark shell using YARN Tue, 13 Mar, 01:13
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 07:12
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 07:12
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 07:25
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 09:32
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 10:15
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 18:37
kant kodali Re: How to run spark shell using YARN Wed, 14 Mar, 19:28
kant kodali is it possible to use Spark 2.3.0 along with Kafka 0.9.0.1? Fri, 16 Mar, 12:52
kant kodali select count * doesnt seem to respect update mode in Kafka Structured Streaming? Mon, 19 Mar, 20:35
kant kodali Re: select count * doesnt seem to respect update mode in Kafka Structured Streaming? Tue, 20 Mar, 00:27
kant kodali Re: select count * doesnt seem to respect update mode in Kafka Structured Streaming? Tue, 20 Mar, 21:58
kant kodali Re: select count * doesnt seem to respect update mode in Kafka Structured Streaming? Wed, 21 Mar, 02:28
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 202181
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137