spark-user mailing list archives: February 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Philippe de Rochambeau Re: Log analysis with GraphX Sat, 10 Feb, 15:28
Prakash Joshi Re: Spark Dataframe and HIVE Fri, 09 Feb, 17:59
Pralabh Kumar Kryo serialization failed: Buffer overflow : Broadcast Join Fri, 02 Feb, 11:38
Pralabh Kumar Re: Kryo serialization failed: Buffer overflow : Broadcast Join Fri, 02 Feb, 11:39
Pralabh Kumar Are there any alternatives to Hive "stored by" clause as Spark 2.0 does not support it Thu, 08 Feb, 06:25
Pralabh Kumar Re: Are there any alternatives to Hive "stored by" clause as Spark 2.0 does not support it Thu, 08 Feb, 16:04
Priyank Shrivastava [Structured Streaming] Avoiding multiple streaming queries Tue, 13 Feb, 01:54
Ramon Bejar Re: [graphframes]how Graphframes Deal With Bidirectional Relationships Tue, 20 Feb, 08:17
Ramon Bejar Torres [Spark GraphX pregel] default value for EdgeDirection not consistent between programming guide and API documentation Tue, 13 Feb, 23:36
Rich Bowen Save the date: ApacheCon North America, September 24-27 in Montréal Tue, 20 Feb, 14:21
Richard Qiao Re: Apache Spark - Structured Streaming Query Status - field descriptions Sun, 11 Feb, 10:17
Richard Qiao Re: optimize hive query to move a subset of data from one partition table to another table Sun, 11 Feb, 21:30
Romain Jouin [Pyspark Streaming + ml] How to combine Sun, 18 Feb, 09:28
Romero, Saul Re: Unsubscribe Mon, 26 Feb, 20:17
Ryan Myer Unsubscribe Mon, 19 Feb, 08:19
SNEHASISH DUTTA Re: Can spark handle this scenario? Sat, 17 Feb, 08:04
SNEHASISH DUTTA Re: Serialize a DataFrame with Vector values into text/csv file Tue, 20 Feb, 21:36
SNEHASISH DUTTA Re: Serialize a DataFrame with Vector values into text/csv file Tue, 20 Feb, 22:08
SNEHASISH DUTTA Re: Serialize a DataFrame with Vector values into text/csv file Tue, 20 Feb, 22:12
SNEHASISH DUTTA CSV use case Wed, 21 Feb, 08:53
Sandeep Kr. Choudhary Unsubscribe Mon, 26 Feb, 06:04
Sandeep Varma Unsubscribe Mon, 12 Feb, 04:32
Sandip Mehta Re: [Structured Streaming] Reuse computation result Thu, 01 Feb, 12:06
Sateesh Karuturi Returns Null when reading data from XML Ask Question Tue, 27 Feb, 10:30
Selvam Raman Pyspark UDF/map fucntion throws pickling exception Thu, 15 Feb, 11:44
Selvam Raman Re: Pyspark UDF/map fucntion throws pickling exception Thu, 15 Feb, 12:01
Selvam Raman pyspark+spacy throwing pickling exception Thu, 15 Feb, 12:08
Selvam Raman Re: pyspark+spacy throwing pickling exception Thu, 15 Feb, 14:34
Selvam Raman Spark-Solr -- unresolved dependencies Fri, 23 Feb, 11:50
Selvam Raman Spark EMR executor-core vs Vcores Mon, 26 Feb, 10:20
Selvam Raman Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 10:35
Selvam Raman Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 12:31
Selvam Raman Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 21:51
Sharan F FINAL REMINDER: CFP for Apache EU Roadshow Closes 25th February Wed, 21 Feb, 17:18
Shmuel Blitz Re: Spark Dataframe and HIVE Sun, 11 Feb, 07:36
Shmuel Blitz Re: Spark Dataframe and HIVE Sun, 11 Feb, 08:49
Srinath C Timezone conversion using from_utc_timestamp Sat, 24 Feb, 17:08
Stefan Panayotov RE: spark 2 new stuff Mon, 26 Feb, 14:58
Stephen Robinson Spark 2.2.1 EMR 5.11.1 Encrypted S3 bucket overwriting parquet file Tue, 13 Feb, 15:04
Stephen Joung Re: parquet vs orc files Thu, 22 Feb, 00:37
Subhajit Purkayastha New to spark 2.2.1 - Problem with finding tables between different metastore db Wed, 07 Feb, 05:46
Subhash Sriram Re: is there a way to create new column with timeuuid using raw spark sql ? Thu, 01 Feb, 16:33
Subhash Sriram Spark JDBC bulk insert Thu, 01 Feb, 16:49
Sudheesh K J Unsubscribe Mon, 26 Feb, 05:06
Tathagata Das Re: Spark Structured Streaming for Twitter Streaming data Thu, 01 Feb, 02:30
Tathagata Das Re: Spark Structured Streaming for Twitter Streaming data Thu, 01 Feb, 03:36
Tathagata Das Re: Spark Streaming withWatermark Wed, 07 Feb, 01:41
Tathagata Das Re: Spark structured streaming: periodically refresh static data frame Wed, 14 Feb, 11:11
Tathagata Das Re: Spark structured streaming: periodically refresh static data frame Thu, 15 Feb, 02:04
Tathagata Das Re: [Structured Streaming] Avoiding multiple streaming queries Thu, 15 Feb, 02:10
Tathagata Das Re: what is the right syntax for self joins in Spark 2.3.0 ? Thu, 22 Feb, 19:25
Tathagata Das Re: Trigger.ProcessingTime("10 seconds") & Trigger.Continuous(10.seconds) Mon, 26 Feb, 06:11
Tathagata Das Re: [Beginner] Kafka 0.11 header support in Spark Structured Streaming Wed, 28 Feb, 01:11
Tathagata Das Re: How does Spark Structured Streaming determine an event has arrived late? Wed, 28 Feb, 01:45
Tathagata Das Re: [Beginner] How to save Kafka Dstream data to parquet ? Wed, 28 Feb, 21:59
Ted Yu Re: KafkaUtils.createStream(..) is removed for API Mon, 19 Feb, 01:47
Thomas Decaux [Spark Core] Limit the task duration (and kill it!) Fri, 02 Feb, 16:45
Thomas Decaux Understand task timing Mon, 19 Feb, 10:13
Vadim Semenov Re: Sharing spark executor pool across multiple long running spark applications Wed, 07 Feb, 14:37
Vadim Semenov Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 18:45
Vadim Semenov Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 21:59
Vadim Semenov Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 18:42
Vadim Semenov Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 19:02
Vadim Semenov Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 19:47
Vadim Semenov Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 20:34
Vibhakar, Beejal Consuming Data in Parallel using Spark Streaming Thu, 22 Feb, 03:12
Vibhakar, Beejal RE: Consuming Data in Parallel using Spark Streaming Fri, 23 Feb, 03:44
Vinay Muttineni Java Heap Space Error Sat, 17 Feb, 01:25
Vishnu Viswanath Re: Spark Streaming withWatermark Tue, 06 Feb, 19:47
Vishnu Viswanath Re: Spark Streaming withWatermark Tue, 06 Feb, 22:05
Vishnu Viswanath Re: Spark Streaming withWatermark Wed, 07 Feb, 01:01
Xiao Li Re: There is no UDF0 interface? Sun, 04 Feb, 20:25
Xin Liu SizeEstimator Tue, 27 Feb, 00:47
Xin Liu Re: SizeEstimator Tue, 27 Feb, 03:23
Xin Liu Re: SizeEstimator Tue, 27 Feb, 03:24
Yanbo Liang [CFP] DataWorks Summit, San Jose, 2018 Thu, 08 Feb, 00:06
Yinan Li Re: Spark on K8s with Romana Mon, 12 Feb, 22:12
Yinan Li Re: Spark on K8s - using files fetched by init-container? Mon, 26 Feb, 20:02
Yogesh Mahajan Re: Max number of streams supported ? Thu, 01 Feb, 00:46
Yogesh Mahajan Re: [Structured Streaming] Avoiding multiple streaming queries Tue, 13 Feb, 18:45
Yogesh Mahajan Inefficient state management in stream to stream join in 2.3 Tue, 13 Feb, 21:10
Yong Zhang Re: CATALYST rule join Tue, 27 Feb, 14:08
Yosef Moatti Unsubscribe Thu, 08 Feb, 18:34
akshay naidu Run Multiple Spark jobs. Reduce Execution time. Tue, 13 Feb, 11:13
akshay naidu Re: Run Multiple Spark jobs. Reduce Execution time. Wed, 14 Feb, 10:42
akshay naidu Re: Run Multiple Spark jobs. Reduce Execution time. Wed, 14 Feb, 10:44
akshay naidu Re: Run Multiple Spark jobs. Reduce Execution time. Wed, 14 Feb, 11:47
akshay naidu Re: Run Multiple Spark jobs. Reduce Execution time. Thu, 15 Feb, 05:38
akshay naidu sqoop import job not working when spark thrift server is running. Tue, 20 Feb, 05:43
akshay naidu Re: sqoop import job not working when spark thrift server is running. Tue, 20 Feb, 10:09
akshay naidu Re: sqoop import job not working when spark thrift server is running. Sat, 24 Feb, 12:47
akshay naidu Re: sqoop import job not working when spark thrift server is running. Sat, 24 Feb, 17:02
akshay naidu Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 18:49
amit kumar singh optimize hive query to move a subset of data from one partition table to another table Sat, 10 Feb, 15:18
amit kumar singh Re: optimize hive query to move a subset of data from one partition table to another table Mon, 12 Feb, 00:55
ayan guha Re: mapGroupsWithState in Python Thu, 01 Feb, 00:14
ayan guha Re: Can spark handle this scenario? Sat, 17 Feb, 04:58
ayan guha Re: Can spark handle this scenario? Sat, 17 Feb, 04:58
chandan prakash SparkR test script issue: unable to run run-tests.h on spark 2.2 Wed, 14 Feb, 09:09
chandan prakash Re: SparkR test script issue: unable to run run-tests.h on spark 2.2 Wed, 14 Feb, 12:21
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Nov 201985
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137