spark-user mailing list archives: February 2018

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4Thread · Author · Date
changhongz...@foxmail.com Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 08:16
changhongz...@foxmail.com Re: Re: Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 08:50
changhongz...@foxmail.com Re: Re: Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 09:18
changhongz...@foxmail.com Re: Re: Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 09:40
dcam Re: [Structured Streaming] Avoiding multiple streaming queries Tue, 13 Feb, 14:55
dcam Re: org.apache.kafka.clients.consumer.OffsetOutOfRangeException Tue, 13 Feb, 15:09
devjyoti patra Re: optimize hive query to move a subset of data from one partition table to another table Mon, 12 Feb, 17:35
dmp unsubscribe Wed, 07 Feb, 16:49
hsy...@gmail.com I got weird error from a join Thu, 22 Feb, 01:02
kant kodali is there a way to create new column with timeuuid using raw spark sql ? Thu, 01 Feb, 11:50
kant kodali Re: is there a way to create new column with timeuuid using raw spark sql ? Thu, 01 Feb, 16:18
kant kodali can we expect UUID type in Spark 2.3? Fri, 02 Feb, 21:14
kant kodali There is no UDF0 interface? Sun, 04 Feb, 20:23
kant kodali Re: There is no UDF0 interface? Sun, 04 Feb, 23:15
kant kodali can udaf's return complex types? Sat, 10 Feb, 13:28
kant kodali stdout: org.apache.spark.sql.AnalysisException: nondeterministic expressions are only allowed in Thu, 15 Feb, 02:11
kant kodali Does the classloader used by spark blocks the I/O calls from UDF's? Fri, 16 Feb, 12:08
kant kodali can we do self join on streaming dataset in 2.2.0? Sun, 18 Feb, 01:16
kant kodali The timestamp column for kafka records doesn't seem to change Tue, 20 Feb, 13:41
kant kodali Re: The timestamp column for kafka records doesn't seem to change Tue, 20 Feb, 14:48
kant kodali what is the right syntax for self joins in Spark 2.3.0 ? Wed, 21 Feb, 03:52
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Wed, 21 Feb, 04:16
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Wed, 21 Feb, 04:20
kant kodali Re: what is the right syntax for self joins in Spark 2.3.0 ? Thu, 22 Feb, 22:32
kant kodali What happens if I can't fit data into memory while doing stream-stream join. Fri, 23 Feb, 10:45
kant kodali Spark 2.3.1 Continuous processing does not support StreamingRelation operations.; Sat, 24 Feb, 08:50
kant kodali Is there a way to query dataframe views directly without going through scheduler? Mon, 26 Feb, 09:32
kant kodali How does Spark Structured Streaming determine an event has arrived late? Tue, 27 Feb, 10:26
kant kodali Re: How does Spark Structured Streaming determine an event has arrived late? Wed, 28 Feb, 03:32
kant kodali Is stream-stream join by default a stateful operation? Wed, 28 Feb, 06:55
karan alang not able to read git info from Scala Test Suite Wed, 14 Feb, 02:35
karan alang scala question (in spark project)- not able to call getClassSchema method in avro generated class Sat, 24 Feb, 19:34
karthikus [Beginner] How to save Kafka Dstream data to parquet ? Wed, 28 Feb, 19:09
karthikus Re: [Beginner] Kafka 0.11 header support in Spark Structured Streaming Wed, 28 Feb, 23:17
karuppayya Errors when running unit tests Tue, 20 Feb, 03:00
kurian vs [spark-sql] Custom Query Execution listener via conf properties Fri, 16 Feb, 08:43
naresh Goud KafkaUtils.createStream(..) is removed for API Mon, 19 Feb, 01:17
naresh Goud Re: KafkaUtils.createStream(..) is removed for API Mon, 19 Feb, 03:34
naresh Goud Re: Return statements aren't allowed in Spark closures Fri, 23 Feb, 02:48
naresh Goud Re: Spark not releasing shuffle files in time (with very large heap) Fri, 23 Feb, 02:58
naresh Goud Re: Spark not releasing shuffle files in time (with very large heap) Fri, 23 Feb, 05:17
naresh Goud Re: Consuming Data in Parallel using Spark Streaming Fri, 23 Feb, 06:10
naresh Goud Trigger.ProcessingTime("10 seconds") & Trigger.Continuous(10.seconds) Sun, 25 Feb, 20:26
naresh Goud Re: Spark structured streaming: periodically refresh static data frame Sun, 25 Feb, 23:27
naresh Goud Re: Trigger.ProcessingTime("10 seconds") & Trigger.Continuous(10.seconds) Mon, 26 Feb, 13:33
naresh Goud Re: partitionBy with partitioned column in output? Mon, 26 Feb, 22:47
naresh Goud Re: Out of memory Error when using Collection Accumulator Spark 2.2 Mon, 26 Feb, 23:14
naresh Goud Re: How does Spark Structured Streaming determine an event has arrived late? Wed, 28 Feb, 01:55
nhamwey PySpark Tweedie GLM Fri, 09 Feb, 17:42
nihed mbarek Re: Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 08:37
nihed mbarek Re: Re: Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 09:05
nihed mbarek Re: Re: Spark on yarn, all executors are allocated in same host,how to adjust? Sat, 24 Feb, 09:21
pooja bhojwani Saving spark output to multiple files as map Sat, 24 Feb, 19:03
prabhastechie [SparkQL] how are RDDs partitioned and distributed in a standalone cluster? Mon, 19 Feb, 02:03
prashanth t Re: saveAsTable does not respect spark.sql.warehouse.dir Sun, 11 Feb, 18:20
purna pradeep Re: Unsubscribe Sun, 11 Feb, 23:37
purna pradeep Unsubscribe Mon, 26 Feb, 11:58
purna pradeep Unsubscribe Mon, 26 Feb, 18:50
purna pradeep Unsubscribe Tue, 27 Feb, 12:32
ravidspark Spark with Kudu behaving unexpectedly when bringing down the Kudu Service Fri, 23 Feb, 17:09
sandeep-katta [Spark-Core]port opened by the SparkDriver is vulnerable to flooding attacks Wed, 14 Feb, 16:01
sandudi Spark sortByKey is not lazy evaluated Mon, 12 Feb, 12:38
sujeet jog read parallel processing spark-cassandra Wed, 14 Feb, 03:47
tan shai CATALYST rule join Sun, 25 Feb, 22:08
tan shai Re: CATALYST rule join Tue, 27 Feb, 09:19
unk1102 org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 18:39
unk1102 Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 18:55
unk1102 Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 19:07
unk1102 Re: org.apache.spark.SparkException: Task failed while writing rows Wed, 28 Feb, 19:53
vermanurag Re: Serialize a DataFrame with Vector values into text/csv file Tue, 20 Feb, 23:52
vermanurag Re: Serialize a DataFrame with Vector values into text/csv file Wed, 21 Feb, 08:33
vijay.bvp Re: [Spark Streaming]: Non-deterministic uneven task-to-machine assignment Tue, 20 Feb, 07:17
vijay.bvp Re: sqoop import job not working when spark thrift server is running. Tue, 20 Feb, 08:18
vijay.bvp Re: Can spark handle this scenario? Tue, 20 Feb, 08:47
vijay.bvp Re: Can spark handle this scenario? Sat, 24 Feb, 01:42
vijay.bvp Re: sqoop import job not working when spark thrift server is running. Sat, 24 Feb, 01:44
vijay.bvp Re: [Spark Streaming]: Non-deterministic uneven task-to-machine assignment Sat, 24 Feb, 02:01
vijay.bvp Re: Apache Spark - Structured Streaming reading from Kafka some tasks take much longer Sat, 24 Feb, 02:07
vijay.bvp Re: Spark not releasing shuffle files in time (with very large heap) Sat, 24 Feb, 02:20
wangsan Unsubscribe Fri, 09 Feb, 08:30
xwu0226 Free access to Index Conf for Apache Spark community attendees Thu, 08 Feb, 19:47
yncxcw Re: Spark EMR executor-core vs Vcores Mon, 26 Feb, 23:05
yncxcw Re: Data loss in spark job Wed, 28 Feb, 06:20
Message list« Previous · 1 · 2 · 3 · 4Thread · Author · Date
Box list
Nov 201975
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137