spark-user mailing list archives: April 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Saisai Shao Re: spark kafka consumer with kerberos Sat, 01 Apr, 00:58
Richard Tsai [Spark Core]: flatMap/reduceByKey seems to be quite slow with Long keys on some distributions Sat, 01 Apr, 07:29
Selvam Raman Convert Dataframe to Dataset<String> in pyspark Sat, 01 Apr, 12:36
Deepu Raj Cuesheet - spark deployment Sat, 01 Apr, 12:55
Chintan Bhatt getting error while storing data in Hbase Sat, 01 Apr, 16:47
Paul Tremblay pyspark bug with PYTHONHASHSEED Sat, 01 Apr, 19:43
Paul Tremblay bug with PYTHONHASHSEED Sat, 01 Apr, 19:54
Jiang Jacky strange behavior of spark 2.1.0 Sat, 01 Apr, 20:14
Yogesh Vyas read binary file in PySpark Sun, 02 Apr, 06:46
Timur Shenkao Re: strange behavior of spark 2.1.0 Sun, 02 Apr, 09:22
jasbir.s...@accenture.com Partitioning strategy Sun, 02 Apr, 10:32
Jörn Franke Re: Partitioning strategy Sun, 02 Apr, 11:18
Jiang Jacky Re: strange behavior of spark 2.1.0 Sun, 02 Apr, 12:27
kant kodali Does Apache Spark use any Dependency Injection framework? Sun, 02 Apr, 13:28
Selvam Raman Update DF record with delta data in spark Sun, 02 Apr, 13:57
Old-School Represent documents as a sequence of wordID & frequency and perform PCA Sun, 02 Apr, 14:51
Jörn Franke Re: Update DF record with delta data in spark Sun, 02 Apr, 15:21
Sathish Kumaran Vairavelu Re: Spark SQL 2.1 Complex SQL - Query Planning Issue Sun, 02 Apr, 15:54
Robert Yokota Graph Analytics on HBase with HGraphDB and Spark GraphFrames Sun, 02 Apr, 16:40
Paul Tremblay Re: Looking at EMR Logs Sun, 02 Apr, 20:05
Felix Cheung Re: Graph Analytics on HBase with HGraphDB and Spark GraphFrames Mon, 03 Apr, 00:19
Irving Duran Re: Graph Analytics on HBase with HGraphDB and Spark GraphFrames Mon, 03 Apr, 02:08
grjohnson35 org.apache.spark.sql.AnalysisException: resolved attribute(s) code#906 missing from code#1992, Mon, 03 Apr, 02:30
kant kodali What is the difference between forEachAsync vs forEachPartitionAsync? Mon, 03 Apr, 03:36
kant kodali Re: What is the difference between forEachAsync vs forEachPartitionAsync? Mon, 03 Apr, 03:53
Weiqing Yang Re: Graph Analytics on HBase with HGraphDB and Spark GraphFrames Mon, 03 Apr, 06:25
gvdongen Benchmarking streaming frameworks Mon, 03 Apr, 07:34
gvdongen Benchmarking streaming frameworks Mon, 03 Apr, 07:41
Jacek Laskowski Re: Does Apache Spark use any Dependency Injection framework? Mon, 03 Apr, 08:41
mathewwicks Do we support excluding the current row in PARTITION BY windowing functions? Mon, 03 Apr, 08:52
mathewwicks Re: Do we support excluding the current row in PARTITION BY windowing functions? Mon, 03 Apr, 09:17
mathewwicks Re: Do we support excluding the current row in PARTITION BY windowing functions? Mon, 03 Apr, 09:30
Alonso Isidoro Roman Re: Benchmarking streaming frameworks Mon, 03 Apr, 09:47
Old-School Read file and represent rows as Vectors Mon, 03 Apr, 12:05
Rishikesh Teke Executor unable to pick postgres driver in Spark standalone cluster Mon, 03 Apr, 13:43
Selvam Raman Pyspark - pickle.PicklingError: Can't pickle Mon, 03 Apr, 18:34
Michael Armbrust Re: Convert Dataframe to Dataset<String> in pyspark Mon, 03 Apr, 18:55
drewrobb _SUCCESS file validation on read Mon, 03 Apr, 20:58
Paul Tremblay Re: Read file and represent rows as Vectors Tue, 04 Apr, 00:18
Paul Tremblay Re: Alternatives for dataframe collectAsList() Tue, 04 Apr, 00:44
mathewwicks Do we support excluding the CURRENT ROW in PARTITION BY windowing functions? Tue, 04 Apr, 02:21
Koert Kuipers map transform on array in spark sql Tue, 04 Apr, 03:18
kant kodali is there a way to persist the lineages generated by spark? Tue, 04 Apr, 03:19
ayan guha Re: is there a way to persist the lineages generated by spark? Tue, 04 Apr, 04:41
Sam Elamin Re: Executor unable to pick postgres driver in Spark standalone cluster Tue, 04 Apr, 08:51
Eike von Seggern Re: Alternatives for dataframe collectAsList() Tue, 04 Apr, 14:38
Eike von Seggern Re: bug with PYTHONHASHSEED Tue, 04 Apr, 14:49
Paul Tremblay Re: bug with PYTHONHASHSEED Tue, 04 Apr, 16:02
Holden Karau Re: bug with PYTHONHASHSEED Tue, 04 Apr, 16:03
Michael Armbrust Re: map transform on array in spark sql Tue, 04 Apr, 18:09
Keith Chapman Re: Alternatives for dataframe collectAsList() Tue, 04 Apr, 19:12
Koert Kuipers how do i force unit test to do whole stage codegen Tue, 04 Apr, 20:10
Jeff Zhang Re: bug with PYTHONHASHSEED Tue, 04 Apr, 23:42
kant kodali Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 00:17
Tathagata Das Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 00:34
Gaurav1809 With Twitter4j API, why am I not able to pull tweets with certain keywords? Wed, 05 Apr, 04:02
Kazuaki Ishizaki Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 04:07
satishl spark stages UI page has 'gc time' column Emtpy Wed, 05 Apr, 04:24
Koert Kuipers Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 04:44
lucas.g...@gmail.com Re: Alternatives for dataframe collectAsList() Wed, 05 Apr, 04:55
Yogesh Vyas reading binary file in spark-kafka streaming Wed, 05 Apr, 06:11
kant kodali Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 07:39
asethia Market Basket Analysis by deploying FP Growth algorithm Wed, 05 Apr, 09:29
Patrick Plaatje Re: Market Basket Analysis by deploying FP Growth algorithm Wed, 05 Apr, 09:34
Hamza HACHANI convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 09:43
hosur narahari Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 09:44
Mungeol Heo JSON lib works differently in spark-shell and IDE like intellij Wed, 05 Apr, 09:52
Hemalatha A Re: How to use ManualClock with Spark streaming Wed, 05 Apr, 10:59
Shiva Ramagopal Re: unit testing in spark Wed, 05 Apr, 11:32
kant kodali Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 14:17
Ian.Malo...@tdameritrade.com Re: With Twitter4j API, why am I not able to pull tweets with certain keywords? Wed, 05 Apr, 15:02
Jacek Laskowski Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 15:15
kant kodali Re: Why do we ever run out of memory in Spark Structured Streaming? Wed, 05 Apr, 15:49
Koert Kuipers Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 16:14
Vinay Parekar Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 16:24
Paul Tremblay Re: bug with PYTHONHASHSEED Wed, 05 Apr, 16:40
Jacek Laskowski Re: how do i force unit test to do whole stage codegen Wed, 05 Apr, 16:44
Justin Miller Spark Streaming Kafka Job has strange behavior for certain tasks Wed, 05 Apr, 17:03
Jiang Jacky Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 18:10
Mendelson, Assaf RE: How to use ManualClock with Spark streaming Wed, 05 Apr, 18:36
Nick Chammas Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 19:27
Mark Hamstra Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 19:54
Mark Hamstra Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 19:54
Vinay Parekar Re: convert JavaRDD<List<Object>> to JavaRDD<Object> Wed, 05 Apr, 19:55
Nicholas Chammas Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 20:11
Mark Hamstra Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 20:31
Nicholas Chammas Re: Spark fair scheduler pools vs. YARN queues Wed, 05 Apr, 20:41
map reduced Master-Worker communication on Standalone cluster issues Wed, 05 Apr, 21:01
Pete Prokopowicz run-time exception trying to train MultilayerPerceptronClassifier with DataFrame Wed, 05 Apr, 21:21
Mungeol Heo Re: JSON lib works differently in spark-shell and IDE like intellij Thu, 06 Apr, 02:01
JoneZhang Why chinese character gash appear when i use spark textFile? Thu, 06 Apr, 04:16
Jone Zhang Why chinese character gash appear when i use spark textFile? Thu, 06 Apr, 04:47
Tim Smith Consuming AWS Cloudwatch logs from Kinesis into Spark Thu, 06 Apr, 04:47
infa elance Spark and Hive connection Thu, 06 Apr, 05:06
infaelance How spark connects to Hive metastore? Thu, 06 Apr, 05:20
颜发才(Yan Facai) Re: Read file and represent rows as Vectors Thu, 06 Apr, 05:36
颜发才(Yan Facai) Re: Why chinese character gash appear when i use spark textFile? Thu, 06 Apr, 05:47
Yogesh Vyas use UTF-16 decode in pyspark streaming Thu, 06 Apr, 06:44
PSw...@in.imshealth.com scala test is unable to initialize spark context. Thu, 06 Apr, 08:03
Jeff Zhang Re: scala test is unable to initialize spark context. Thu, 06 Apr, 08:09
Message list1 · 2 · 3 · 4 · 5 · 6 · Next »Thread · Author · Date
Box list
May 2019274
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137