spark-user mailing list archives: January 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
☼ R Nair (रविशंकर नायर) Dataframe caching Fri, 20 Jan, 14:27
☼ R Nair (रविशंकर नायर) Re: Dataframe caching Fri, 20 Jan, 23:32
☼ R Nair (रविशंकर नायर) No Reducer scenarios Mon, 30 Jan, 05:31
周家帅 [Spark Kafka] How to update batch size of input dynamically for spark kafka consumer? Tue, 03 Jan, 10:00
李斌松 What is the difference between hive on spark and spark on hive? Mon, 09 Jan, 15:05
李斌松 how the sparksession initialization, set currentDatabase value? Wed, 11 Jan, 03:46
颜发才(Yan Facai) Spark 2.0.2, KyroSerializer, double[] is not registered. Sun, 08 Jan, 05:21
颜发才(Yan Facai) Re: Spark 2.0.2, KyroSerializer, double[] is not registered. Sun, 08 Jan, 13:28
颜发才(Yan Facai) Re: Kryo On Spark 1.6.0 Sat, 14 Jan, 12:39
Dinko Srkoč Re: (send this email to subscribe) Wed, 04 Jan, 18:08
Dinko Srkoč Re: Entering the variables in the Argument part in Submit job section to run a spark code on Google Cloud Mon, 09 Jan, 15:23
Dinko Srkoč Re: Running a spark code using submit job in google cloud platform Fri, 13 Jan, 13:19
Hakan İlter Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 06:35
Hakan İlter Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 20:11
Hakan İlter Re: Spark streaming multiple kafka topic doesn't work at-least-once Tue, 24 Jan, 20:51
Jiří Syrový Re: Dependency Injection and Microservice development with Spark Wed, 04 Jan, 12:06
Michal Šenkýř Re: What is missing here to use sql in spark? Mon, 02 Jan, 07:23
Michal Šenkýř Re: how to dynamic partition dataframe Thu, 19 Jan, 11:55
Bernhard Schäfer 24/7 Spark Streaming on YARN in Production Mon, 02 Jan, 07:29
Blaž Šnuderl Pyspark 2.1.0 weird behavior with repartition Mon, 30 Jan, 19:19
Hanna Mäki Accumulators and Datasets Wed, 18 Jan, 14:15
Kürşat Kurt increasing cross join speed Tue, 31 Jan, 21:35
Jörn Franke Re: How to connect Tableau to databricks spark? Mon, 09 Jan, 07:58
Jörn Franke Re: AVRO Append HDFS using saveAsNewAPIHadoopFile Mon, 09 Jan, 09:47
Jörn Franke Re: Spark/Parquet/Statistics question Tue, 17 Jan, 15:17
Jörn Franke Re: Quick but probably silly question... Tue, 17 Jan, 16:57
Jörn Franke Re: How to do dashboard reporting in spark Fri, 20 Jan, 07:27
Jörn Franke Re: Saving from Dataset to Bigquery Table Fri, 20 Jan, 11:22
Jörn Franke Re: Saving from Dataset to Bigquery Table Fri, 20 Jan, 12:37
Jörn Franke Re: Text Fri, 27 Jan, 13:45
Jörn Franke Re: Text Fri, 27 Jan, 13:58
Jörn Franke Re: spark architecture question -- Pleas Read Sat, 28 Jan, 08:26
Jörn Franke Re: spark architecture question -- Pleas Read Sun, 29 Jan, 13:45
Jörn Franke Re: spark architecture question -- Pleas Read Sun, 29 Jan, 14:22
Jörn Franke Re: spark architecture question -- Pleas Read Sun, 29 Jan, 22:22
Jörn Franke Re: Tableau BI on Spark SQL Mon, 30 Jan, 21:51
Jörn Franke Re: Tableau BI on Spark SQL Mon, 30 Jan, 22:15
A Shaikh Re: Spark Read from Google store and save in AWS s3 Tue, 10 Jan, 11:55
A Shaikh Dataset Type safety Tue, 10 Jan, 19:34
A Shaikh Handling null in dataset Wed, 11 Jan, 17:11
A Shaikh Re: Handling null in dataset Wed, 11 Jan, 18:51
A Shaikh Re: Running a spark code using submit job in google cloud platform Thu, 12 Jan, 17:39
A Shaikh TDD in Spark Sun, 15 Jan, 18:14
A Shaikh Re: TDD in Spark Fri, 20 Jan, 09:27
A Shaikh Saving from Dataset to Bigquery Table Fri, 20 Jan, 10:54
A Shaikh Re: Saving from Dataset to Bigquery Table Fri, 20 Jan, 12:24
A Shaikh DML in Spark ETL Thu, 26 Jan, 11:28
Aaron Perrin Re: Tuning spark.executor.cores Mon, 09 Jan, 14:59
Aaron Perrin Multiple quantile calculations Tue, 31 Jan, 15:42
Abhishek Bhandari Re: Could not parse Master URL for Mesos on Spark 2.1.0 Tue, 10 Jan, 00:26
Abhishek Gupta Ingesting data in parallel across workers in Data Frame Sat, 21 Jan, 05:03
Alex Re: spark architecture question -- Pleas Read Sun, 29 Jan, 10:18
Alex Re: spark architecture question -- Pleas Read Sun, 29 Jan, 14:37
Alex Re: help!!!----issue with spark-sql type cast form long to longwritable Mon, 30 Jan, 11:49
Alex how to compare two avro format hive tables Mon, 30 Jan, 15:37
Alex Re: help!!!----issue with spark-sql type cast form long to longwritable Mon, 30 Jan, 17:26
Alex Re: help!!!----issue with spark-sql type cast form long to longwritable Mon, 30 Jan, 18:26
Alex does both below code do the same thing? I had to refactor code to fit in spark-sql Tue, 31 Jan, 07:01
Alex alternatives for long to longwritable typecasting in spark sql Tue, 31 Jan, 07:32
Alex Roadblock -- stuck for 10 days :( how come same hive udf giving different results in spark and hive Tue, 31 Jan, 14:34
AlexModestov apache-spark doesn't work correktly with russian alphabet Wed, 18 Jan, 12:53
Alvin Chen too noisy Fri, 20 Jan, 17:21
Amiya Mishra Reason behind mapping of StringType with CLOB nullType Mon, 30 Jan, 12:14
Amrit Jangid Re: [Spark Structured Streaming]: Is it possible to ingest data from a jdbc data source incrementally? Tue, 03 Jan, 11:25
Amrit Jangid Re: Data frame writing Fri, 13 Jan, 06:12
Amrit Jangid Re: HBaseContext with Spark Wed, 25 Jan, 11:39
Anahita Talebi Fwd: (send this email to subscribe) Wed, 04 Jan, 16:34
Anahita Talebi Re: (send this email to subscribe) Wed, 04 Jan, 21:33
Anahita Talebi Fwd: Entering the variables in the Argument part in Submit job section to run a spark code on Google Cloud Mon, 09 Jan, 12:43
Anahita Talebi Running a spark code using submit job in google cloud platform Thu, 12 Jan, 15:51
Anahita Talebi Re: Running a spark code using submit job in google cloud platform Fri, 13 Jan, 12:55
Anahita Talebi Re: Running a spark code using submit job in google cloud platform Fri, 13 Jan, 15:53
Anastasios Zouzias Re: Broadcast destroy Mon, 02 Jan, 17:09
Anastasios Zouzias Re: Equally split a RDD partition into two partition at the same node Sun, 15 Jan, 08:58
Anastasios Zouzias Re: Equally split a RDD partition into two partition at the same node Sun, 15 Jan, 17:21
Andrew Ash Re: Spark ANSI SQL Support Wed, 18 Jan, 06:01
Andrew Ehrlich json_tuple fails to parse string with emoji Wed, 25 Jan, 01:14
Andrew Ehrlich Re: json_tuple fails to parse string with emoji Thu, 26 Jan, 20:26
Andrew Holway Re: Running Spark on EMR Sun, 15 Jan, 16:37
Andrew Holway Re: Running Spark on EMR Sun, 15 Jan, 19:09
Andrew Milkowski freeing up memory occupied by processed Stream Blocks Thu, 19 Jan, 18:17
Andrew Milkowski Re: freeing up memory occupied by processed Stream Blocks Wed, 25 Jan, 14:30
Andy Dang top-k function for Window Tue, 03 Jan, 13:06
Andy Dang Re: top-k function for Window Tue, 03 Jan, 18:03
Andy Dang Re: top-k function for Window Tue, 03 Jan, 19:09
Andy Dang Re: top-k function for Window Wed, 04 Jan, 19:21
Andy Dang Converting an InternalRow to a Row Wed, 04 Jan, 19:27
Andy Dang How to hint Spark to use HashAggregate() for UDAF Mon, 09 Jan, 13:52
Andy Dang Re: How to hint Spark to use HashAggregate() for UDAF Mon, 09 Jan, 14:13
Andy Dang Re: groupByKey vs mapPartitions for efficient grouping within a Partition Mon, 16 Jan, 16:58
Andy Dang Re: GroupBy and Spark Performance issue Tue, 17 Jan, 12:06
Anil Langote Spark Aggregator for array of doubles Wed, 04 Jan, 22:23
Anil Langote Efficient look up in Key Pair RDD Mon, 09 Jan, 01:03
Anil Langote Re: Efficient look up in Key Pair RDD Mon, 09 Jan, 01:37
Anil Langote Re: Efficient look up in Key Pair RDD Mon, 09 Jan, 03:29
Anil Langote Issue with caching Fri, 27 Jan, 16:02
AnilKumar B mapPartition iterator Mon, 16 Jan, 22:28
Ankur Jain Machine Learning in Spark 1.6 vs Spark 2.0 Mon, 09 Jan, 10:19
Ankur Jain RE: Machine Learning in Spark 1.6 vs Spark 2.0 Mon, 09 Jan, 16:36
Ankur Srivastava Spark GraphFrame ConnectedComponents Thu, 05 Jan, 00:40
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · Next »Thread · Author · Date
Box list
Dec 201955
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137