spark-user mailing list archives: October 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
mailford...@gmail.com Re: NullPointerException error while saving Scala Dataframe to HBase Sun, 01 Oct, 03:32
Debabrata Ghosh Re: HDP 2.5 - Python - Spark-On-Hbase Sun, 01 Oct, 04:47
Kanagha Kumar Error - Spark reading from HDFS via dataframes - Java Sun, 01 Oct, 05:57
Anastasios Zouzias Re: Error - Spark reading from HDFS via dataframes - Java Sun, 01 Oct, 07:04
Sun, Keith How to find the temporary views' DDL Sun, 01 Oct, 09:49
Jeroen Miller Re: More instances = slower Spark job Sun, 01 Oct, 17:17
Hammad Fwd: Spark Streaming - Multiple Spark Contexts (SparkSQL) Performance Sun, 01 Oct, 17:55
Marco Mistroni Re: NullPointerException error while saving Scala Dataframe to HBase Sun, 01 Oct, 18:32
Gerard Maas Re: Spark Streaming - Multiple Spark Contexts (SparkSQL) Performance Sun, 01 Oct, 18:46
Gourav Sengupta Re: More instances = slower Spark job Sun, 01 Oct, 19:40
Jeroen Miller Re: More instances = slower Spark job Sun, 01 Oct, 21:11
Steve Loughran Re: More instances = slower Spark job Sun, 01 Oct, 22:53
Steve Loughran Re: More instances = slower Spark job Sun, 01 Oct, 23:23
Sean Owen Re: Should Flume integration be behind a profile? Mon, 02 Oct, 07:49
Pavel Knoblokh Re: Saving dataframes with partitionBy: append partitions, overwrite within each Mon, 02 Oct, 11:37
Patrick McCarthy PySpark - Expand rows into dataframes via function Mon, 02 Oct, 14:01
mckunkel Example of GBTClassifier Mon, 02 Oct, 15:51
JG Perrin RE: Error - Spark reading from HDFS via dataframes - Java Mon, 02 Oct, 18:23
JG Perrin RE: HDFS or NFS as a cache? Mon, 02 Oct, 18:26
Marcelo Vanzin Re: HDFS or NFS as a cache? Mon, 02 Oct, 18:31
Miguel Morales Re: HDFS or NFS as a cache? Mon, 02 Oct, 19:24
Sathish Kumaran Vairavelu Re: PySpark - Expand rows into dataframes via function Mon, 02 Oct, 23:52
JG Perrin Quick one... AWS SDK version? Tue, 03 Oct, 01:28
Weichen Xu Re: Example of GBTClassifier Tue, 03 Oct, 02:15
Jack Leadford [Spark] Expose Spark to Untrusted Users? Tue, 03 Oct, 03:23
Yash Sharma Re: Quick one... AWS SDK version? Tue, 03 Oct, 06:01
Ahmed Mahmoud Multiple filters vs multiple conditions Tue, 03 Oct, 12:14
Femi Anthony Re: Multiple filters vs multiple conditions Tue, 03 Oct, 12:19
ayan guha Re: Multiple filters vs multiple conditions Tue, 03 Oct, 13:01
Michael Artz Re: Multiple filters vs multiple conditions Tue, 03 Oct, 13:17
Patrick McCarthy Re: PySpark - Expand rows into dataframes via function Tue, 03 Oct, 13:30
usa usa Spark 2.2.0 Win 7 64 bits Exception while deleting Spark temp dir Tue, 03 Oct, 15:49
Sathish Kumaran Vairavelu Re: PySpark - Expand rows into dataframes via function Tue, 03 Oct, 16:03
Vadim Semenov Re: Multiple filters vs multiple conditions Tue, 03 Oct, 16:05
Adaryl Wakefield how do you deal with datetime in Spark? Tue, 03 Oct, 17:43
shyla deshpande Any libraries to do Complex Event Processing with spark streaming? Tue, 03 Oct, 17:50
Vadim Semenov Re: how do you deal with datetime in Spark? Tue, 03 Oct, 17:56
Nicholas Hakobian Re: how do you deal with datetime in Spark? Tue, 03 Oct, 18:04
Nicolas Paris Hive From Spark: Jdbc VS sparkContext Tue, 03 Oct, 18:08
Steve Loughran Re: how do you deal with datetime in Spark? Tue, 03 Oct, 19:18
Steve Loughran Re: Quick one... AWS SDK version? Tue, 03 Oct, 19:20
Adaryl Wakefield RE: how do you deal with datetime in Spark? Tue, 03 Oct, 20:14
Adaryl Wakefield RE: how do you deal with datetime in Spark? Tue, 03 Oct, 20:16
JG Perrin RE: Quick one... AWS SDK version? Tue, 03 Oct, 20:34
JG Perrin RE: Quick one... AWS SDK version? Tue, 03 Oct, 20:37
JG Perrin RE: Spark 2.2.0 Win 7 64 bits Exception while deleting Spark temp dir Tue, 03 Oct, 20:41
shyla deshpande Re: Any libraries to do Complex Event Processing with spark streaming? Tue, 03 Oct, 23:00
Marco Mistroni RE: Spark 2.2.0 Win 7 64 bits Exception while deleting Spark temp dir Wed, 04 Oct, 06:59
Gourav Sengupta Re: Hive From Spark: Jdbc VS sparkContext Wed, 04 Oct, 11:30
ayan guha Re: Hive From Spark: Jdbc VS sparkContext Wed, 04 Oct, 12:00
Steve Loughran Re: Quick one... AWS SDK version? Wed, 04 Oct, 14:17
Mikhailau, Alex Re: Re-sharded kinesis stream starts generating warnings after kinesis shard numbers were doubled Wed, 04 Oct, 14:43
Mikhailau, Alex Re: Re-sharded kinesis stream starts generating warnings after kinesis shard numbers were doubled Wed, 04 Oct, 14:48
pun mllib - CountVectorizer + LogisticRegression unexpected behavior Wed, 04 Oct, 18:29
pun Re: Spark ML - CountVectorizer + LogisticRegression unexpected behavior Wed, 04 Oct, 21:10
Sonavale, Piyush Inconsistent P-value generated for MLlib linear regression operation Thu, 05 Oct, 07:29
Tarun Kumar Accumulators not available in Task.taskMetrics Thu, 05 Oct, 08:14
Tushar Sudake How to merge fragmented IDs into one cluster if one/more IDs are shared Thu, 05 Oct, 19:35
Darshan Pandya <msg> Any rabbit mq connect for spark structured streaming ? </msg> Thu, 05 Oct, 19:51
pun Spark ML - LogisticRegression extract words with highest weights Thu, 05 Oct, 21:12
孫澤恩 Re: How to merge fragmented IDs into one cluster if one/more IDs are shared Fri, 06 Oct, 02:32
Tarun Kumar Re: Accumulators not available in Task.taskMetrics Fri, 06 Oct, 04:53
jithinpt Spark structured streaming - join static dataset with streaming dataset Fri, 06 Oct, 05:03
shadow Why is spark library using outputs(i+1) in MultilayerPerceptron for previous Delta Calculations Fri, 06 Oct, 08:30
Iman Mohtashemi TallSkinny QR decomposition Fri, 06 Oct, 18:18
Iman Mohtashemi Re: TallSkinnyQR Fri, 06 Oct, 21:29
Jonathan Kelly Re: Quick one... AWS SDK version? Fri, 06 Oct, 21:58
Xianyang Liu Re: TallSkinnyQR Sat, 07 Oct, 06:44
kant kodali How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 07:30
Matteo Cossu Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 15:28
Weitong Chen [spark-core] SortShuffleManager - when to enable Serialized sorting Sat, 07 Oct, 16:18
Jules Damji Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 17:00
Somasundaram Sekar DataFrame multiple agg on the same column Sat, 07 Oct, 17:12
yohann jardin Re: DataFrame multiple agg on the same column Sat, 07 Oct, 17:33
John, Vishal (Agoda) Cases when to clear the checkpoint directories. Sat, 07 Oct, 18:53
Marco Mistroni Re: Quick one... AWS SDK version? Sat, 07 Oct, 19:34
Jean Georges Perrin Re: Quick one... AWS SDK version? Sat, 07 Oct, 19:50
Serega Sheypak Implement Dataset reader from SEQ file with protobuf to Dataset Sun, 08 Oct, 10:00
Somasundaram Sekar Equivalent of Redshift ListAgg function in Spark (Pyspak) Sun, 08 Oct, 11:59
Tushar Sudake Re: Quick one... AWS SDK version? Sun, 08 Oct, 15:41
Jonathan Kelly Re: Quick one... AWS SDK version? Sun, 08 Oct, 16:13
kant kodali Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sun, 08 Oct, 18:58
Michael Armbrust Re: Implement Dataset reader from SEQ file with protobuf to Dataset Sun, 08 Oct, 19:22
Tushar Sudake EMR: Use extra mounted EBS volumes for spark.local.dir Mon, 09 Oct, 01:54
Li Zuwei [Spark Structured Streaming] How to select events by latest timestamp and aggregate count Mon, 09 Oct, 04:44
Mahesh Sawaiker RE: Equivalent of Redshift ListAgg function in Spark (Pyspak) Mon, 09 Oct, 06:14
Abdullah Bashir Fwd: [MLlib] RowMatrix computeSVD Native ARPACK support not detecting. Mon, 09 Oct, 07:46
Vikash Pareek How to avoid creating meta files (.crc files) Mon, 09 Oct, 07:50
Weichen Xu Re: [MLlib] RowMatrix computeSVD Native ARPACK support not detecting. Mon, 09 Oct, 09:41
kant kodali Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 11:36
Koert Kuipers Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 13:10
sixers [Spark SQL] Missing data in Elastisearch when writing data with elasticsearch-spark connector Mon, 09 Oct, 13:36
ayan guha Re: [Spark SQL] Missing data in Elastisearch when writing data with elasticsearch-spark connector Mon, 09 Oct, 13:42
Daan Debie Why does Spark need to set log levels Mon, 09 Oct, 15:49
kant kodali Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 18:38
Koert Kuipers Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 18:48
kant kodali Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 19:08
kant kodali Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Mon, 09 Oct, 19:14
Tathagata Das Re: Cases when to clear the checkpoint directories. Mon, 09 Oct, 20:06
Suman Somasundar UnresolvedAddressException in Kubernetes Cluster Mon, 09 Oct, 22:42
Message list1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Dec 201932
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137