spark-user mailing list archives: October 2017

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Re: NullPointerException error while saving Scala Dataframe to HBase
mailford...@gmail.com   Re: NullPointerException error while saving Scala Dataframe to HBase Sun, 01 Oct, 03:32
Marco Mistroni     Re: NullPointerException error while saving Scala Dataframe to HBase Sun, 01 Oct, 18:32
Re: HDP 2.5 - Python - Spark-On-Hbase
Debabrata Ghosh   Re: HDP 2.5 - Python - Spark-On-Hbase Sun, 01 Oct, 04:47
Kanagha Kumar Error - Spark reading from HDFS via dataframes - Java Sun, 01 Oct, 05:57
Anastasios Zouzias   Re: Error - Spark reading from HDFS via dataframes - Java Sun, 01 Oct, 07:04
JG Perrin     RE: Error - Spark reading from HDFS via dataframes - Java Mon, 02 Oct, 18:23
Sun, Keith How to find the temporary views' DDL Sun, 01 Oct, 09:49
Re: More instances = slower Spark job
Jeroen Miller   Re: More instances = slower Spark job Sun, 01 Oct, 17:17
Gourav Sengupta     Re: More instances = slower Spark job Sun, 01 Oct, 19:40
Jeroen Miller   Re: More instances = slower Spark job Sun, 01 Oct, 21:11
Steve Loughran   Re: More instances = slower Spark job Sun, 01 Oct, 22:53
Steve Loughran   Re: More instances = slower Spark job Sun, 01 Oct, 23:23
Fwd: Spark Streaming - Multiple Spark Contexts (SparkSQL) Performance
Hammad   Fwd: Spark Streaming - Multiple Spark Contexts (SparkSQL) Performance Sun, 01 Oct, 17:55
Gerard Maas     Re: Spark Streaming - Multiple Spark Contexts (SparkSQL) Performance Sun, 01 Oct, 18:46
Re: Should Flume integration be behind a profile?
Sean Owen   Re: Should Flume integration be behind a profile? Mon, 02 Oct, 07:49
Re: Saving dataframes with partitionBy: append partitions, overwrite within each
Pavel Knoblokh   Re: Saving dataframes with partitionBy: append partitions, overwrite within each Mon, 02 Oct, 11:37
Patrick McCarthy PySpark - Expand rows into dataframes via function Mon, 02 Oct, 14:01
Sathish Kumaran Vairavelu   Re: PySpark - Expand rows into dataframes via function Mon, 02 Oct, 23:52
Patrick McCarthy     Re: PySpark - Expand rows into dataframes via function Tue, 03 Oct, 13:30
Sathish Kumaran Vairavelu       Re: PySpark - Expand rows into dataframes via function Tue, 03 Oct, 16:03
mckunkel Example of GBTClassifier Mon, 02 Oct, 15:51
Weichen Xu   Re: Example of GBTClassifier Tue, 03 Oct, 02:15
RE: HDFS or NFS as a cache?
JG Perrin   RE: HDFS or NFS as a cache? Mon, 02 Oct, 18:26
Marcelo Vanzin     Re: HDFS or NFS as a cache? Mon, 02 Oct, 18:31
Miguel Morales       Re: HDFS or NFS as a cache? Mon, 02 Oct, 19:24
JG Perrin Quick one... AWS SDK version? Tue, 03 Oct, 01:28
Yash Sharma   Re: Quick one... AWS SDK version? Tue, 03 Oct, 06:01
JG Perrin     RE: Quick one... AWS SDK version? Tue, 03 Oct, 20:34
Steve Loughran   Re: Quick one... AWS SDK version? Tue, 03 Oct, 19:20
JG Perrin     RE: Quick one... AWS SDK version? Tue, 03 Oct, 20:37
Steve Loughran       Re: Quick one... AWS SDK version? Wed, 04 Oct, 14:17
Jonathan Kelly         Re: Quick one... AWS SDK version? Fri, 06 Oct, 21:58
Marco Mistroni           Re: Quick one... AWS SDK version? Sat, 07 Oct, 19:34
Jean Georges Perrin             Re: Quick one... AWS SDK version? Sat, 07 Oct, 19:50
Tushar Sudake               Re: Quick one... AWS SDK version? Sun, 08 Oct, 15:41
Jonathan Kelly                 Re: Quick one... AWS SDK version? Sun, 08 Oct, 16:13
Jack Leadford [Spark] Expose Spark to Untrusted Users? Tue, 03 Oct, 03:23
Ahmed Mahmoud Multiple filters vs multiple conditions Tue, 03 Oct, 12:14
Femi Anthony   Re: Multiple filters vs multiple conditions Tue, 03 Oct, 12:19
ayan guha     Re: Multiple filters vs multiple conditions Tue, 03 Oct, 13:01
Michael Artz       Re: Multiple filters vs multiple conditions Tue, 03 Oct, 13:17
Vadim Semenov   Re: Multiple filters vs multiple conditions Tue, 03 Oct, 16:05
usa usa Spark 2.2.0 Win 7 64 bits Exception while deleting Spark temp dir Tue, 03 Oct, 15:49
JG Perrin   RE: Spark 2.2.0 Win 7 64 bits Exception while deleting Spark temp dir Tue, 03 Oct, 20:41
Marco Mistroni     RE: Spark 2.2.0 Win 7 64 bits Exception while deleting Spark temp dir Wed, 04 Oct, 06:59
Adaryl Wakefield how do you deal with datetime in Spark? Tue, 03 Oct, 17:43
Vadim Semenov   Re: how do you deal with datetime in Spark? Tue, 03 Oct, 17:56
Nicholas Hakobian   Re: how do you deal with datetime in Spark? Tue, 03 Oct, 18:04
Adaryl Wakefield     RE: how do you deal with datetime in Spark? Tue, 03 Oct, 20:14
Steve Loughran   Re: how do you deal with datetime in Spark? Tue, 03 Oct, 19:18
Adaryl Wakefield     RE: how do you deal with datetime in Spark? Tue, 03 Oct, 20:16
shyla deshpande Any libraries to do Complex Event Processing with spark streaming? Tue, 03 Oct, 17:50
shyla deshpande   Re: Any libraries to do Complex Event Processing with spark streaming? Tue, 03 Oct, 23:00
Nicolas Paris Hive From Spark: Jdbc VS sparkContext Tue, 03 Oct, 18:08
Gourav Sengupta   Re: Hive From Spark: Jdbc VS sparkContext Wed, 04 Oct, 11:30
ayan guha     Re: Hive From Spark: Jdbc VS sparkContext Wed, 04 Oct, 12:00
郭鹏飞   Re: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 10:23
ayan guha     Re: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 11:29
weand       Re: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 21:14
Walia, Reema         RE: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 21:32
Gourav Sengupta         Re: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 21:35
Nicolas Paris           Re: Hive From Spark: Jdbc VS sparkContext Fri, 13 Oct, 07:22
Kabeer Ahmed             Re: Hive From Spark: Jdbc VS sparkContext Fri, 13 Oct, 10:02
Nicolas Paris           Re: Hive From Spark: Jdbc VS sparkContext Sun, 15 Oct, 14:43
Gourav Sengupta             Re: Hive From Spark: Jdbc VS sparkContext Sun, 15 Oct, 17:24
Nicolas Paris   Re: Hive From Spark: Jdbc VS sparkContext Sun, 15 Oct, 11:55
Gourav Sengupta     Re: Hive From Spark: Jdbc VS sparkContext Sun, 15 Oct, 13:34
Nicolas Paris       Re: Hive From Spark: Jdbc VS sparkContext Sun, 15 Oct, 14:07
Re: Re-sharded kinesis stream starts generating warnings after kinesis shard numbers were doubled
Mikhailau, Alex   Re: Re-sharded kinesis stream starts generating warnings after kinesis shard numbers were doubled Wed, 04 Oct, 14:43
Mikhailau, Alex     Re: Re-sharded kinesis stream starts generating warnings after kinesis shard numbers were doubled Wed, 04 Oct, 14:48
pun mllib - CountVectorizer + LogisticRegression unexpected behavior Wed, 04 Oct, 18:29
pun   Re: Spark ML - CountVectorizer + LogisticRegression unexpected behavior Wed, 04 Oct, 21:10
Sonavale, Piyush Inconsistent P-value generated for MLlib linear regression operation Thu, 05 Oct, 07:29
Sonavale, Piyush   Inconsistent P-value generated for MLlib linear regression operation Tue, 10 Oct, 06:14
Tarun Kumar Accumulators not available in Task.taskMetrics Thu, 05 Oct, 08:14
Tarun Kumar   Re: Accumulators not available in Task.taskMetrics Fri, 06 Oct, 04:53
Tushar Sudake How to merge fragmented IDs into one cluster if one/more IDs are shared Thu, 05 Oct, 19:35
孫澤恩   Re: How to merge fragmented IDs into one cluster if one/more IDs are shared Fri, 06 Oct, 02:32
Darshan Pandya <msg> Any rabbit mq connect for spark structured streaming ? </msg> Thu, 05 Oct, 19:51
pun Spark ML - LogisticRegression extract words with highest weights Thu, 05 Oct, 21:12
jithinpt Spark structured streaming - join static dataset with streaming dataset Fri, 06 Oct, 05:03
shadow Why is spark library using outputs(i+1) in MultilayerPerceptron for previous Delta Calculations Fri, 06 Oct, 08:30
Iman Mohtashemi TallSkinny QR decomposition Fri, 06 Oct, 18:18
Re: TallSkinnyQR
Iman Mohtashemi   Re: TallSkinnyQR Fri, 06 Oct, 21:29
Xianyang Liu   Re: TallSkinnyQR Sat, 07 Oct, 06:44
kant kodali How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 07:30
Matteo Cossu   Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 15:28
Jules Damji   Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 17:00
kant kodali     Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sun, 08 Oct, 18:58
kant kodali       Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Mon, 09 Oct, 19:14
JG Perrin   RE: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Tue, 10 Oct, 18:24
Weitong Chen [spark-core] SortShuffleManager - when to enable Serialized sorting Sat, 07 Oct, 16:18
Somasundaram Sekar DataFrame multiple agg on the same column Sat, 07 Oct, 17:12
yohann jardin   Re: DataFrame multiple agg on the same column Sat, 07 Oct, 17:33
John, Vishal (Agoda) Cases when to clear the checkpoint directories. Sat, 07 Oct, 18:53
Tathagata Das   Re: Cases when to clear the checkpoint directories. Mon, 09 Oct, 20:06
Serega Sheypak Implement Dataset reader from SEQ file with protobuf to Dataset Sun, 08 Oct, 10:00
Michael Armbrust   Re: Implement Dataset reader from SEQ file with protobuf to Dataset Sun, 08 Oct, 19:22
Somasundaram Sekar Equivalent of Redshift ListAgg function in Spark (Pyspak) Sun, 08 Oct, 11:59
Mahesh Sawaiker   RE: Equivalent of Redshift ListAgg function in Spark (Pyspak) Mon, 09 Oct, 06:14
Tushar Sudake EMR: Use extra mounted EBS volumes for spark.local.dir Mon, 09 Oct, 01:54
Vadim Semenov   Re: EMR: Use extra mounted EBS volumes for spark.local.dir Tue, 10 Oct, 15:26
Li Zuwei [Spark Structured Streaming] How to select events by latest timestamp and aggregate count Mon, 09 Oct, 04:44
Fwd: [MLlib] RowMatrix computeSVD Native ARPACK support not detecting.
Abdullah Bashir   Fwd: [MLlib] RowMatrix computeSVD Native ARPACK support not detecting. Mon, 09 Oct, 07:46
Weichen Xu     Re: [MLlib] RowMatrix computeSVD Native ARPACK support not detecting. Mon, 09 Oct, 09:41
Vikash Pareek How to avoid creating meta files (.crc files) Mon, 09 Oct, 07:50
kant kodali Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 11:36
Koert Kuipers   Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 13:10
kant kodali     Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 18:38
Koert Kuipers       Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 18:48
kant kodali         Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 19:08
kant kodali           Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Tue, 10 Oct, 08:46
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Sep 2019137
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137