spark-user mailing list archives: October 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Tarun Kumar Accumulators not available in Task.taskMetrics Thu, 05 Oct, 08:14
Tarun Kumar Re: Accumulators not available in Task.taskMetrics Fri, 06 Oct, 04:53
Tarun Kumar Tasks not getting scheduled on specified executor host Thu, 12 Oct, 19:31
Tarun Kumar Re: Tasks not getting scheduled on specified executor host Fri, 13 Oct, 04:53
Tathagata Das Re: Cases when to clear the checkpoint directories. Mon, 09 Oct, 20:06
Tathagata Das Re: Structured Stream in Spark Wed, 25 Oct, 23:42
Thakrar, Jayesh Re: Why don't I see my spark jobs running in parallel in Cassandra/Spark DSE cluster? Fri, 27 Oct, 13:14
Thomas Bailet Re: Spark streaming for CEP Tue, 24 Oct, 12:53
Tianyu Qi Fwd: Problem on running LDA with large iterations on spark Thu, 12 Oct, 12:28
Timur Shenkao Re: Job spark blocked and runs indefinitely Thu, 26 Oct, 21:55
Tushar Adeshara Re: Spark - Partitions Fri, 13 Oct, 08:45
Tushar Sudake How to merge fragmented IDs into one cluster if one/more IDs are shared Thu, 05 Oct, 19:35
Tushar Sudake Re: Quick one... AWS SDK version? Sun, 08 Oct, 15:41
Tushar Sudake EMR: Use extra mounted EBS volumes for spark.local.dir Mon, 09 Oct, 01:54
Vadim Semenov Re: Multiple filters vs multiple conditions Tue, 03 Oct, 16:05
Vadim Semenov Re: how do you deal with datetime in Spark? Tue, 03 Oct, 17:56
Vadim Semenov Re: Unable to run Spark Jobs in yarn cluster mode Tue, 10 Oct, 15:09
Vadim Semenov Re: EMR: Use extra mounted EBS volumes for spark.local.dir Tue, 10 Oct, 15:26
Vadim Semenov Re: Is there a difference between df.cache() vs df.rdd.cache() Fri, 13 Oct, 21:50
Vasu Gourabathina Metadata Management Thu, 19 Oct, 21:21
Vikash Pareek How to avoid creating meta files (.crc files) Mon, 09 Oct, 07:50
Walia, Reema RE: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 21:32
Weichen Xu Re: Example of GBTClassifier Tue, 03 Oct, 02:15
Weichen Xu Re: [MLlib] RowMatrix computeSVD Native ARPACK support not detecting. Mon, 09 Oct, 09:41
Weichen Xu Re: Is there a difference between df.cache() vs df.rdd.cache() Fri, 13 Oct, 10:19
Weichen Xu Re: Is there a difference between df.cache() vs df.rdd.cache() Sat, 14 Oct, 01:56
Weichen Xu Re: jar file problem Fri, 20 Oct, 02:11
Weichen Xu Re: Spark ML - LogisticRegression interpreting prediction Mon, 23 Oct, 01:47
Weichen Xu Re: Zero Coefficient in logistic regression Tue, 24 Oct, 10:23
Weichen Xu Re: StringIndexer on several columns in a DataFrame with Scala Mon, 30 Oct, 09:40
Weitong Chen [spark-core] SortShuffleManager - when to enable Serialized sorting Sat, 07 Oct, 16:18
Wenchen Fan Re: Dataset API Question Wed, 25 Oct, 20:49
Xianyang Liu Re: TallSkinnyQR Sat, 07 Oct, 06:44
Yash Sharma Re: Quick one... AWS SDK version? Tue, 03 Oct, 06:01
Zhang, Liyun Anyone knows how to build and spark on jdk9? Fri, 27 Oct, 02:21
Zhang, Liyun RE: Anyone knows how to build and spark on jdk9? Fri, 27 Oct, 02:44
amine_901 Job spark blocked and runs indefinitely Wed, 11 Oct, 12:37
amine_901 Job spark blocked and runs indefinitely Wed, 11 Oct, 12:40
anna stax Spark streaming for CEP Wed, 18 Oct, 19:52
anna stax Re: Spark streaming for CEP Thu, 26 Oct, 02:08
ashmeet kandhari Reading Array Type of Struct Column from a Dataset Thu, 12 Oct, 14:02
ayan guha Re: Multiple filters vs multiple conditions Tue, 03 Oct, 13:01
ayan guha Re: Hive From Spark: Jdbc VS sparkContext Wed, 04 Oct, 12:00
ayan guha Re: [Spark SQL] Missing data in Elastisearch when writing data with elasticsearch-spark connector Mon, 09 Oct, 13:42
ayan guha Re: Hive From Spark: Jdbc VS sparkContext Tue, 10 Oct, 11:29
ayan guha Re: Reading from HDFS by increasing split size Tue, 10 Oct, 11:32
ayan guha Re: Reading from HDFS by increasing split size Tue, 10 Oct, 19:25
ayan guha Re: How to flatten a row in PySpark Fri, 13 Oct, 01:27
ayan guha Re: Happy Diwali to those forum members who celebrate this great festival Mon, 16 Oct, 09:56
ayan guha Re: Database insert happening two times Tue, 17 Oct, 12:02
ayan guha Re: Database insert happening two times Tue, 17 Oct, 13:15
ayan guha Re: parition by multiple columns/keys Wed, 18 Oct, 05:29
ayan guha Re: Structured streaming with event hubs Fri, 27 Oct, 14:18
jithinpt Spark structured streaming - join static dataset with streaming dataset Fri, 06 Oct, 05:03
kant kodali How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sat, 07 Oct, 07:30
kant kodali Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Sun, 08 Oct, 18:58
kant kodali Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 11:36
kant kodali Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 18:38
kant kodali Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Mon, 09 Oct, 19:08
kant kodali Re: How to convert Array of Json rows into Dataset of specific columns in Spark 2.2.0? Mon, 09 Oct, 19:14
kant kodali Re: Does Spark 2.2.0 support Dataset<List<Map<String,Object>>> ? Tue, 10 Oct, 08:46
kant kodali Does spark sql has timezone support? Thu, 26 Oct, 06:04
kant kodali JIRA Ticket 21641 Thu, 26 Oct, 06:18
lmk Re: Prediction using Classification with text attributes in Apache Spark MLLib Fri, 20 Oct, 11:42
lucas.g...@gmail.com Does Apache Spark take into account JDBC indexes / statistics when optimizing queries? Thu, 19 Oct, 22:10
lucas.g...@gmail.com Re: Does Apache Spark take into account JDBC indexes / statistics when optimizing queries? Thu, 19 Oct, 22:29
lucas.g...@gmail.com Re: Does Apache Spark take into account JDBC indexes / statistics when optimizing queries? Thu, 19 Oct, 23:04
lucas.g...@gmail.com Re: Does Apache Spark take into account JDBC indexes / statistics when optimizing queries? Fri, 20 Oct, 16:17
lucas.g...@gmail.com Re: spark session jdbc performance Tue, 24 Oct, 23:09
lucas.g...@gmail.com Re: Spark streaming for CEP Wed, 25 Oct, 03:02
lucas.g...@gmail.com Re: spark session jdbc performance Wed, 25 Oct, 03:04
lucas.g...@gmail.com Re: spark session jdbc performance Wed, 25 Oct, 17:03
lucas.g...@gmail.com Re: spark session jdbc performance Wed, 25 Oct, 20:26
lucas.g...@gmail.com Re: Suggestions on using scala/python for Spark Streaming Thu, 26 Oct, 16:30
lucas.g...@gmail.com Re: Controlling number of spark partitions in dataframes Thu, 26 Oct, 16:52
lucas.g...@gmail.com Re: Controlling number of spark partitions in dataframes Thu, 26 Oct, 18:31
lucas.g...@gmail.com Re: Controlling number of spark partitions in dataframes Thu, 26 Oct, 21:01
mailford...@gmail.com Re: NullPointerException error while saving Scala Dataframe to HBase Sun, 01 Oct, 03:32
mailford...@gmail.com Re: Unable to run Spark Jobs in yarn cluster mode Tue, 10 Oct, 23:58
mckunkel Example of GBTClassifier Mon, 02 Oct, 15:51
mmdenny Re: Spark 2.2.0 GC Overhead Limit Exceeded and OOM errors in the executors Mon, 30 Oct, 01:52
onoke How to get the data url Mon, 30 Oct, 03:20
patel kumar Dependency error due to scala version mismatch in SBT and Spark 2.1 Mon, 16 Oct, 05:42
patel kumar Re: Dependency error due to scala version mismatch in SBT and Spark 2.1 Mon, 16 Oct, 07:26
pnpritchard Unexpected caching behavior Thu, 26 Oct, 22:58
pnpritchard Re: Unexpected caching behavior Thu, 26 Oct, 23:01
pnpritchard Re: Unexpected caching behavior Thu, 26 Oct, 23:01
pun mllib - CountVectorizer + LogisticRegression unexpected behavior Wed, 04 Oct, 18:29
pun Re: Spark ML - CountVectorizer + LogisticRegression unexpected behavior Wed, 04 Oct, 21:10
pun Spark ML - LogisticRegression extract words with highest weights Thu, 05 Oct, 21:12
pun Spark ML - LogisticRegression interpreting prediction Sun, 22 Oct, 17:20
pun Re: Spark ML - LogisticRegression interpreting prediction Mon, 23 Oct, 16:23
ricky l interpretation of Spark logs about remote fetch latency Fri, 13 Oct, 02:42
roshan joe share datasets across multiple spark-streaming applications for lookup Tue, 31 Oct, 02:53
sanat kumar Patnaik Databricks Certification Registration Tue, 24 Oct, 12:17
shadow Why is spark library using outputs(i+1) in MultilayerPerceptron for previous Delta Calculations Fri, 06 Oct, 08:30
shekar Spark-submit on a sample program gives Syntax Error Tue, 10 Oct, 11:26
shyla deshpande Any libraries to do Complex Event Processing with spark streaming? Tue, 03 Oct, 17:50
shyla deshpande Re: Any libraries to do Complex Event Processing with spark streaming? Tue, 03 Oct, 23:00
sixers [Spark SQL] Missing data in Elastisearch when writing data with elasticsearch-spark connector Mon, 09 Oct, 13:36
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Sep 202194
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137