spark-user mailing list archives: June 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
jay vyas Spark jobs without a login Thu, 16 Jun, 20:32
Ted Yu   Re: Spark jobs without a login Thu, 16 Jun, 21:14
Amit Assudani Update Batch DF with Streaming Thu, 16 Jun, 22:11
Amit Assudani   Re: Update Batch DF with Streaming Sun, 19 Jun, 18:41
Jacek Laskowski   Re: Update Batch DF with Streaming Mon, 20 Jun, 16:09
tosaigan...@gmail.com Spark Streaming WAL issue**: File exists and there is no append support! Thu, 16 Jun, 22:50
Selvam Raman Skew data Fri, 17 Jun, 00:55
Pedro Rodriguez   Re: Skew data Sat, 18 Jun, 04:32
Joseph sparkR.init() can not load sparkPackages. Fri, 17 Jun, 02:46
Sun Rui   Re: sparkR.init() can not load sparkPackages. Sun, 19 Jun, 07:26
test - what is the wrong while adding one column in the dataframe
Zhiliang Zhu   test - what is the wrong while adding one column in the dataframe Fri, 17 Jun, 04:15
Zhiliang Zhu     Re: test - what is the wrong while adding one column in the dataframe Fri, 17 Jun, 05:48
spark job killed without rhyme or reason
Zhiliang Zhu   spark job killed without rhyme or reason Fri, 17 Jun, 06:09
Zhiliang Zhu     Re: spark job automatically killed without rhyme or reason Fri, 17 Jun, 06:33
pseudo oduesp Stringindexers on multiple columns >1000 Fri, 17 Jun, 07:39
RE: spark job automatically killed without rhyme or reason
Alexander Kapustin   RE: spark job automatically killed without rhyme or reason Fri, 17 Jun, 07:52
Zhiliang Zhu     Re: spark job automatically killed without rhyme or reason Fri, 17 Jun, 10:53
Zhiliang Zhu       Re: spark job automatically killed without rhyme or reason Fri, 17 Jun, 10:59
Zhiliang Zhu         Re: spark job automatically killed without rhyme or reason Fri, 17 Jun, 11:07
Zhiliang Zhu       Re: spark job automatically killed without rhyme or reason Fri, 17 Jun, 11:06
Alexander Kapustin   RE: spark job automatically killed without rhyme or reason Fri, 17 Jun, 12:44
Zhiliang Zhu     Re: spark job automatically killed without rhyme or reason Mon, 20 Jun, 08:17
Sean Owen       Re: spark job automatically killed without rhyme or reason Mon, 20 Jun, 08:34
Nirav Patel         Re: spark job automatically killed without rhyme or reason Wed, 22 Jun, 05:59
Zhiliang Zhu           Re: spark job automatically killed without rhyme or reason Thu, 23 Jun, 06:21
Aakash Basu             Re: spark job automatically killed without rhyme or reason Thu, 23 Jun, 16:08
pseudo oduesp update data frame inside function Fri, 17 Jun, 08:25
Леонид Поляков Custom DataFrame filter Fri, 17 Jun, 08:45
pseudo oduesp binding two data frame Fri, 17 Jun, 09:04
VG java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:08
Marco Mistroni   Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:12
VG     Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:20
Siva A       Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:26
Siva A         Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:28
VG         Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:42
Marco Mistroni       Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:29
VG         Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:47
Siva A           Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 09:50
Siva A             Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:28
VG               Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:32
Siva A                 Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:38
Marco Mistroni                 Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:41
Siva A                   Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:46
VG                     Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:55
VG                       Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:58
Siva A                       Re: java.lang.ClassNotFoundException: Failed to find data source: com.databricks.spark.xml. Please find packages at http://spark-packages.org Fri, 17 Jun, 10:58
VG spark-xml - xml parsing when rows only have attributes Fri, 17 Jun, 12:19
Ted Yu   Re: spark-xml - xml parsing when rows only have attributes Fri, 17 Jun, 12:51
VG     Re: spark-xml - xml parsing when rows only have attributes Fri, 17 Jun, 13:11
Unable to kill spark app gracefully. Unable to stop driver in cluster mode
Ravi Agrawal   Unable to kill spark app gracefully. Unable to stop driver in cluster mode Fri, 17 Jun, 13:09
Ravi Agrawal   Unable to kill spark app gracefully. Unable to stop driver in cluster mode Fri, 17 Jun, 13:11
Sumona Routh Spark UI shows finished when job had an error Fri, 17 Jun, 13:49
Jacek Laskowski   Re: Spark UI shows finished when job had an error Fri, 17 Jun, 16:13
Gourav Sengupta   Re: Spark UI shows finished when job had an error Fri, 17 Jun, 16:41
Mich Talebzadeh   Re: Spark UI shows finished when job had an error Fri, 17 Jun, 17:12
Running Java Implementationof StreamingKmeans
Biplob Biswas   Running Java Implementationof StreamingKmeans Fri, 17 Jun, 15:39
Biplob Biswas   Running Java Implementationof StreamingKmeans Fri, 17 Jun, 17:50
Everett Anderson Best way to go from RDD<String> to DataFrame of StringType columns Fri, 17 Jun, 19:38
Mich Talebzadeh   Re: Best way to go from RDD<String> to DataFrame of StringType columns Fri, 17 Jun, 19:44
Everett Anderson     Re: Best way to go from RDD<String> to DataFrame of StringType columns Fri, 17 Jun, 20:02
Mich Talebzadeh       Re: Best way to go from RDD<String> to DataFrame of StringType columns Fri, 17 Jun, 20:17
Everett Anderson         Re: Best way to go from RDD<String> to DataFrame of StringType columns Fri, 17 Jun, 20:59
Jason   Re: Best way to go from RDD<String> to DataFrame of StringType columns Fri, 17 Jun, 22:02
Saisai Shao YARN Application Timeline service with Spark 2.0.0 issue Fri, 17 Jun, 20:29
Running JavaBased Implementationof StreamingKmeans
Biplob Biswas   Running JavaBased Implementationof StreamingKmeans Fri, 17 Jun, 20:41
Biplob Biswas   Running JavaBased Implementationof StreamingKmeans Sat, 18 Jun, 09:54
Akhil Das     Re: Running JavaBased Implementationof StreamingKmeans Sat, 18 Jun, 15:59
Biplob Biswas       Re: Running JavaBased Implementationof StreamingKmeans Sat, 18 Jun, 17:37
Akhil Das         Re: Running JavaBased Implementationof StreamingKmeans Sun, 19 Jun, 01:23
Biplob Biswas           Re: Running JavaBased Implementationof StreamingKmeans Sun, 19 Jun, 11:29
Biplob Biswas             Re: Running JavaBased Implementationof StreamingKmeans Tue, 21 Jun, 08:47
Benjamin Kim Data Integrity / Model Quality Monitoring Fri, 17 Jun, 21:35
Pedro Rodriguez Dataset Select Function after Aggregate Error Fri, 17 Jun, 22:33
Xinh Huynh   Re: Dataset Select Function after Aggregate Error Fri, 17 Jun, 22:53
Takeshi Yamamuro     Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 02:53
Pedro Rodriguez       Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 03:59
Takeshi Yamamuro         Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 06:00
Pedro Rodriguez         Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 06:09
Takeshi Yamamuro           Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 07:16
Pedro Rodriguez             Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 12:39
Pedro Rodriguez               Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 15:29
Ted Yu                 Re: Dataset Select Function after Aggregate Error Sat, 18 Jun, 15:47
Andrew Lee Spark 2.0 preview - How to configure warehouse for Catalyst? always pointing to /user/hive/warehouse Fri, 17 Jun, 23:34
Jonathan Kelly Spark 2.0 on YARN - Files in config archive not ending up on executor classpath Sat, 18 Jun, 01:36
Jonathan Kelly   Re: Spark 2.0 on YARN - Files in config archive not ending up on executor classpath Mon, 20 Jun, 14:04
Marcelo Vanzin     Re: Spark 2.0 on YARN - Files in config archive not ending up on executor classpath Mon, 20 Jun, 17:42
Jonathan Kelly       Re: Spark 2.0 on YARN - Files in config archive not ending up on executor classpath Mon, 20 Jun, 20:20
Marcelo Vanzin         Re: Spark 2.0 on YARN - Files in config archive not ending up on executor classpath Mon, 20 Jun, 20:21
Jonathan Kelly           Re: Spark 2.0 on YARN - Files in config archive not ending up on executor classpath Mon, 20 Jun, 21:14
Python to Scala
Aakash Basu   Python to Scala Sat, 18 Jun, 04:34
Yash Sharma     Re: Python to Scala Sat, 18 Jun, 04:37
Aakash Basu       Re: Python to Scala Sat, 18 Jun, 04:47
Stephen Boesch         Re: Python to Scala Sat, 18 Jun, 05:09
Aakash Basu           Re: Python to Scala Sat, 18 Jun, 05:27
Yash Sharma             Re: Python to Scala Sat, 18 Jun, 06:13
ayan guha               Re: Python to Scala Sat, 18 Jun, 07:26
Marco Mistroni             Re: Python to Scala Sat, 18 Jun, 13:46
Sivakumaran S             Re: Python to Scala Sat, 18 Jun, 13:50
Ramprakash Ramamoorthy Making spark read from sources other than HDFS Sat, 18 Jun, 09:52
Mich Talebzadeh   Re: Making spark read from sources other than HDFS Sat, 18 Jun, 12:00
Jacek Laskowski How to cause a stage to fail (using spark-shell)? Sat, 18 Jun, 09:53
Jacek Laskowski   Re: How to cause a stage to fail (using spark-shell)? Sat, 18 Jun, 12:35
Burak Yavuz     Re: How to cause a stage to fail (using spark-shell)? Sun, 19 Jun, 03:25
Jacek Laskowski       Re: How to cause a stage to fail (using spark-shell)? Sun, 19 Jun, 10:22
Ted Yu         Re: How to cause a stage to fail (using spark-shell)? Sun, 19 Jun, 14:35
Jacek Laskowski           Re: How to cause a stage to fail (using spark-shell)? Sun, 19 Jun, 14:59
Jacek Laskowski Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 14:04
Mich Talebzadeh   Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 16:02
Akhil Das   Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 16:05
Jacek Laskowski     Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 16:08
Mich Talebzadeh       Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 16:16
Jacek Laskowski         Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 16:35
Mich Talebzadeh           Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 16:53
Mich Talebzadeh             Re: Many executors with the same ID in web UI (under Executors)? Sat, 18 Jun, 17:12
Brandon White What does it mean when a executor has negative active tasks? Sat, 18 Jun, 16:50
Mich Talebzadeh   Re: What does it mean when a executor has negative active tasks? Sat, 18 Jun, 17:02
Brandon White     Re: What does it mean when a executor has negative active tasks? Sat, 18 Jun, 17:02
Biplob Biswas Running JavaBased Implementation of StreamingKmeans Sat, 18 Jun, 17:30
Jules Damji CfP for Spark Summit Brussels, 2016 Sat, 18 Jun, 17:56
unsubscribe error
Marco Platania   unsubscribe error Sat, 18 Jun, 19:04
Mich Talebzadeh     Re: unsubscribe error Sat, 18 Jun, 19:10
Natu Lauchande Spark not using all the cluster instances in AWS EMR Sat, 18 Jun, 19:17
Akhil Das   Re: Spark not using all the cluster instances in AWS EMR Sun, 19 Jun, 01:40
Re: Improving performance of a kafka spark streaming app
Colin Kincaid Williams   Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 19:40
Mich Talebzadeh     Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 19:53
Colin Kincaid Williams       Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 19:59
Colin Kincaid Williams         Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 20:00
Mich Talebzadeh         Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 20:01
Mich Talebzadeh           Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 20:08
Colin Kincaid Williams             Re: Improving performance of a kafka spark streaming app Sat, 18 Jun, 21:40
Cody Koeninger               Re: Improving performance of a kafka spark streaming app Mon, 20 Jun, 14:12
Colin Kincaid Williams                 Re: Improving performance of a kafka spark streaming app Mon, 20 Jun, 19:32
Colin Kincaid Williams                   Re: Improving performance of a kafka spark streaming app Tue, 21 Jun, 20:19
Cody Koeninger                     Re: Improving performance of a kafka spark streaming app Tue, 21 Jun, 20:32
Colin Kincaid Williams                       Re: Improving performance of a kafka spark streaming app Tue, 21 Jun, 21:04
Colin Kincaid Williams                         Re: Improving performance of a kafka spark streaming app Thu, 23 Jun, 05:06
Colin Kincaid Williams                           Re: Improving performance of a kafka spark streaming app Thu, 23 Jun, 05:09
Cody Koeninger                             Re: Improving performance of a kafka spark streaming app Fri, 24 Jun, 14:35
Re: Creating tables for JSON data
brendan kehoe   Re: Creating tables for JSON data Sun, 19 Jun, 00:24
Vamsi Krishna spark streaming - how to purge old data files in data directory Sun, 19 Jun, 00:28
Akhil Das   Re: spark streaming - how to purge old data files in data directory Sun, 19 Jun, 01:34
Krishna Sankar Thanks For a Job Well Done !!! Sun, 19 Jun, 02:20
Reynold Xin   Re: Thanks For a Job Well Done !!! Sun, 19 Jun, 05:34
Amit Sela Are ser/de optimizations relevant with Dataset API and Encoders ? Sun, 19 Jun, 06:55
Running Spark in local mode
Ashok Kumar   Running Spark in local mode Sun, 19 Jun, 08:39
Takeshi Yamamuro     Re: Running Spark in local mode Sun, 19 Jun, 08:52
Ashok Kumar       Re: Running Spark in local mode Sun, 19 Jun, 09:14
Takeshi Yamamuro         Re: Running Spark in local mode Sun, 19 Jun, 09:39
Mich Talebzadeh           Re: Running Spark in local mode Sun, 19 Jun, 10:30
Jacek Laskowski             Re: Running Spark in local mode Sun, 19 Jun, 10:46
Mich Talebzadeh               Re: Running Spark in local mode Sun, 19 Jun, 11:13
Jonathan Kelly                 Re: Running Spark in local mode Sun, 19 Jun, 18:09
Mich Talebzadeh                   Re: Running Spark in local mode Sun, 19 Jun, 18:30
Ashok Kumar                     Re: Running Spark in local mode Sun, 19 Jun, 19:43
pseudo oduesp plot importante variable in pyspark Sun, 19 Jun, 08:44
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · Next »Thread · Author · Date
Box list
Sep 202191
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137