spark-user mailing list archives: February 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Devesh Raj Singh Reading CSV file using pyspark Thu, 18 Feb, 10:05
Teng Qiu   Re: Reading CSV file using pyspark Thu, 18 Feb, 11:05
Gourav Sengupta     Re: Reading CSV file using pyspark Thu, 18 Feb, 11:27
roryofbyrne How do I stream in Parquet files using fileStream() and ParquetInputFormat Thu, 18 Feb, 10:40
Re: Is stddev not a supported aggregation function in SparkSQL WindowSpec?
rok   Re: Is stddev not a supported aggregation function in SparkSQL WindowSpec? Thu, 18 Feb, 11:03
Mich Talebzadeh     Re: Is stddev not a supported aggregation function in SparkSQL WindowSpec? Thu, 18 Feb, 15:58
Sachin Aggarwal explaination for parent.slideDuration in ReducedWindowedDStream Thu, 18 Feb, 11:14
James Hammerton Is this likely to cause any problems? Thu, 18 Feb, 11:39
Ted Yu   Re: Is this likely to cause any problems? Thu, 18 Feb, 12:23
Gourav Sengupta     Re: Is this likely to cause any problems? Thu, 18 Feb, 14:04
Teng Qiu       Re: Is this likely to cause any problems? Thu, 18 Feb, 14:25
Ted Yu         Re: Is this likely to cause any problems? Thu, 18 Feb, 14:30
Gourav Sengupta           Re: Is this likely to cause any problems? Thu, 18 Feb, 14:41
Gourav Sengupta         Re: Is this likely to cause any problems? Thu, 18 Feb, 14:32
James Hammerton       Re: Is this likely to cause any problems? Thu, 18 Feb, 16:35
James Hammerton     Re: Is this likely to cause any problems? Thu, 18 Feb, 16:39
Daniel Siegmann       Re: Is this likely to cause any problems? Fri, 19 Feb, 14:25
James Hammerton         Re: Is this likely to cause any problems? Fri, 19 Feb, 16:05
Nicholas Chammas           Re: Is this likely to cause any problems? Fri, 19 Feb, 19:03
Sabarish Sasidharan         Re: Is this likely to cause any problems? Sat, 20 Feb, 07:34
Teng Qiu           Is this likely to cause any problems? Sat, 20 Feb, 09:26
Rory Byrne How do I stream in Parquet files using fileStream() and ParquetInputFormat? Thu, 18 Feb, 12:05
Ashish Soni SPARK-9559 Thu, 18 Feb, 15:13
Daniel Darabos   Re: SPARK-9559 Thu, 18 Feb, 15:21
Igor Berman     Re: SPARK-9559 Thu, 18 Feb, 20:03
Mehdi Ben Haj Abbes equalTo isin not working as expected with a constructed column with DataFrames Thu, 18 Feb, 15:20
Mehdi Ben Haj Abbes   Re: equalTo isin not working as expected with a constructed column with DataFrames Thu, 18 Feb, 17:10
Michael Armbrust     Re: equalTo isin not working as expected with a constructed column with DataFrames Fri, 19 Feb, 20:15
alvarobrandon SPARK REST API on YARN Thu, 18 Feb, 15:56
Ricardo Paiva   Re: SPARK REST API on YARN Thu, 18 Feb, 16:46
Richard Cobbe UDAF support for DataFrames in Spark 1.5.0? Thu, 18 Feb, 16:31
Kabeer Ahmed   Re: UDAF support for DataFrames in Spark 1.5.0? Thu, 18 Feb, 23:18
Ted Yu     Re: UDAF support for DataFrames in Spark 1.5.0? Thu, 18 Feb, 23:44
Richard Cobbe     Re: UDAF support for DataFrames in Spark 1.5.0? Fri, 19 Feb, 22:27
Mich Talebzadeh Importing csv files into Hive ORC target table Thu, 18 Feb, 17:35
Alex Dzhagriev   Re: Importing csv files into Hive ORC target table Thu, 18 Feb, 21:00
wgtmac SparkConf does not work for spark.driver.memory Thu, 18 Feb, 18:26
Marcelo Vanzin   Re: SparkConf does not work for spark.driver.memory Thu, 18 Feb, 18:33
Access to broadcasted variable
jeff saremi   Access to broadcasted variable Thu, 18 Feb, 19:44
jeff saremi     RE: Access to broadcasted variable Fri, 19 Feb, 13:54
Shixiong(Ryan) Zhu       Re: Access to broadcasted variable Sat, 20 Feb, 00:48
jeff saremi         RE: Access to broadcasted variable Sat, 20 Feb, 16:15
Ilya Ganelin           Re: Access to broadcasted variable Sat, 20 Feb, 17:23
Bemaze Lazy executors Thu, 18 Feb, 20:57
DaPsul subtractByKey increases RDD size in memory - any ideas? Thu, 18 Feb, 21:37
Andrew Ehrlich   Re: subtractByKey increases RDD size in memory - any ideas? Fri, 19 Feb, 01:32
DaPsul     Re: subtractByKey increases RDD size in memory - any ideas? Fri, 19 Feb, 10:00
Mich Talebzadeh Hive REGEXP_REPLACE use or equivalent in Spark Thu, 18 Feb, 22:09
Andrew Ehrlich   Re: Hive REGEXP_REPLACE use or equivalent in Spark Fri, 19 Feb, 01:22
Mich Talebzadeh     RE: Hive REGEXP_REPLACE use or equivalent in Spark Fri, 19 Feb, 09:06
UMESH CHAUDHARY       Re: Hive REGEXP_REPLACE use or equivalent in Spark Fri, 19 Feb, 10:20
Chandeep Singh       Re: Hive REGEXP_REPLACE use or equivalent in Spark Fri, 19 Feb, 10:34
Mich Talebzadeh         RE: Hive REGEXP_REPLACE use or equivalent in Spark Fri, 19 Feb, 15:50
Sutanu Das Spark History Server NOT showing Jobs with Hortonworks Thu, 18 Feb, 22:22
Mich Talebzadeh   RE: Spark History Server NOT showing Jobs with Hortonworks Thu, 18 Feb, 22:27
Sutanu Das     RE: Spark History Server NOT showing Jobs with Hortonworks Thu, 18 Feb, 22:58
Mich Talebzadeh       RE: Spark History Server NOT showing Jobs with Hortonworks Thu, 18 Feb, 23:09
Divya Gehlot         Re: Spark History Server NOT showing Jobs with Hortonworks Fri, 19 Feb, 02:47
Steve Loughran   Re: Spark History Server NOT showing Jobs with Hortonworks Fri, 19 Feb, 10:42
Shyam Sarkar JDBC based access to RDD Thu, 18 Feb, 22:36
Mich Talebzadeh   RE: JDBC based access to RDD Thu, 18 Feb, 22:43
Shyam Sarkar     Re: JDBC based access to RDD Sat, 20 Feb, 19:51
Shyam Sarkar       Re: JDBC based access to RDD Sat, 20 Feb, 20:10
Koert Kuipers spark 1.6 new memory management - some issues with tasks not using all executors Thu, 18 Feb, 23:51
Koert Kuipers   Re: spark 1.6 new memory management - some issues with tasks not using all executors Fri, 19 Feb, 00:01
Lior Chaga     Re: spark 1.6 new memory management - some issues with tasks not using all executors Sun, 28 Feb, 16:24
Koert Kuipers       Re: spark 1.6 new memory management - some issues with tasks not using all executors Sun, 28 Feb, 21:16
Lior Chaga         Re: spark 1.6 new memory management - some issues with tasks not using all executors Mon, 29 Feb, 13:38
Yin Yang           Re: spark 1.6 new memory management - some issues with tasks not using all executors Mon, 29 Feb, 14:51
Koert Kuipers             Re: spark 1.6 new memory management - some issues with tasks not using all executors Mon, 29 Feb, 17:47
roni cannot coerce class "data.frame" to a DataFrame - with spark R Fri, 19 Feb, 00:54
Felix Cheung   Re: cannot coerce class "data.frame" to a DataFrame - with spark R Fri, 19 Feb, 05:03
roni     Re: cannot coerce class "data.frame" to a DataFrame - with spark R Fri, 19 Feb, 20:25
ramach1776 StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 01:59
Bryan Cutler   Re: StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 18:18
krishna ramachandran     Re: StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 18:40
Bryan Cutler       Re: StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 18:59
krishna ramachandran         Re: StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 20:49
krishna ramachandran           Re: StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 21:15
Bryan Cutler             Re: StreamingKMeans does not update cluster centroid locations Fri, 19 Feb, 23:32
Divya Gehlot Spark JDBC connection - data writing success or failure cases Fri, 19 Feb, 02:35
Mich Talebzadeh   RE: Spark JDBC connection - data writing success or failure cases Fri, 19 Feb, 06:45
Jörn Franke   Re: Spark JDBC connection - data writing success or failure cases Fri, 19 Feb, 08:25
Russell Jurney     Re: Spark JDBC connection - data writing success or failure cases Fri, 19 Feb, 16:48
Mich Talebzadeh       RE: Spark JDBC connection - data writing success or failure cases Fri, 19 Feb, 18:45
Divya Gehlot         RE: Spark JDBC connection - data writing success or failure cases Sun, 21 Feb, 00:08
Mich Talebzadeh           RE: Spark JDBC connection - data writing success or failure cases Sun, 21 Feb, 00:42
Arko Provo Mukherjee Using sbt assembly Fri, 19 Feb, 02:50
Brian London   Re: Using sbt assembly Fri, 19 Feb, 04:30
Arunkumar Pillai Logistic Regression using ML Pipeline Fri, 19 Feb, 05:27
Ajinkya Kale   Re: Logistic Regression using ML Pipeline Fri, 19 Feb, 08:41
Prabhu Joseph Concurreny does not improve for Spark Jobs with Same Spark Context Fri, 19 Feb, 05:51
Jörn Franke   Re: Concurreny does not improve for Spark Jobs with Same Spark Context Fri, 19 Feb, 06:36
Prabhu Joseph     Re: Concurreny does not improve for Spark Jobs with Same Spark Context Fri, 19 Feb, 07:20
Ted Yu   Re: Concurreny does not improve for Spark Jobs with Same Spark Context Fri, 19 Feb, 06:57
How to get the code for class in spark
Ashok Kumar   How to get the code for class in spark Fri, 19 Feb, 09:43
Ted Yu     Re: How to get the code for class in spark Fri, 19 Feb, 11:23
Ashok Kumar       Re: How to get the code for class in spark Fri, 19 Feb, 15:14
Michał Zieliński         Re: How to get the code for class in spark Sat, 20 Feb, 09:01
Divya Gehlot Read files dynamically having different schema under one parent directory + scala + Spakr 1.5,2 Fri, 19 Feb, 10:14
UMESH CHAUDHARY   Re: Read files dynamically having different schema under one parent directory + scala + Spakr 1.5,2 Fri, 19 Feb, 10:54
Divya Gehlot     Re: Read files dynamically having different schema under one parent directory + scala + Spakr 1.5,2 Sat, 20 Feb, 14:37
Chandeep Singh       Re: Read files dynamically having different schema under one parent directory + scala + Spakr 1.5,2 Sat, 20 Feb, 16:01
Domenico Pontari Meetup in Rome Fri, 19 Feb, 10:37
Denny Lee   Re: Meetup in Rome Fri, 19 Feb, 16:54
Re: Accessing Web UI
vasbhat   Re: Accessing Web UI Fri, 19 Feb, 11:18
Gourav Sengupta     Re: Accessing Web UI Fri, 19 Feb, 12:16
Vasanth Bhat       Re: Accessing Web UI Mon, 22 Feb, 06:23
Kayode Odeyemi         Re: Accessing Web UI Mon, 22 Feb, 11:00
Vasanth Bhat           Re: Accessing Web UI Mon, 22 Feb, 12:04
Vasanth Bhat             Re: Accessing Web UI Mon, 22 Feb, 13:39
Vasanth Bhat               Re: Accessing Web UI Tue, 23 Feb, 09:02
Gourav Sengupta                 Re: Accessing Web UI Tue, 23 Feb, 09:27
Vasanth Bhat                   Re: Accessing Web UI Tue, 23 Feb, 10:51
Eduardo Costa Alfaia     Re: Accessing Web UI Fri, 19 Feb, 13:25
AlexModestov an error when I read data from parquet Fri, 19 Feb, 12:59
Jorge Sánchez   Re: an error when I read data from parquet Mon, 22 Feb, 15:26
Udbhav Agarwal Adding vertex to a graph in graphx is taking more time in subsequent addition Fri, 19 Feb, 13:45
Sutanu Das Spark stream job is take up /TMP with 100% Fri, 19 Feb, 15:15
Holden Karau   Re: Spark stream job is take up /TMP with 100% Fri, 19 Feb, 15:36
install databricks csv package for spark
Ashok Kumar   install databricks csv package for spark Fri, 19 Feb, 15:26
Holden Karau     Re: install databricks csv package for spark Fri, 19 Feb, 15:33
Ashok Kumar       Re: install databricks csv package for spark Fri, 19 Feb, 16:15
Ewan Higgs Spark Random Forest Memory issues Fri, 19 Feb, 16:26
Tamara Mendt Spark Job Hanging on Join Fri, 19 Feb, 17:31
Michael Armbrust   Re: Spark Job Hanging on Join Fri, 19 Feb, 20:11
Dave Moyers   Re: Spark Job Hanging on Join Sat, 20 Feb, 23:52
Gourav Sengupta   Re: Spark Job Hanging on Join Sun, 21 Feb, 19:37
Gourav Sengupta     Re: Spark Job Hanging on Join Sun, 21 Feb, 19:39
Mohannad Ali       Re: Spark Job Hanging on Join Mon, 22 Feb, 09:45
Davies Liu         Re: Spark Job Hanging on Join Mon, 22 Feb, 17:10
Dave Moyers           Re: Spark Job Hanging on Join Mon, 22 Feb, 20:23
Mohannad Ali             Re: Spark Job Hanging on Join Tue, 23 Feb, 08:43
Alonso Isidoro Roman               Re: Spark Job Hanging on Join Tue, 23 Feb, 09:01
Dave Moyers               Re: Spark Job Hanging on Join Tue, 23 Feb, 13:56
Ashish Soni Communication between two spark streaming Job Fri, 19 Feb, 19:48
Ted Yu   Re: Communication between two spark streaming Job Sat, 20 Feb, 03:35
Chris Fregly     Re: Communication between two spark streaming Job Sat, 20 Feb, 05:18
Arko Provo Mukherjee Submitting Jobs Programmatically Sat, 20 Feb, 01:56
Holden Karau   Re: Submitting Jobs Programmatically Sat, 20 Feb, 02:01
Arko Provo Mukherjee     Re: Submitting Jobs Programmatically Sat, 20 Feb, 02:27
Ted Yu       Re: Submitting Jobs Programmatically Sat, 20 Feb, 02:35
Arko Provo Mukherjee         Re: Submitting Jobs Programmatically Sat, 20 Feb, 02:40
Ted Yu           Re: Submitting Jobs Programmatically Sat, 20 Feb, 02:49
Arko Provo Mukherjee             Re: Submitting Jobs Programmatically Sat, 20 Feb, 03:27
Patrick Mi               RE: Submitting Jobs Programmatically Mon, 22 Feb, 01:14
Mich Talebzadeh Checking for null values when mapping Sat, 20 Feb, 08:24
Michał Zieliński   Re: Checking for null values when mapping Sat, 20 Feb, 08:59
Mich Talebzadeh     RE: Checking for null values when mapping Sat, 20 Feb, 11:59
Ted Yu       Re: Checking for null values when mapping Sat, 20 Feb, 12:32
Mich Talebzadeh         RE: Checking for null values when mapping Sat, 20 Feb, 21:42
Chandeep Singh   Re: Checking for null values when mapping Sat, 20 Feb, 13:47
Mich Talebzadeh     RE: Checking for null values when mapping Sat, 20 Feb, 14:09
Chandeep Singh       Re: Checking for null values when mapping Sat, 20 Feb, 14:17
Chandeep Singh         Re: Checking for null values when mapping Sat, 20 Feb, 14:27
Mich Talebzadeh           RE: Checking for null values when mapping Sat, 20 Feb, 14:31
Chandeep Singh             Re: Checking for null values when mapping Sat, 20 Feb, 14:32
AlexModestov spark.driver.maxResultSize doesn't work in conf-file Sat, 20 Feb, 14:40
Mohannad Ali   Re: spark.driver.maxResultSize doesn't work in conf-file Mon, 22 Feb, 09:48
Jorge Rodriguez Spark Streaming: Is it possible to schedule multiple active batches? Sat, 20 Feb, 19:24
Neelesh   Re: Spark Streaming: Is it possible to schedule multiple active batches? Sat, 20 Feb, 19:41
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Sep 202181
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137