spark-user mailing list archives: July 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · Next »Thread · Author · Date
ORC or parquet with Spark
Ashok Kumar   ORC or parquet with Spark Mon, 04 Jul, 06:53
ar7 Limiting Pyspark.daemons Mon, 04 Jul, 07:15
Mathieu Longtin   Re: Limiting Pyspark.daemons Mon, 04 Jul, 14:36
Ashwin Raaghav     Re: Limiting Pyspark.daemons Mon, 04 Jul, 14:44
Mathieu Longtin       Re: Limiting Pyspark.daemons Mon, 04 Jul, 14:52
Ashwin Raaghav         Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:16
Mathieu Longtin           Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:21
Ashwin Raaghav             Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:24
Mathieu Longtin               Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:33
Ashwin Raaghav                 Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:39
Mathieu Longtin                   Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:42
Ashwin Raaghav                     Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:43
Mathieu Longtin                     Re: Limiting Pyspark.daemons Mon, 04 Jul, 15:43
Re: java.io.FileNotFoundException
kishore kumar   Re: java.io.FileNotFoundException Mon, 04 Jul, 08:57
karthi keyan     Re: java.io.FileNotFoundException Mon, 04 Jul, 09:32
Jacek Laskowski     Re: java.io.FileNotFoundException Mon, 04 Jul, 09:50
kishore kumar       Re: java.io.FileNotFoundException Mon, 04 Jul, 10:34
Jacek Laskowski         Re: java.io.FileNotFoundException Mon, 04 Jul, 10:51
kishore kumar           Re: java.io.FileNotFoundException Mon, 04 Jul, 23:15
kishore kumar             Re: java.io.FileNotFoundException Tue, 05 Jul, 00:16
Jacek Laskowski               Re: java.io.FileNotFoundException Tue, 05 Jul, 08:57
nsharkey Specifying Fixed Duration (Spot Block) for AWS Spark EC2 Cluster Mon, 04 Jul, 13:59
Arnaud Bailly How to handle update/deletion in Structured Streaming? Mon, 04 Jul, 15:23
Tathagata Das   Re: How to handle update/deletion in Structured Streaming? Tue, 05 Jul, 04:04
Jakub Stransky Spark application doesn't scale to worker nodes Mon, 04 Jul, 15:31
Mich Talebzadeh   Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 15:44
Mathieu Longtin     Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 15:51
Jakub Stransky       Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 16:10
Jakub Stransky     Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 16:05
Mich Talebzadeh       Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 16:36
Jakub Stransky         Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 18:27
Mich Talebzadeh           Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 18:36
Mathieu Longtin           Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 18:36
Jacek Laskowski             Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 19:35
Mich Talebzadeh               Re: Spark application doesn't scale to worker nodes Mon, 04 Jul, 19:43
Jakub Stransky                 Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 15:19
Mathieu Longtin                   Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 15:29
Mich Talebzadeh                 Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 15:22
Jakub Stransky                   Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 15:39
Mich Talebzadeh                     Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 17:33
Michael Segel                   Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 18:24
Mich Talebzadeh                     Re: Spark application doesn't scale to worker nodes Tue, 05 Jul, 18:40
Sebastian Kuepers pyspark aggregate vectors from onehotencoder Mon, 04 Jul, 19:40
Jean Georges Perrin log traces Mon, 04 Jul, 20:56
Mich Talebzadeh   Re: log traces Mon, 04 Jul, 21:12
Jean Georges Perrin     Re: log traces Mon, 04 Jul, 21:18
Anupam Bhatnagar       Re: log traces Mon, 04 Jul, 21:28
Jean Georges Perrin         Re: log traces Mon, 04 Jul, 21:57
Jean Georges Perrin           Re: log traces Mon, 04 Jul, 22:36
mshiryae Spark MLlib: MultilayerPerceptronClassifier error? Mon, 04 Jul, 21:09
Yanbo Liang   Re: Spark MLlib: MultilayerPerceptronClassifier error? Tue, 05 Jul, 04:57
Ulanov, Alexander     RE: Spark MLlib: MultilayerPerceptronClassifier error? Tue, 05 Jul, 18:32
Shiryaev, Mikhail       RE: Spark MLlib: MultilayerPerceptronClassifier error? Tue, 05 Jul, 23:05
svjk24 Pregel algorithm edge direction docs Tue, 05 Jul, 02:32
Scott W Spark Dataframe validating column names Tue, 05 Jul, 05:02
Jacek Laskowski   Re: Spark Dataframe validating column names Tue, 05 Jul, 12:56
Scott W     Re: Spark Dataframe validating column names Tue, 05 Jul, 16:03
Yu Wei Is that possible to launch spark streaming application on yarn with only one machine? Tue, 05 Jul, 06:31
Deng Ching-Mallete   Re: Is that possible to launch spark streaming application on yarn with only one machine? Tue, 05 Jul, 08:03
Yu Wei     Re: Is that possible to launch spark streaming application on yarn with only one machine? Tue, 05 Jul, 08:41
Yu Wei       Re: Is that possible to launch spark streaming application on yarn with only one machine? Wed, 06 Jul, 11:31
Mich Talebzadeh         Re: Is that possible to launch spark streaming application on yarn with only one machine? Wed, 06 Jul, 13:46
Yu Wei           Re: Is that possible to launch spark streaming application on yarn with only one machine? Thu, 07 Jul, 02:26
Rabin Banerjee             Re: Is that possible to launch spark streaming application on yarn with only one machine? Thu, 07 Jul, 05:04
Yu Wei               Re: Is that possible to launch spark streaming application on yarn with only one machine? Thu, 07 Jul, 07:16
Rabin Banerjee                 Re: Is that possible to launch spark streaming application on yarn with only one machine? Thu, 07 Jul, 11:04
Yu Wei                   Re: Is that possible to launch spark streaming application on yarn with only one machine? Fri, 08 Jul, 09:40
Rabin Banerjee                     Re: Is that possible to launch spark streaming application on yarn with only one machine? Fri, 08 Jul, 20:22
Yu Wei                     Re: Is that possible to launch spark streaming application on yarn with only one machine? Sat, 09 Jul, 07:04
Yu Wei                     Re: Is that possible to launch spark streaming application on yarn with only one machine? Tue, 19 Jul, 15:54
lokeshyadav How to Create a Database in Spark SQL Tue, 05 Jul, 06:57
Mich Talebzadeh   Re: How to Create a Database in Spark SQL Tue, 05 Jul, 07:38
Akmal Abbasov How Spark HA works Tue, 05 Jul, 08:34
immerrr again pyspark: dataframe.take is slow Tue, 05 Jul, 09:27
tan shai Dataframe sort Tue, 05 Jul, 10:57
Biplob Biswas StreamingKmeans Spark doesn't work at all Tue, 05 Jul, 11:00
Biplob Biswas   Re: StreamingKmeans Spark doesn't work at all Thu, 07 Jul, 15:21
Biplob Biswas     Re: StreamingKmeans Spark doesn't work at all Sun, 10 Jul, 18:37
Shuai Lin       Re: StreamingKmeans Spark doesn't work at all Mon, 11 Jul, 03:52
Biplob Biswas         Re: StreamingKmeans Spark doesn't work at all Mon, 11 Jul, 07:48
mshiryae Spark MLlib: network intensive algorithms Tue, 05 Jul, 11:07
Bruckwald Tamás Read Kafka topic in a Spark batch job Tue, 05 Jul, 12:15
nihed mbarek   Re: Read Kafka topic in a Spark batch job Tue, 05 Jul, 12:25
Bruckwald Tamás     Re: Read Kafka topic in a Spark batch job Tue, 05 Jul, 12:40
Cody Koeninger       Re: Read Kafka topic in a Spark batch job Tue, 05 Jul, 14:46
Nkechi Achara Having issues of passing properties to Spark in 1.5 in comparison to 1.2 Tue, 05 Jul, 13:40
Jakub Stransky Standalone mode resource allocation questions Tue, 05 Jul, 14:18
Jacek Laskowski   Re: Standalone mode resource allocation questions Tue, 05 Jul, 14:41
rss rss Spark streaming. Strict discretizing by time Tue, 05 Jul, 15:02
Cody Koeninger   Re: Spark streaming. Strict discretizing by time Tue, 05 Jul, 15:12
rss rss     Re: Spark streaming. Strict discretizing by time Tue, 05 Jul, 15:41
Cody Koeninger       Re: Spark streaming. Strict discretizing by time Tue, 05 Jul, 15:51
rss rss         Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 13:45
Cody Koeninger           Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 14:40
rss rss             Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 15:25
Cody Koeninger               Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 15:41
rss rss                 Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 16:06
Cody Koeninger                   Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 16:11
rss rss                     Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 16:38
Cody Koeninger                       Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 16:55
rss rss                         Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 17:23
Cody Koeninger                           Re: Spark streaming. Strict discretizing by time Wed, 06 Jul, 18:12
rss rss                             Re: Spark streaming. Strict discretizing by time Thu, 07 Jul, 10:12
pseudo oduesp remove row from data frame Tue, 05 Jul, 15:38
nihed mbarek   Re: remove row from data frame Tue, 05 Jul, 15:41
Benjamin Kim SnappyData and Structured Streaming Tue, 05 Jul, 19:19
Jags Ramnarayan   Re: SnappyData and Structured Streaming Wed, 06 Jul, 14:03
Benjamin Kim     Re: SnappyData and Structured Streaming Wed, 06 Jul, 14:32
Jags Ramnarayan       Re: SnappyData and Structured Streaming Wed, 06 Jul, 15:52
Benjamin Kim         Re: SnappyData and Structured Streaming Wed, 06 Jul, 16:05
Kali.tumm...@gmail.com spark local dir to HDFS ? Tue, 05 Jul, 22:47
Jeff Zhang   Re: spark local dir to HDFS ? Wed, 06 Jul, 00:22
Sri     Re: spark local dir to HDFS ? Wed, 06 Jul, 01:05
Saisai Shao       Re: spark local dir to HDFS ? Wed, 06 Jul, 01:15
sri hari kali charan Tummala         Re: spark local dir to HDFS ? Wed, 06 Jul, 01:26
另一片天 where is open source Distributed service framework use for spark?? Wed, 06 Jul, 06:24
Re: Spark Task failure with File segment length as negative
Priya Ch   Re: Spark Task failure with File segment length as negative Wed, 06 Jul, 08:01
Igor Berman streaming new data into bigger parquet file Wed, 06 Jul, 09:27
luohui20...@sina.com how to select first 50 value of each group after group by? Wed, 06 Jul, 11:07
Tal Grynbaum   Re: how to select first 50 value of each group after group by? Wed, 06 Jul, 14:55
Anton Okolnychyi     Re: how to select first 50 value of each group after group by? Wed, 06 Jul, 15:22
Yu Wei It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 11:35
Rabin Banerjee   Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 12:07
Sean Owen     Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 12:16
Rabin Banerjee       Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 12:19
Sean Owen         Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 12:20
Yu Wei           Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 13:17
Saisai Shao             Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 13:24
Yu Wei             Re: It seemed JavaDStream.print() did not work when launching via yarn on a single node Wed, 06 Jul, 13:58
Spark Left outer Join issue using programmatic sql joins
Radha krishna   Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 12:29
radha   Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 12:33
ayan guha     Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 13:00
Rabin Banerjee       Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 15:31
Mich Talebzadeh       Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 16:28
Mich Talebzadeh         Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 16:31
Radha krishna           Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 16:44
radha     Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 16:48
Mich Talebzadeh       Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 17:01
Radha krishna         Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 17:18
Mich Talebzadeh           Re: Spark Left outer Join issue using programmatic sql joins Wed, 06 Jul, 17:42
matd spark 2.0 bloom filters Wed, 06 Jul, 13:23
AC24 SparkR | Exception in invokeJava: SparkR + Windows standalone cluster Wed, 06 Jul, 14:08
Dragisa Krsmanovic Difference between DataFrame.write.jdbc and DataFrame.write.format("jdbc") Wed, 06 Jul, 17:05
Xiao Li   Re: Difference between DataFrame.write.jdbc and DataFrame.write.format("jdbc") Wed, 06 Jul, 17:21
Dragisa Krsmanovic     Re: Difference between DataFrame.write.jdbc and DataFrame.write.format("jdbc") Wed, 06 Jul, 17:37
Rabin Banerjee   Re: Difference between DataFrame.write.jdbc and DataFrame.write.format("jdbc") Wed, 06 Jul, 17:41
Xiao Li     Re: Difference between DataFrame.write.jdbc and DataFrame.write.format("jdbc") Wed, 06 Jul, 21:31
Sunita Arvind Maintain complete state for updateStateByKey Wed, 06 Jul, 17:40
Chen Song spark classloader question Wed, 06 Jul, 18:28
Chen Song   Re: spark classloader question Thu, 07 Jul, 16:05
Marco Mistroni     Re: spark classloader question Thu, 07 Jul, 16:18
Chen Song       Re: spark classloader question Thu, 07 Jul, 18:50
Prajwal Tuladhar     Re: spark classloader question Thu, 07 Jul, 16:20
Chen Song       Re: spark classloader question Thu, 07 Jul, 18:50
dabuki Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:25
Jean Georges Perrin   Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:29
Andreas Bauer     Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:39
Mich Talebzadeh       Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:46
Andreas Bauer         Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:54
Mich Talebzadeh           Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:59
Andreas Bauer             Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 20:21
Jean Georges Perrin       Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 19:56
Michael Segel   Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 20:12
Andreas Bauer     Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 20:24
Mich Talebzadeh       Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 20:29
Michael Segel       Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 20:52
Andreas Bauer         Re: Is Spark suited for replacing a batch job using many database tables? Wed, 06 Jul, 21:29
Mich Talebzadeh Presentation in London: Running Spark on Hive or Hive on Spark Wed, 06 Jul, 21:37
Ashok Kumar   Re: Presentation in London: Running Spark on Hive or Hive on Spark Thu, 07 Jul, 19:14
mylistt...@gmail.com   Re: Presentation in London: Running Spark on Hive or Hive on Spark Sat, 09 Jul, 02:44
Marco Mistroni   Re: Presentation in London: Running Spark on Hive or Hive on Spark Fri, 15 Jul, 10:04
Joaquin Alzola     RE: Presentation in London: Running Spark on Hive or Hive on Spark Fri, 15 Jul, 10:06
Mich Talebzadeh       Re: Presentation in London: Running Spark on Hive or Hive on Spark Tue, 19 Jul, 18:12
Ashok Kumar         Re: Presentation in London: Running Spark on Hive or Hive on Spark Tue, 19 Jul, 19:10
Egor Pahomov Logs of spark driver in yarn-client mode. Thu, 07 Jul, 00:25
craigjar Structured Streaming Comparison to AMPS Thu, 07 Jul, 03:19
Tathagata Das   Re: Structured Streaming Comparison to AMPS Thu, 07 Jul, 07:17
Arnaud Bailly     Re: Structured Streaming Comparison to AMPS Thu, 07 Jul, 07:35
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · Next »Thread · Author · Date
Box list
Oct 2020176
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137