spark-user mailing list archives: November 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Sabarish Sasidharan Re: thought experiment: use spark ML to real time prediction Fri, 13 Nov, 09:46
Sabarish Sasidharan Re: large, dense matrix multiplication Fri, 13 Nov, 09:55
Steve Loughran Re: how to run unit test for specific component only Fri, 13 Nov, 10:00
Steve Loughran Re: HiveServer2 Thrift OOM Fri, 13 Nov, 10:03
kundan kumar Kafka Offsets after application is restarted using Spark Streaming Checkpointing Fri, 13 Nov, 10:36
Deenar Toraskar Re: Spark 1.5 UDAF ArrayType Fri, 13 Nov, 10:40
Netai Biswas Spark and Spring Integrations Fri, 13 Nov, 10:47
Balthasar Schopman Spark Executors off-heap memory usage keeps increasing Fri, 13 Nov, 10:49
Veluru, Aruna Traing data sets storage requirement Fri, 13 Nov, 11:15
MEETHU MATHEW How is the predict() working in LogisticRegressionModel? Fri, 13 Nov, 11:55
Parin Choganwala Stack Overflow Question Fri, 13 Nov, 13:26
Gaurav Kumar Save GraphX to disk Fri, 13 Nov, 14:08
Renu Yadav spark 1.4 GC issue Fri, 13 Nov, 14:31
Sabarish Sasidharan Re: Stack Overflow Question Fri, 13 Nov, 14:46
Saiph Kappa Spark Streaming + SparkSQL, time based windowing queries Fri, 13 Nov, 14:59
Gaurav Kumar Re: spark 1.4 GC issue Fri, 13 Nov, 15:06
satish chandra j No suitable drivers found for postgresql Fri, 13 Nov, 15:14
Cody Koeninger Re: Kafka Offsets after application is restarted using Spark Streaming Checkpointing Fri, 13 Nov, 15:18
James Nowell Re: No suitable drivers found for postgresql Fri, 13 Nov, 15:34
Eilidh Troup Re: large, dense matrix multiplication Fri, 13 Nov, 16:25
Eran Medan Joining HDFS and JDBC data sources - benchmarks Fri, 13 Nov, 16:57
Nicolae Marasoiu a way to allow spark job to continue despite task failures? Fri, 13 Nov, 17:05
Krishna Sangeeth KS Re: No suitable drivers found for postgresql Fri, 13 Nov, 17:11
Sujit Pal Please add us to the Powered by Spark page Fri, 13 Nov, 17:21
firemonk9 Re: What is difference btw reduce & fold? Fri, 13 Nov, 17:43
Sabarish Sasidharan Re: large, dense matrix multiplication Fri, 13 Nov, 18:11
Hster Geguri hang correlated to number of shards Re: Checkpointing with Kinesis hangs with socket timeouts when driver is relaunched while transforming on a 0 event batch Fri, 13 Nov, 18:13
James Nowell Re: No suitable drivers found for postgresql Fri, 13 Nov, 18:25
jeff saremi SequenceFile and object reuse Fri, 13 Nov, 18:29
Davies Liu Re: very slow parquet file write Fri, 13 Nov, 18:42
Buttler, David RE: Save GraphX to disk Fri, 13 Nov, 18:45
Sabarish Sasidharan Re: Joining HDFS and JDBC data sources - benchmarks Fri, 13 Nov, 19:13
sara mustafa Columnar Statisics Fri, 13 Nov, 19:57
Alan Dipert SparkException: Could not read until the end sequence number of the range Fri, 13 Nov, 20:37
Alexander Pivovarov Join and HashPartitioner question Fri, 13 Nov, 20:40
Andy Davidson does spark ML have some thing like createDataPartition() in R caret package ? Fri, 13 Nov, 21:21
Wei Chen pyspark sql: number of partitions and partition by size? Fri, 13 Nov, 22:13
Davies Liu Re: very slow parquet file write Fri, 13 Nov, 23:38
Davies Liu Re: Distributing Python code packaged as tar balls Fri, 13 Nov, 23:40
Davies Liu Re: bin/pyspark SparkContext is missing? Fri, 13 Nov, 23:42
Rok Roskar Re: very slow parquet file write Fri, 13 Nov, 23:50
Alan Braithwaite Re: Window's Operations on Spark Partitioned RDD Fri, 13 Nov, 23:57
Ted Yu Re: a way to allow spark job to continue despite task failures? Sat, 14 Nov, 00:50
Walrus theCat send transformed RDD to s3 from slaves Sat, 14 Nov, 00:56
ravi.gawai Spak filestreaming issue Sat, 14 Nov, 01:51
SLiZn Liu Re: Save GraphX to disk Sat, 14 Nov, 02:14
Sonal Goyal Re: does spark ML have some thing like createDataPartition() in R caret package ? Sat, 14 Nov, 03:27
AlexG out of memory error with Parquet Sat, 14 Nov, 03:32
Burak Yavuz Re: large, dense matrix multiplication Sat, 14 Nov, 04:19
Sun, Rui RE: Connecting SparkR through Yarn Sat, 14 Nov, 04:41
AlexG Re: out of memory error with Parquet Sat, 14 Nov, 06:02
Josh Rosen Re: out of memory error with Parquet Sat, 14 Nov, 07:34
rohangpatil Re: Spark ClosureCleaner or java serializer OOM when trying to grow Sat, 14 Nov, 08:24
chao chu Need sth like "def groupByKeyWithRDD(partitioner: Partitioner): RDD[(K, RDD[V])] = ???" Sat, 14 Nov, 09:02
kundan kumar Re: Kafka Offsets after application is restarted using Spark Streaming Checkpointing Sat, 14 Nov, 10:51
Ajay Re: send transformed RDD to s3 from slaves Sat, 14 Nov, 13:48
Sabarish Sasidharan Re: send transformed RDD to s3 from slaves Sat, 14 Nov, 15:47
Sabarish Sasidharan Re: very slow parquet file write Sat, 14 Nov, 15:49
Sabarish Sasidharan Re: Spark and Spring Integrations Sat, 14 Nov, 16:19
Muthu Jayakumar Re: Spark and Spring Integrations Sat, 14 Nov, 17:10
Andrew Ehrlich Re: send transformed RDD to s3 from slaves Sat, 14 Nov, 17:24
pratik khadloya Spark job stuck with 0 input records Sun, 15 Nov, 01:50
Jerry Lam Very slow startup for jobs containing millions of tasks Sun, 15 Nov, 02:35
Ted Yu Re: Very slow startup for jobs containing millions of tasks Sun, 15 Nov, 04:21
Sandip Mehta Calculating Timeseries Aggregation Sun, 15 Nov, 05:32
Renu Yadav Re: spark 1.4 GC issue Sun, 15 Nov, 06:03
Jerry Lam Re: Very slow startup for jobs containing millions of tasks Sun, 15 Nov, 06:04
YaoPau Spark SQL: filter if column substring does not contain a string Sun, 15 Nov, 07:49
Sabarish Sasidharan Re: Spark and Spring Integrations Sun, 15 Nov, 08:41
Ted Yu Re: Very slow startup for jobs containing millions of tasks Sun, 15 Nov, 09:26
Ted Yu Re: Spark SQL: filter if column substring does not contain a string Sun, 15 Nov, 10:08
Ted Yu Re: spark 1.4 GC issue Sun, 15 Nov, 10:17
Renu Yadav Data Locality Issue Sun, 15 Nov, 12:24
Cody Koeninger Re: Kafka Offsets after application is restarted using Spark Streaming Checkpointing Sun, 15 Nov, 15:43
Cody Koeninger Re: Window's Operations on Spark Partitioned RDD Sun, 15 Nov, 15:55
PhuDuc Nguyen Re: spark 1.4 GC issue Sun, 15 Nov, 16:11
SURAJ SHETH Yarn Spark on EMR Sun, 15 Nov, 16:19
kundan kumar Re: Kafka Offsets after application is restarted using Spark Streaming Checkpointing Sun, 15 Nov, 17:04
kundan kumar ReduceByKeyAndWindow does repartitioning twice on recovering from checkpoint Sun, 15 Nov, 17:05
Muthu Jayakumar Re: Spark and Spring Integrations Sun, 15 Nov, 19:14
Jagat Singh Re: Spark and Spring Integrations Sun, 15 Nov, 21:09
Deenar Toraskar spark sql "create temporary function" scala functions Sun, 15 Nov, 23:23
Deng Ching-Mallete Re: Spak filestreaming issue Mon, 16 Nov, 02:23
wangpan how to get the tracking URL with ip address instead of hostname in yarn-cluster model Mon, 16 Nov, 02:53
Jong Wook Kim Spark-shell connecting to Mesos stuck at sched.cpp Mon, 16 Nov, 02:59
Charles Cobb DynamoDB Connector? Mon, 16 Nov, 03:00
Zhang, Jingyu How to passing parameters to another java class Mon, 16 Nov, 04:47
Fengdong Yu Re: How to passing parameters to another java class Mon, 16 Nov, 05:05
Renu Yadav Re: Data Locality Issue Mon, 16 Nov, 05:08
Zhang, Jingyu Re: How to passing parameters to another java class Mon, 16 Nov, 05:10
Fengdong Yu Re: How to passing parameters to another java class Mon, 16 Nov, 05:16
Zhang, Jingyu Re: How to passing parameters to another java class Mon, 16 Nov, 05:22
Fengdong Yu Re: How to passing parameters to another java class Mon, 16 Nov, 05:34
Zhang, Jingyu Re: How to passing parameters to another java class Mon, 16 Nov, 05:47
kiran lonikar Hive on Spark Vs Spark SQL Mon, 16 Nov, 06:37
Reynold Xin Re: Hive on Spark Vs Spark SQL Mon, 16 Nov, 06:37
kiran lonikar Re: Hive on Spark Vs Spark SQL Mon, 16 Nov, 06:45
Reynold Xin Re: Hive on Spark Vs Spark SQL Mon, 16 Nov, 06:50
Yogesh Vyas NoSuchMethodError Mon, 16 Nov, 07:02
Fengdong Yu Re: NoSuchMethodError Mon, 16 Nov, 07:18
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · Next »Thread · Author · Date
Box list
Jun 2021122
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137