spark-user mailing list archives: May 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Arunkumar Chandrasekar XML Processing using Spark SQL Thu, 12 May, 20:03
Arunkumar Pillai Running R codes in sparkR Tue, 31 May, 12:46
Ashish Dubey Re: sqlCtx.read.parquet yields lots of small tasks Sat, 07 May, 23:20
Ashish Dubey Re: How to verify if spark is using kryo serializer for shuffle Sat, 07 May, 23:51
Ashish Dubey Re: Parse Json in Spark Mon, 09 May, 00:53
Ashish Dubey Re: BlockManager crashing applications Mon, 09 May, 00:54
Ashish Dubey Re: BlockManager crashing applications Mon, 09 May, 01:40
Ashish Dubey Re: sqlCtx.read.parquet yields lots of small tasks Mon, 09 May, 02:07
Ashish Dubey Re: Joining a RDD to a Dataframe Mon, 09 May, 02:12
Ashish Kumar Singh Spark log collection via Logstash Thu, 19 May, 18:05
Ashish Kumar Singh Logstash to collect Spark logs Fri, 20 May, 21:04
Ashok Kumar Re: Re: How big the spark stream window could be ? Mon, 09 May, 09:06
Ashok Kumar Re: Re: How big the spark stream window could be ? Mon, 09 May, 09:31
Ashok Kumar Re: Re: How big the spark stream window could be ? Mon, 09 May, 11:08
Ashok Kumar Re: My notes on Spark Performance & Tuning Guide Thu, 12 May, 10:11
Ashok Kumar Spark handling spill overs Thu, 12 May, 23:07
Ashok Kumar Monitoring Spark application progress Mon, 16 May, 16:13
Ashok Kumar Re: Using Spark on Hive with Hive also using Spark as its execution engine Mon, 23 May, 20:24
Ashok Kumar Using Java in Spark shell Wed, 25 May, 05:11
Ashok Kumar Does Spark support updates or deletes on underlying Hive tables Mon, 30 May, 18:37
Ashok Kumar processing twitter data Tue, 31 May, 12:04
Augusto Uehara CreateProcess error=5, Access is denied when trying SparkLauncher example in Win10 Fri, 06 May, 17:08
Aulakh, Sahib Re: Can not set spark dynamic resource allocation Fri, 20 May, 19:43
Ayman Khalil Locality aware tree reduction Sat, 07 May, 13:18
Ayman Khalil Evenly balance the number of items in each RDD partition Tue, 10 May, 17:38
Ayman Khalil Re: Evenly balance the number of items in each RDD partition Tue, 10 May, 20:14
Ayman Khalil Re: Evenly balance the number of items in each RDD partition Tue, 10 May, 20:15
Ayman Khalil Re: Evenly balance the number of items in each RDD partition Tue, 10 May, 21:02
Batselem substitute mapPartitions by distinct Wed, 04 May, 08:56
BenD Stackoverflowerror in scala.collection Wed, 04 May, 21:04
Benjamin Kim Re: Save DataFrame to HBase Tue, 10 May, 21:53
Benjamin Kim Re: Structured Streaming in Spark 2.0 and DStreams Sun, 15 May, 20:58
Benjamin Kim Re: Structured Streaming in Spark 2.0 and DStreams Sun, 15 May, 22:04
Benjamin Kim Re: Structured Streaming in Spark 2.0 and DStreams Mon, 16 May, 16:47
Benjamin Kim Spark Streaming S3 Error Sat, 21 May, 03:31
Benjamin Kim Re: Spark Streaming S3 Error Sat, 21 May, 14:17
Benjamin Kim Re: Spark Streaming S3 Error Sat, 21 May, 15:28
Bharathi Raja Spark 1.6.0: substring on df.select Wed, 11 May, 15:07
Bharathi Raja RE: Spark 1.6.0: substring on df.select Thu, 12 May, 10:40
Bibudh Lahiri Alternative to groupByKey() + mapValues() for non-commutative, non-associative aggregate? Tue, 03 May, 21:29
Bibudh Lahiri How long should logistic regression take on this data? Thu, 05 May, 22:37
Bijay Kumar Pathak Performance with Insert overwrite into Hive Table. Wed, 04 May, 17:02
Bijay Kumar Pathak Re: Performance with Insert overwrite into Hive Table. Wed, 04 May, 21:22
Bijay Kumar Pathak SqlContext parquet read OutOfMemoryError: Requested array size exceeds VM limit error Wed, 04 May, 21:44
Bijay Kumar Pathak Re: SqlContext parquet read OutOfMemoryError: Requested array size exceeds VM limit error Wed, 04 May, 22:36
Bijay Kumar Pathak Disable parquet metadata summary in Fri, 06 May, 00:42
Bijay Kumar Pathak Re: Error joining dataframes Tue, 17 May, 20:52
Brandon White Is DataFrame randomSplit Deterministic? Sun, 01 May, 18:37
Brandon White QueryExecution to String breaks with OOM Mon, 02 May, 20:02
Brandon White BlockManager crashing applications Sun, 08 May, 20:01
Brandon White Re: BlockManager crashing applications Mon, 09 May, 01:02
Brindha Sengottaiyan unsubscribe Fri, 06 May, 03:59
Bryan Cutler Re: Multinomial regression with spark.ml version of LogisticRegression Sun, 29 May, 22:40
Bryan Jeffrey Streaming application slows over time Mon, 09 May, 14:32
Buntu Dev SparkSQL with large result size Mon, 02 May, 04:19
Buntu Dev Re: SparkSQL with large result size Mon, 02 May, 16:45
Buntu Dev pyspark dataframe sort issue Sun, 08 May, 06:48
Buntu Dev Re: pyspark dataframe sort issue Sun, 08 May, 07:41
Buntu Dev Re: SparkSQL with large result size Tue, 10 May, 23:32
Cameron Davidson-Pilon question about Union in pyspark and preserving partitioners Tue, 17 May, 05:50
Cassa L Accessing Cassandra data from Spark Shell Tue, 10 May, 04:08
Cassa L Re: Accessing Cassandra data from Spark Shell Wed, 18 May, 05:39
Cassa L Re: Accessing Cassandra data from Spark Shell Thu, 19 May, 05:30
Cesar Flores Re: Weird results with Spark SQL Outer joins Tue, 03 May, 16:50
Cesar Flores DAG Pipelines? Wed, 04 May, 21:25
Cesar Flores Re: My notes on Spark Performance & Tuning Guide Tue, 17 May, 21:58
Chan Yi Sheng(Eason) Re: Content-based Recommendation Engine Thu, 05 May, 19:18
Chandraprakash Bhagtani Spark job is failing with kerberos error while creating hive context in yarn-cluster mode (through spark-submit) Mon, 23 May, 11:41
Chandraprakash Bhagtani Re: Spark job is failing with kerberos error while creating hive context in yarn-cluster mode (through spark-submit) Mon, 23 May, 19:39
Chandraprakash Bhagtani Re: Spark job is failing with kerberos error while creating hive context in yarn-cluster mode (through spark-submit) Tue, 24 May, 05:32
Chaoqiang why spark 1.6 use Netty instead of Akka? Mon, 23 May, 13:19
Chaoqiang why spark 1.6 use Netty instead of Akka? Mon, 23 May, 13:23
Chaoqiang Re: why spark 1.6 use Netty instead of Akka? Tue, 24 May, 03:04
Chaoqiang Re: why spark 1.6 use Netty instead of Akka? Wed, 25 May, 06:32
Cheng Lian Re: feedback on dataset api explode Wed, 25 May, 20:05
Chris Fregly Re: Does Structured Streaming support count(distinct) over all the streaming data? Tue, 17 May, 22:47
Chris Fregly Re: local Vs Standalonecluster production deployment Sat, 28 May, 19:08
Chris Fregly Re: GraphX Java API Mon, 30 May, 23:00
Cody Koeninger Re: kafka direct streaming python API fromOffsets Mon, 02 May, 16:57
Cody Koeninger Re: Improving performance of a kafka spark streaming app Mon, 02 May, 18:09
Cody Koeninger Re: Improving performance of a kafka spark streaming app Tue, 03 May, 04:08
Cody Koeninger Re: Improving performance of a kafka spark streaming app Tue, 03 May, 18:51
Cody Koeninger Re: run-example streaming.KafkaWordCount fails on CDH 5.7.0 Wed, 04 May, 14:28
Cody Koeninger Re: Missing data in Kafka Consumer Thu, 05 May, 16:34
Cody Koeninger Re: Missing data in Kafka Consumer Thu, 05 May, 20:09
Cody Koeninger Re: Error Kafka/Spark. Ran out of messages before reaching ending offset Fri, 06 May, 14:11
Cody Koeninger Re: createDirectStream with offsets Fri, 06 May, 15:32
Cody Koeninger Re: Spark Streaming : is spark.streaming.receiver.maxRate valid for DirectKafkaApproach Tue, 10 May, 14:31
Cody Koeninger Re: Spark Streaming : is spark.streaming.receiver.maxRate valid for DirectKafkaApproach Tue, 10 May, 16:22
Cody Koeninger Re: Kafka partition increased while Spark Streaming is running Fri, 13 May, 14:40
Cody Koeninger Re: KafkaUtils.createDirectStream Not Fetching Messages with Confluent Serializers as Value Decoder. Mon, 16 May, 17:49
Cody Koeninger Re: Does Structured Streaming support Kafka as data source? Thu, 19 May, 15:17
Cody Koeninger Re: Couldn't find leader offsets Thu, 19 May, 15:19
Cody Koeninger Re: Maintain kafka offset externally as Spark streaming processes records. Tue, 24 May, 19:25
Cody Koeninger Re: about an exception when receiving data from kafka topic using Direct mode of Spark Streaming Wed, 25 May, 14:41
Cody Koeninger Re: Spark Streaming - Kafka Direct Approach: re-compute from specific time Wed, 25 May, 14:42
Cody Koeninger Re: Spark Streaming - Kafka - java.nio.BufferUnderflowException Wed, 25 May, 14:46
Cody Koeninger Re: Spark Streaming - Kafka Direct Approach: re-compute from specific time Wed, 25 May, 16:11
Cody Koeninger Re: about an exception when receiving data from kafka topic using Direct mode of Spark Streaming Thu, 26 May, 15:00
Cody Koeninger Re: Kafka connection logs in Spark Thu, 26 May, 15:04
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · Next »Thread · Author · Date
Box list
Nov 201993
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137