spark-user mailing list archives: October 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Michael Armbrust Re: thriftserver: access temp dataframe from in-memory of spark-shell Wed, 14 Oct, 17:17
Michael Armbrust Re: Reusing Spark Functions Wed, 14 Oct, 17:24
Michael Armbrust Re: Question about data frame partitioning in Spark 1.3.0 Wed, 14 Oct, 18:59
Michael Armbrust Re: PySpark - Hive Context Does Not Return Results but SQL Context Does for Similar Query. Wed, 14 Oct, 21:23
Michael Armbrust Re: PySpark - Hive Context Does Not Return Results but SQL Context Does for Similar Query. Wed, 14 Oct, 21:30
Michael Armbrust Re: Spark SQL running totals Thu, 15 Oct, 18:51
Michael Armbrust Re: Dynamic partition pruning Fri, 16 Oct, 18:18
Michael Armbrust Re: flattening a JSON data structure Mon, 19 Oct, 20:55
Michael Armbrust Re: Concurrency/Multiple Users Mon, 19 Oct, 21:39
Michael Armbrust Re: Spark SQL: Preserving Dataframe Schema Tue, 20 Oct, 17:20
Michael Armbrust Re: Hive custom transform scripts in Spark? Tue, 20 Oct, 17:20
Michael Armbrust Re: [spark1.5.1] HiveQl.parse throws org.apache.spark.sql.AnalysisException: null Tue, 20 Oct, 17:23
Michael Armbrust Re: Hive custom transform scripts in Spark? Tue, 20 Oct, 17:48
Michael Armbrust Re: hive thriftserver and fair scheduling Tue, 20 Oct, 19:34
Michael Armbrust Re: Spark SQL: Preserving Dataframe Schema Tue, 20 Oct, 19:38
Michael Armbrust Re: How to distinguish columns when joining DataFrames with shared parent? Wed, 21 Oct, 18:46
Michael Armbrust Re: How to distinguish columns when joining DataFrames with shared parent? Wed, 21 Oct, 20:54
Michael Armbrust Re: How to implement zipWithIndex as a UDF? Fri, 23 Oct, 19:44
Michael Armbrust Re: Spark SQL Persistent Table - joda DateTime Compatability Tue, 27 Oct, 15:37
Michael Armbrust Re: Hive Version Wed, 28 Oct, 13:34
Michael Armbrust Re: SparkSQL: What is the cost of DataFrame.registerTempTable(String)? Can I have multiple tables referencing to the same DataFrame? Thu, 29 Oct, 14:49
Michael Armbrust Re: Inconsistent Persistence of DataFrames in Spark 1.5 Thu, 29 Oct, 14:58
Michael Armbrust Re: Collect Column as Array in Grouped DataFrame Thu, 29 Oct, 14:59
Michael Armbrust Re: SPARK SQL- Parquet projection pushdown for nested data Thu, 29 Oct, 17:29
Michael Armbrust Re: Issue of Hive parquet partitioned table schema mismatch Fri, 30 Oct, 11:23
Michael Armbrust Re: key not found: sportingpulse.com in Spark SQL 1.5.0 Sat, 31 Oct, 11:33
Michael Armbrust Re: Pulling data from a secured SQL database Sat, 31 Oct, 11:35
Michael Lewis Spark issue running jar on Linux vs Windows Thu, 22 Oct, 23:39
Michael Lewis Re: Spark issue running jar on Linux vs Windows Fri, 23 Oct, 12:54
Mina Berkeley DB storage for Spark Wed, 28 Oct, 00:06
Mingyu Kim Re: compatibility issue with Jersey2 Tue, 13 Oct, 07:56
Mohammed Guller RE: laziness in textFile reading from HDFS? Tue, 06 Oct, 01:25
Mohammed Guller RE: laziness in textFile reading from HDFS? Tue, 06 Oct, 22:44
Mohammed Guller RE: laziness in textFile reading from HDFS? Tue, 06 Oct, 23:42
Mohammed Guller RE: dataframes and numPartitions Thu, 15 Oct, 23:52
Mohammed Guller RE: Spark 1.5.1 ClassNotFoundException in cluster mode. Fri, 16 Oct, 00:57
Mohammed Guller RE: Spark SQL Thriftserver and Hive UDF in Production Mon, 19 Oct, 03:42
Muhammad Ahsan ERROR: "Size exceeds Integer.MAX_VALUE" Spark 1.5 Mon, 05 Oct, 22:12
Muhammad Ahsan Turn off logs in spark-sql shell Fri, 16 Oct, 05:56
Muhammad Haseeb Javed What is the abstraction for a Worker process in Spark code Mon, 12 Oct, 12:12
Mustafa Elbehery Indexing Support Sun, 18 Oct, 21:16
Natu Lauchande Re: Cache in Spark Fri, 09 Oct, 08:56
Natu Lauchande Re: How to lookup by a key in an RDD Sat, 31 Oct, 16:36
Ndjido Ardo Bar Re: can I use Spark as alternative for gem fire cache ? Sat, 17 Oct, 18:05
Nethaji Chandrasiri Define new stage in pipeline Mon, 12 Oct, 08:21
Nethaji Chandrasiri How to add transformations as pipeline Stages ? Tue, 13 Oct, 05:50
Nicholas Chammas Re: stability of Spark 1.4.1 with Python 3 versions Wed, 14 Oct, 18:07
Nicholas Chammas Can we add an unsubscribe link in the footer of every email? Wed, 21 Oct, 14:38
Nicholas Chammas Re: Sorry, but Nabble and ML suck Sat, 31 Oct, 16:34
Nicholas Pritchard Re: Spark UI consuming lots of memory Tue, 13 Oct, 03:42
Nicholas Pritchard Re: Spark UI consuming lots of memory Tue, 13 Oct, 03:44
Nicholas Pritchard Re: Spark UI consuming lots of memory Thu, 15 Oct, 17:40
Nick Pentreath Re: Spark job workflow engine recommendations Wed, 07 Oct, 17:25
Nick Pentreath Re: Machine learning with spark (book code example error) Wed, 14 Oct, 07:46
Nick Pentreath Re: How to specify the numFeatures in HashingTF Thu, 15 Oct, 16:17
Nick Peterson Re: Broadcast var is null Tue, 06 Oct, 14:15
Nicolae Marasoiu Re: Problem understanding spark word count execution Thu, 01 Oct, 04:57
Nicolae Marasoiu Re: Problem understanding spark word count execution Thu, 01 Oct, 19:38
Nicolae Marasoiu Re: Kafka Direct Stream Thu, 01 Oct, 19:43
Nicolae Marasoiu Re: spark.streaming.kafka.maxRatePerPartition for direct stream Fri, 02 Oct, 06:01
Nicolae Marasoiu Re: How to save DataFrame as a Table in Hbase? Fri, 02 Oct, 06:18
Nikhil Gs Kafka and Spark combination Fri, 09 Oct, 13:17
Nikhil Gs Re: Kafka streaming "at least once" semantics Fri, 09 Oct, 13:20
Nipun Arora [Spark Streaming] Design Patterns forEachRDD Wed, 21 Oct, 17:55
Nipun Arora [SPARK STREAMING] polling based operation instead of event based operation Thu, 22 Oct, 20:48
Nipun Arora Re: [Spark Streaming] Design Patterns forEachRDD Thu, 22 Oct, 20:49
Nipun Arora Re: [SPARK STREAMING] polling based operation instead of event based operation Fri, 23 Oct, 14:30
Nipun Arora [SPARK STREAMING] Concurrent operations in spark streaming Sat, 24 Oct, 21:08
Nipun Arora Re: [SPARK STREAMING] Concurrent operations in spark streaming Sun, 25 Oct, 14:09
Nipun Arora [SPARK STREAMING ] Sending data to ElasticSearch Thu, 29 Oct, 14:49
Nuno Carvalho Re: flattening a JSON data structure Tue, 20 Oct, 10:16
Nuthan Kumar RE: Best practices to call small spark jobs as part of REST api Mon, 12 Oct, 04:00
Oded Maimon Spark Streaming - use the data in different jobs Sun, 18 Oct, 11:49
Olivier Girardot Re: Lookup / Access of master data in spark streaming Mon, 05 Oct, 20:40
Olivier Girardot Re: Lookup / Access of master data in spark streaming Tue, 06 Oct, 06:19
Ophir Cohen GenericMutableRow and Row mismatch on Spark 1.5? Tue, 06 Oct, 09:51
Ophir Cohen Re: GenericMutableRow and Row mismatch on Spark 1.5? Wed, 07 Oct, 10:00
Ophir Cohen Re: GenericMutableRow and Row mismatch on Spark 1.5? Wed, 07 Oct, 11:07
Pala M Muthaia Re: Hive permanent functions are not available in Spark SQL Thu, 01 Oct, 21:04
Panos Str Stack overflow error caused by long lineage RDD created after many recursions Fri, 30 Oct, 22:10
PashMic "java.io.IOException: Connection reset by peer" thrown on the resource manager when launching Spark on Yarn Thu, 22 Oct, 17:21
Patcharee Thongtra Re: sql query orc slow Tue, 13 Oct, 08:01
Patcharee Thongtra Re: sql query orc slow Tue, 13 Oct, 17:46
Patrick McGloin Re: Spark UI consuming lots of memory Tue, 27 Oct, 12:56
Pavol Loffay Java REST custom receiver Thu, 01 Oct, 19:58
Pete Zybrick unsubscribe Tue, 20 Oct, 21:42
Peyman Mohajerian Re: Aster Functions equivalent in spark : cfilter, npath and sessionize Thu, 29 Oct, 19:20
Phil Kallos Spark 1.5 Streaming and Kinesis Thu, 15 Oct, 05:49
Phil Kallos Re: Spark 1.5 Streaming and Kinesis Thu, 15 Oct, 06:36
Phil Kallos Re: Spark 1.5 Streaming and Kinesis Fri, 16 Oct, 05:21
Phil Kallos Re: Spark 1.5 Streaming and Kinesis Mon, 19 Oct, 21:07
Philip Weaver Re: Limiting number of cores per job in multi-threaded driver. Sat, 03 Oct, 04:02
Philip Weaver Re: Limiting number of cores per job in multi-threaded driver. Sun, 04 Oct, 17:43
Philip Weaver Re: Limiting number of cores per job in multi-threaded driver. Sun, 04 Oct, 21:33
Philip Weaver Re: Limiting number of cores per job in multi-threaded driver. Sun, 04 Oct, 21:48
Philip Weaver Location preferences in pyspark? Sat, 17 Oct, 00:42
Philip Weaver Re: Location preferences in pyspark? Wed, 21 Oct, 03:11
Prateek . DStream Transformation to save JSON in Cassandra 2.1 Mon, 05 Oct, 14:14
Prateek . RE: DStream Transformation to save JSON in Cassandra 2.1 Tue, 06 Oct, 10:38
Prateek . Streaming Application Unable to get Stream from Kafka Fri, 09 Oct, 13:25
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Box list
Feb 202043
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137