spark-user mailing list archives: January 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16Thread · Author · Date
Manoj Samel schemaRDD.saveAsParquetFile creates large number of small parquet files ... Thu, 29 Jan, 17:27
Michael Armbrust   Re: schemaRDD.saveAsParquetFile creates large number of small parquet files ... Thu, 29 Jan, 18:52
Felix C   RE: schemaRDD.saveAsParquetFile creates large number of small parquet files ... Fri, 30 Jan, 07:02
prateek arora spark connector for CouchDB Thu, 29 Jan, 17:34
Re: connector for CouchDB
prateek arora   Re: connector for CouchDB Thu, 29 Jan, 17:46
Harihar Nahak     Re: connector for CouchDB Thu, 29 Jan, 23:30
prateek arora       Re: connector for CouchDB Fri, 30 Jan, 00:00
prateek arora       Re: connector for CouchDB Fri, 30 Jan, 00:10
derrickburns spark challenge: zip with next??? Thu, 29 Jan, 19:49
Ganelin, Ilya   RE: spark challenge: zip with next??? Thu, 29 Jan, 21:32
Mohammed Guller     RE: spark challenge: zip with next??? Thu, 29 Jan, 21:47
Tobias Pfeiffer     Re: spark challenge: zip with next??? Fri, 30 Jan, 00:36
Mohit Jaggi       Re: spark challenge: zip with next??? Fri, 30 Jan, 05:27
Koert Kuipers         Re: spark challenge: zip with next??? Fri, 30 Jan, 14:11
Michael Malak           Re: spark challenge: zip with next??? Fri, 30 Jan, 16:05
Koert Kuipers             Re: spark challenge: zip with next??? Fri, 30 Jan, 17:03
Koert Kuipers             Re: spark challenge: zip with next??? Fri, 30 Jan, 17:19
Derrick Burns               Re: spark challenge: zip with next??? Fri, 30 Jan, 20:47
oxpeople Connecting Cassandra by unknow host Thu, 29 Jan, 21:33
Ankur Srivastava   Re: Connecting Cassandra by unknow host Fri, 30 Jan, 01:01
nate.y Driver startup error when submitting in cluster mode Thu, 29 Jan, 21:52
Ankur Srivastava Error when running spark in debug mode Thu, 29 Jan, 22:54
Arush Kharbanda   Re: Error when running spark in debug mode Fri, 30 Jan, 13:10
Ankur Srivastava     Re: Error when running spark in debug mode Fri, 30 Jan, 16:19
Arush Kharbanda       Re: Error when running spark in debug mode Sat, 31 Jan, 08:05
Arush Kharbanda         Re: Error when running spark in debug mode Sat, 31 Jan, 08:36
Mohit Jaggi spark with cdh 5.2.1 Thu, 29 Jan, 23:33
Nobuhiro Sue   Re: spark with cdh 5.2.1 Fri, 30 Jan, 01:41
Mohit Jaggi     Re: spark with cdh 5.2.1 Fri, 30 Jan, 05:30
Sean Owen   Re: spark with cdh 5.2.1 Fri, 30 Jan, 08:11
Re: We are migrating Tera Data SQL to Spark SQL. Query is taking long time. Please have a look on this issue
hnahak   Re: We are migrating Tera Data SQL to Spark SQL. Query is taking long time. Please have a look on this issue Thu, 29 Jan, 23:34
freedafeng What could cause number of tasks to go down from 2k to 1? Fri, 30 Jan, 00:25
QiuxuanZhu Error when get data from hive table. Use python code. Fri, 30 Jan, 02:36
Cheng Lian   Re: Error when get data from hive table. Use python code. Fri, 30 Jan, 02:58
Davies Liu   Re: Error when get data from hive table. Use python code. Fri, 30 Jan, 04:10
Zhan Zhang   Re: Error when get data from hive table. Use python code. Fri, 30 Jan, 04:16
mvsundaresan KMeans with large clusters Java Heap Space Fri, 30 Jan, 03:57
derrickburns   Re: KMeans with large clusters Java Heap Space Fri, 30 Jan, 10:11
YaoPau Read from file and broadcast before every Spark Streaming bucket? Fri, 30 Jan, 04:05
Sean Owen   Re: Read from file and broadcast before every Spark Streaming bucket? Fri, 30 Jan, 09:22
matroyd HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0 Fri, 30 Jan, 05:38
Zhan Zhang   Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0 Fri, 30 Jan, 07:40
Ayoub   Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0 Fri, 30 Jan, 16:19
Cheng Lian     Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0 Sat, 31 Jan, 03:19
Siddharth Ubale Hi: hadoop 2.5 for spark Fri, 30 Jan, 07:50
bit1...@163.com   Re: Hi: hadoop 2.5 for spark Fri, 30 Jan, 07:58
fightf...@163.com   Re: Hi: hadoop 2.5 for spark Fri, 30 Jan, 07:59
Ayoub Fwd: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0 Fri, 30 Jan, 07:53
mtheofilos HBase Thrift API Error on map/reduce functions Fri, 30 Jan, 11:40
kundan kumar WARN NativeCodeLoader warning in spark shell Fri, 30 Jan, 13:04
Sean Owen   Re: WARN NativeCodeLoader warning in spark shell Fri, 30 Jan, 13:08
Yifan LI [Graphx & Spark] Error of "Lost executor" and TimeoutException Fri, 30 Jan, 14:20
Yifan LI   [Graphx & Spark] Error of "Lost executor" and TimeoutException Fri, 30 Jan, 14:22
Sonal Goyal     Re: [Graphx & Spark] Error of "Lost executor" and TimeoutException Fri, 30 Jan, 21:25
Yifan LI       Re: [Graphx & Spark] Error of "Lost executor" and TimeoutException Fri, 30 Jan, 22:51
Aniket Bhatnagar Programmatic Spark 1.2.0 on EMR | S3 filesystem is not working when using Fri, 30 Jan, 14:44
Sven Krasser   Re: Programmatic Spark 1.2.0 on EMR | S3 filesystem is not working when using Fri, 30 Jan, 17:55
Aniket Bhatnagar     Re: Programmatic Spark 1.2.0 on EMR | S3 filesystem is not working when using Fri, 30 Jan, 17:59
Guillermo Ortiz Define size partitions Fri, 30 Jan, 14:50
Sven Krasser   Re: Define size partitions Fri, 30 Jan, 17:47
Rishi Yadav     Re: Define size partitions Fri, 30 Jan, 18:37
Davies Liu   Re: Define size partitions Fri, 30 Jan, 19:22
Peter Thai Negative Accumulators Fri, 30 Jan, 16:06
francois.garil...@typesafe.com   Re: Negative Accumulators Fri, 30 Jan, 16:15
Jianguo Li Does the kFold in Spark always give you the same split? Fri, 30 Jan, 16:12
Sean Owen   Re: Does the kFold in Spark always give you the same split? Fri, 30 Jan, 17:22
Jianguo Li     Re: Does the kFold in Spark always give you the same split? Fri, 30 Jan, 19:27
Sean Owen       Re: Does the kFold in Spark always give you the same split? Fri, 30 Jan, 19:55
Capitão Spark SQL - Unable to use Hive UDF because of ClassNotFoundException Fri, 30 Jan, 17:17
Marcelo Vanzin   Re: Spark SQL - Unable to use Hive UDF because of ClassNotFoundException Sat, 31 Jan, 00:12
ganterm Spark streaming - tracking/deleting processed files Fri, 30 Jan, 18:07
Akhil Das   Re: Spark streaming - tracking/deleting processed files Sat, 31 Jan, 08:21
Arush Kharbanda   Re: Spark streaming - tracking/deleting processed files Sat, 31 Jan, 08:33
Ayoub [hive context] Unable to query array once saved as parquet Fri, 30 Jan, 18:33
Michael Armbrust   Re: [hive context] Unable to query array once saved as parquet Fri, 30 Jan, 19:28
Cheng Lian     Re: [hive context] Unable to query array once saved as parquet Sat, 31 Jan, 03:05
Cheng Lian     Re: [hive context] Unable to query array once saved as parquet Sat, 31 Jan, 03:05
Ayoub   Re: [hive context] Unable to query array once saved as parquet Fri, 30 Jan, 19:33
Ayoub   Re: [hive context] Unable to query array once saved as parquet Sat, 31 Jan, 21:30
Eduardo Costa Alfaia KafkaWordCount Fri, 30 Jan, 18:58
andrew.rowson Duplicate key when sorting BytesWritable with Kryo? Fri, 30 Jan, 19:20
Sandy Ryza   Re: Duplicate key when sorting BytesWritable with Kryo? Fri, 30 Jan, 19:27
Aaron Davidson     Re: Duplicate key when sorting BytesWritable with Kryo? Fri, 30 Jan, 19:59
Sandy Ryza       Re: Duplicate key when sorting BytesWritable with Kryo? Fri, 30 Jan, 20:38
Antony Mayi pyspark and and page allocation failures due to memory fragmentation Fri, 30 Jan, 19:46
Amit Behera groupByKey is not working Fri, 30 Jan, 20:20
Arush Kharbanda   Re: groupByKey is not working Fri, 30 Jan, 20:34
Charles Feduke   Re: groupByKey is not working Fri, 30 Jan, 20:39
Amit Behera     Re: groupByKey is not working Fri, 30 Jan, 20:47
Amit Behera   Re: groupByKey is not working Fri, 30 Jan, 20:44
Stephen Boesch     Re: groupByKey is not working Fri, 30 Jan, 20:47
Charles Feduke       Re: groupByKey is not working Fri, 30 Jan, 20:50
Amit Behera         Re: groupByKey is not working Fri, 30 Jan, 20:55
ankits Serialized task result size exceeded Fri, 30 Jan, 20:46
Charles Feduke   Re: Serialized task result size exceeded Fri, 30 Jan, 20:56
Trouble deploying spark program because of soft link?
Su She   Trouble deploying spark program because of soft link? Fri, 30 Jan, 22:11
suhshekar52   Trouble deploying spark program because of soft link? Fri, 30 Jan, 22:32
suhshekar52     Re: Trouble deploying spark program because of soft link? Fri, 30 Jan, 22:51
Manoj Samel Why is DecimalType separate from DataType ? Fri, 30 Jan, 22:23
Michael Armbrust   Re: Why is DecimalType separate from DataType ? Fri, 30 Jan, 22:28
Sean Owen Cheapest way to materialize an RDD? Fri, 30 Jan, 22:42
Stephen Boesch   Re: Cheapest way to materialize an RDD? Fri, 30 Jan, 22:47
Sean Owen     Re: Cheapest way to materialize an RDD? Fri, 30 Jan, 23:54
Eduardo Costa Alfaia Error Compiling Sat, 31 Jan, 00:00
Akhil Das   Re: Error Compiling Sat, 31 Jan, 07:48
Sean Owen   Re: Error Compiling Sat, 31 Jan, 09:04
Corey Nolet Long pauses after writing to sequence files Sat, 31 Jan, 01:52
Akhil Das   Re: Long pauses after writing to sequence files Sat, 31 Jan, 07:24
Josh J measuring time taken in map, reduceByKey, filter, flatMap Sat, 31 Jan, 03:59
Akhil Das   Re: measuring time taken in map, reduceByKey, filter, flatMap Sat, 31 Jan, 07:18
Andrew Musselman Build error Sat, 31 Jan, 04:59
Tathagata Das   Re: Build error Sat, 31 Jan, 05:53
Deep Pradhan Spark on Gordon Sat, 31 Jan, 14:54
Koert Kuipers spark on yarn succeeds but exit code 1 in logs Sat, 31 Jan, 19:24
Ted Yu   Re: spark on yarn succeeds but exit code 1 in logs Sat, 31 Jan, 20:28
Koert Kuipers     Re: spark on yarn succeeds but exit code 1 in logs Sat, 31 Jan, 20:51
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16Thread · Author · Date
Box list
Jun 2019137
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137