spark-user mailing list archives: December 2015

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
chenwu why "cache table a as select * from b" will do shuffle,and create 2 stages. Sat, 12 Dec, 11:30
donhoff_h Job Error:Actor not found for: ActorSelection[Anchor(akka.tcp://sparkDriver@130.1.10.108:23600/) Fri, 25 Dec, 06:26
zhangjp Re: Building spark 1.3 from source code to work with Hive 1.2.1 Thu, 03 Dec, 12:38
zhangjp jdbc error, ClassNotFoundException: org.apache.hadoop.hive.schshim.FairSchedulerShim Fri, 04 Dec, 01:59
zhangjp Could not load shims in class org.apache.hadoop.hive.schshim.FairSchedulerShim Mon, 07 Dec, 03:35
zhangjp how to use sparkR or spark MLlib load csv file on hdfs then calculate covariance Mon, 28 Dec, 09:21
Бобров Виктор Can't filter Thu, 10 Dec, 11:10
Бобров Виктор RE: Can't filter Thu, 10 Dec, 11:31
Бобров Виктор RE: Can't filter Thu, 10 Dec, 11:53
Бобров Виктор RE: Can't filter Thu, 10 Dec, 11:59
Василец Дмитрий Re: Available options for Spark REST API Mon, 07 Dec, 11:34
Василец Дмитрий Re: Stuck with DataFrame df.select("select * from table"); Fri, 25 Dec, 13:42
Նարեկ Գալստեան partitioning json data in spark Sun, 27 Dec, 13:18
Նարեկ Գալստեան Re: partitioning json data in spark Sun, 27 Dec, 17:28
Նարեկ Գալստեան Re: partitioning json data in spark Mon, 28 Dec, 08:20
Նարեկ Գալստեան Re: partitioning json data in spark Tue, 29 Dec, 06:51
张炜 Can Spark Execute Hive Update/Delete operations Wed, 02 Dec, 03:08
张炜 Re: Can Spark Execute Hive Update/Delete operations Wed, 02 Dec, 07:23
张炜 Re: Can Spark Execute Hive Update/Delete operations Thu, 03 Dec, 09:42
谢廷稳 One Problem about Spark Dynamic Allocation Fri, 04 Dec, 05:55
Blaž Šnuderl Re: SparkSQL integration issue with AWS S3a Wed, 30 Dec, 17:54
Jiří Syrový Re: Spark SQL - saving to multiple partitions in parallel - FileNotFoundException on _temporary directory possible bug? Tue, 08 Dec, 11:35
Jiří Syrový Re: FileNotFoundException in appcache shuffle files Thu, 10 Dec, 10:28
Paweł Szulc Re: mapValues Transformation (JavaPairRDD) Tue, 15 Dec, 08:57
Andrés Ivaldi Low Latency SQL query Tue, 01 Dec, 19:51
Andrés Ivaldi Re: Low Latency SQL query Tue, 01 Dec, 20:58
Andrés Ivaldi Re: Low Latency SQL query Wed, 02 Dec, 00:22
Andrés Ivaldi Re: Low Latency SQL query Wed, 02 Dec, 00:23
Andrés Ivaldi Re: Low Latency SQL query Wed, 02 Dec, 01:21
Bartłomiej Alberski Re: Spark streaming: java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration ... on restart from checkpoint Mon, 14 Dec, 16:57
Bartłomiej Alberski Re: Spark streaming: java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration ... on restart from checkpoint Wed, 16 Dec, 22:34
Bartłomiej Alberski Re: Spark streaming: java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration ... on restart from checkpoint Thu, 17 Dec, 12:39
Fabian Böhnlein HiveContext.read.orc - buffer size not respected after setting it Wed, 09 Dec, 11:52
Iulian Dragoș Re: Scala 2.11 and Akka 2.4.0 Tue, 01 Dec, 21:42
Iulian Dragoș Re: Mesos scheduler obeying limit of tasks / executor Fri, 11 Dec, 14:36
Iulian Dragoș Re: default parallelism and mesos executors Fri, 11 Dec, 15:00
Jean-Baptiste Onofré Re: How to test https://issues.apache.org/jira/browse/SPARK-10648 fix Thu, 03 Dec, 10:11
Jean-Baptiste Onofré Re: How and where to update release notes for spark rel 1.6? Thu, 03 Dec, 13:29
Jean-Baptiste Onofré Re: Spark streaming with Kinesis broken? Thu, 10 Dec, 19:05
Jean-Baptiste Onofré Re: Compiling ERROR for Spark MetricsSystem Fri, 11 Dec, 17:48
Jean-Baptiste Onofré Re: Spark Submit - java.lang.IllegalArgumentException: requirement failed Fri, 11 Dec, 18:01
Jean-Baptiste Onofré Re: Download Problem with Spark 1.5.2 pre-built for Hadoop 1.X Thu, 17 Dec, 12:07
Stéphane Verlet Re: rdd split into new rdd Wed, 23 Dec, 15:26
Stéphane Verlet Re: rdd split into new rdd Wed, 23 Dec, 20:11
Timothée Carayol Is DataFrame.groupBy supposed to preserve order within groups? Fri, 18 Dec, 07:55
Timothée Carayol Re: Is DataFrame.groupBy supposed to preserve order within groups? Sat, 19 Dec, 15:43
Zsolt Tóth create DataFrame from RDD<Row> Wed, 02 Dec, 14:29
真·金蜂无双 回复: Problem of submitting Spark task to cluster from eclipse IDE on Windows Thu, 24 Dec, 04:18
Ricky 回复:Classpath problem trying to use DataFrames Sun, 13 Dec, 07:30
donhoff_h 回复: Job Error:Actor not found for: ActorSelection[Anchor(akka.tcp://sparkDriver@130.1.10.108:23600/) Fri, 25 Dec, 08:28
donhoff_h 回复: Job Error:Actor not found for: ActorSelection[Anchor(akka.tcp://sparkDriver@130.1.10.108:23600/) Fri, 25 Dec, 09:36
zhangjp 回复: how to use sparkR or spark MLlib load csv file on hdfs thencalculate covariance Tue, 29 Dec, 07:20
hxw黄祥为 spark1.4.1 extremely slow for take(1) or head() or first() or show Thu, 03 Dec, 10:29
zml张明磊 RuntimeException: Failed to check null bit for primitive int type Mon, 14 Dec, 11:40
zml张明磊 YarnScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Wed, 16 Dec, 02:32
zml张明磊 Are there some solution to complete the transform category variables into dummy variable in scala or spark ? Thu, 17 Dec, 08:00
zml张明磊 UnsupportedOperationException Schema for type String => Int is not supported Tue, 22 Dec, 08:27
zml张明磊 running spark application encouter an error (maven relative) Wed, 23 Dec, 06:10
zml张明磊 How can I get the column data based on specific column name and then stored these data in array or list ? Fri, 25 Dec, 07:33
zml张明磊 Error:scalac: Error: assertion failed: List(object package$DebugNode, object package$DebugNode) Thu, 31 Dec, 07:00
zml张明磊 转发: Error:scalac: Error: assertion failed: List(object package$DebugNode, object package$DebugNode) Thu, 31 Dec, 07:15
顾亮亮 Opening Dynamic Scaling Executors on Yarn Mon, 28 Dec, 06:00
汪洋 Problem using limit clause in spark sql Wed, 23 Dec, 13:26
汪洋 Re: Problem using limit clause in spark sql Thu, 24 Dec, 01:32
汪洋 Re: Problem using limit clause in spark sql Thu, 24 Dec, 03:56
顾亮亮 RE: Opening Dynamic Scaling Executors on Yarn Mon, 28 Dec, 06:33
Hervé Yviquel Problem with RDD of (Long, Byte[Array]) Thu, 03 Dec, 16:58
Hervé Yviquel Re: Problem with RDD of (Long, Byte[Array]) Thu, 03 Dec, 17:58
Jörn Franke Re: Low Latency SQL query Tue, 01 Dec, 20:38
Jörn Franke Re: Low Latency SQL query Wed, 02 Dec, 00:05
Jörn Franke Re: Spark with MapDB Tue, 08 Dec, 12:00
Jörn Franke Re: Logging spark output to hdfs file Tue, 08 Dec, 12:31
Jörn Franke Re: Graph visualization tool for GraphX Tue, 08 Dec, 16:30
Jörn Franke Re: Run ad-hoc queries at runtime against cached RDDs Mon, 14 Dec, 17:04
Jörn Franke Re: How to run multiple Spark jobs as a workflow that takes input from a Streaming job in Oozie Sun, 20 Dec, 08:08
Yusuf Can Gürkan AWS CLI --jars comma problem Thu, 03 Dec, 16:51
Aaron Re: Spark-shell connecting to Mesos stuck at sched.cpp Wed, 16 Dec, 16:06
Aaron Jackson Increasing memory usage on batch job (pyspark) Wed, 02 Dec, 05:46
Aaron Jackson Re: Passing parameters to spark SQL Mon, 28 Dec, 19:52
Abhinav M Kulkarni Fwd: Numpy and dynamic loading Sun, 20 Dec, 03:03
Abhinav M Kulkarni Numpy and dynamic loading Sun, 20 Dec, 17:49
Abhishek Anand Error on using updateStateByKey Fri, 18 Dec, 08:12
Abhishek Shivkumar Is it possible to pass additional parameters to a python function when used inside RDD.filter method? Fri, 04 Dec, 12:19
Abhishek Shivkumar Re: Is it possible to pass additional parameters to a python function when used inside RDD.filter method? Fri, 04 Dec, 12:59
Abhishek Shivkumar How to access a RDD (that has been broadcasted) inside the filter method of another RDD? Fri, 04 Dec, 17:13
Abhishek Shivkumar How to unpack the values of an item in a RDD so I can create a RDD with multiple items? Sun, 13 Dec, 17:40
Abhishek Shivkumar Re: PairRDD(K, L<V>) to multiple files by key serializing each value in L<V> before Wed, 16 Dec, 12:26
Adrian Bridgett default parallelism and mesos executors Wed, 02 Dec, 14:58
Adrian Bridgett default parallelism and mesos executors Wed, 09 Dec, 15:29
Adrian Bridgett Re: default parallelism and mesos executors Tue, 15 Dec, 09:49
Adrian Bridgett Executor deregistered after 2mins (mesos, 1.6.0-rc4) Tue, 29 Dec, 20:43
Adrian Bridgett Re: Executor deregistered after 2mins (mesos, 1.6.0-rc4) Wed, 30 Dec, 08:31
Adrian Bridgett Re: Executor deregistered after 2mins (mesos, 1.6.0-rc4) Wed, 30 Dec, 11:54
Adrian Bridgett Re: Executor deregistered after 2mins (mesos, 1.6.0-rc4) Wed, 30 Dec, 13:00
Adrien Mogenet Re: [POWERED BY] Please add our organization Wed, 02 Dec, 10:53
Adrien Mogenet Re: [POWERED BY] Please add our organization Wed, 02 Dec, 11:04
Adrien Mogenet Re: df.partitionBy().parquet() java.lang.OutOfMemoryError: GC overhead limit exceeded Thu, 03 Dec, 07:38
Afshartous, Nick Spark Submit - java.lang.IllegalArgumentException: requirement failed Fri, 11 Dec, 16:49
Afshartous, Nick Re: Spark Submit - java.lang.IllegalArgumentException: requirement failed Fri, 11 Dec, 19:13
Afshartous, Nick Configuring log4j Fri, 18 Dec, 16:46
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
May 2019207
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137