spark-user mailing list archives: October 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
pnpritchard Re: why would a spark Job fail without throwing run-time exceptions? Mon, 12 Oct, 20:06
pnpritchard Re: ClassCastException when use spark1.5.1 Mon, 12 Oct, 21:22
pnpritchard Re: SPARK SQL Error Tue, 13 Oct, 20:41
pnpritchard Re: SPARK SQL Error Wed, 14 Oct, 17:18
pnpritchard Re: SPARK SQL Error Thu, 15 Oct, 17:27
prajod.vettiyat...@wipro.com RE: Node afinity for Kafka-Direct Stream Wed, 14 Oct, 16:00
prajod.vettiyat...@wipro.com RE: Running in cluster mode causes native library linking to fail Thu, 15 Oct, 06:27
prajod.vettiyat...@wipro.com RE: Running in cluster mode causes native library linking to fail Tue, 27 Oct, 05:48
pratik khadloya Huge shuffle data size Fri, 23 Oct, 18:10
pratik khadloya Re: Huge shuffle data size Fri, 23 Oct, 18:39
pratik khadloya Re: Saprk error:- Not a valid DFS File name Fri, 23 Oct, 18:43
pratik khadloya Re: Stream are not serializable Fri, 23 Oct, 18:46
pratik khadloya Re: Saprk error:- Not a valid DFS File name Fri, 23 Oct, 18:48
pratik khadloya Re: Huge shuffle data size Fri, 23 Oct, 21:02
praveen S Concurrent execution of actions within a driver Mon, 26 Oct, 11:26
pushkar priyadarshi Re: Kafka streaming "at least once" semantics Fri, 09 Oct, 12:30
pushkar priyadarshi Re: Kafka streaming "at least once" semantics Fri, 09 Oct, 12:31
r7raul1...@163.com how to use Trees and ensembles: class probabilities Thu, 22 Oct, 02:58
rake Getting info from DecisionTreeClassificationModel Wed, 21 Oct, 07:04
ravi.gawai Re: Filter RDD Tue, 20 Oct, 21:31
rkrist spark SQL thrift server - support for more features via jdbc (table catalog) Wed, 21 Oct, 13:22
robert towne Dynamic Allocation & Spark Streaming Mon, 19 Oct, 20:13
robert towne Dynamic Allocation & Spark Streaming Mon, 19 Oct, 20:26
robin_up Clustering KMeans error in 1.5.1 Fri, 16 Oct, 20:36
rohit13k Re: graphx - mutable? Wed, 14 Oct, 09:03
rohit13k EdgeTriplet showing two versions of the same vertex Wed, 14 Oct, 09:13
roy python version in spark-submit Thu, 01 Oct, 20:56
roywang1024 Re:Re: Re: Re: Error in load hbase on spark Sat, 10 Oct, 01:26
rporcio SparkR 1.5.1 ClassCastException when working with CSV files Wed, 28 Oct, 11:46
rporcio Re: SparkR 1.5.1 ClassCastException when working with CSV files Wed, 28 Oct, 14:59
rporcio SparkR job with >200 tasks hangs when calling from web server Fri, 30 Oct, 15:09
saluc PySpark: breakdown application execution time and fine-tuning Sat, 17 Oct, 10:10
satish chandra j Re: Scala Limitation - Case Class definition with more than 22 arguments Sat, 03 Oct, 04:01
satish chandra j Re: Scala Limitation - Case Class definition with more than 22 arguments Mon, 05 Oct, 05:19
satish chandra j Fwd: Partition Column in JDBCRDD or Datasource API Wed, 14 Oct, 11:15
satish chandra j Convert SchemaRDD to RDD Fri, 16 Oct, 14:41
satish chandra j Re: Convert SchemaRDD to RDD Fri, 16 Oct, 15:01
satish chandra j Re: JdbcRDD Constructor Tue, 20 Oct, 14:19
saurfang Collect Column as Array in Grouped DataFrame Thu, 29 Oct, 01:19
sethah Re: Adding the values in a column of a dataframe Fri, 02 Oct, 18:03
sethah Re: Does feature parity exist between Spark and PySpark Wed, 07 Oct, 16:29
sethah Re: Getting info from DecisionTreeClassificationModel Thu, 22 Oct, 04:43
shahab unresolved dependency: org.apache.spark#spark-streaming_2.10;1.5.0: not found Tue, 06 Oct, 09:50
shahid Re: How does shuffle work in spark ? Mon, 19 Oct, 13:54
shahid Can we split partition Wed, 21 Oct, 04:57
shahid Python worker exited unexpectedly (crashed) Thu, 22 Oct, 16:37
shahid ashraf Re: Build Failure Thu, 08 Oct, 08:25
shahid ashraf Re: repartition vs partitionby Sat, 17 Oct, 13:14
shahid ashraf Re: repartition vs partitionby Mon, 19 Oct, 05:14
shahid ashraf SHUFFLE in PARTITIONBY or shuffle in general Mon, 19 Oct, 11:16
shahid ashraf Fwd: SHUFFLE in PARTITIONBY or shuffle in general Mon, 19 Oct, 15:57
shahid ashraf Re: issue with spark.driver.maxResultSize parameter in spark 1.3 Fri, 30 Oct, 04:09
shahid qadri API to run spark Jobs Tue, 06 Oct, 16:37
shahid qadri Re: API to run spark Jobs Tue, 06 Oct, 17:08
shahid qadri Build Failure Thu, 08 Oct, 07:55
shahid qadri repartition vs partitionby Sat, 17 Oct, 07:32
shahid qadri LARGE COLLECT Mon, 26 Oct, 20:27
shobhit gupta Re: SQLcontext changing String field to Long Sun, 11 Oct, 01:52
shobhit gupta Re: SQLcontext changing String field to Long Mon, 12 Oct, 17:57
shoira.mukhsin...@bnpparibasfortis.com stability of Spark 1.4.1 with Python 3 versions Wed, 14 Oct, 11:06
spakle Loading dataframes to vertica database Thu, 29 Oct, 17:37
sri hari kali charan Tummala Re: Pass spark partition explicitly ? Sun, 18 Oct, 18:22
srungarapu vamsi Re: Spark/Kafka Streaming Job Gets Stuck Thu, 29 Oct, 06:45
surbhi.mungre Preemption with Spark on Yarn Tue, 20 Oct, 18:28
swetha Usage of transform for code reuse between Streaming and Batch job affects the performance ? Mon, 05 Oct, 00:59
swetha Optimal way to avoid processing null returns in Spark Scala Wed, 07 Oct, 16:42
swetha How to put an object in cache for ever in Streaming Fri, 16 Oct, 19:02
swetha How to have Single refernce of a class in Spark Streaming? Sat, 17 Oct, 01:05
swetha Job splling to disk and memory in Spark Streaming Wed, 21 Oct, 00:59
swetha Distributed caching of a file in SPark Streaming Wed, 21 Oct, 20:05
swetha Does using Custom Partitioner before calling reduceByKey improve performance? Tue, 27 Oct, 20:20
swetha How to lookup by a key in an RDD Sat, 31 Oct, 16:04
swetha kasireddy Re: Spark streaming job filling a lot of data in local spark nodes Fri, 02 Oct, 00:59
swetha kasireddy Re: How to put an object in cache for ever in Streaming Sat, 17 Oct, 01:15
swetha kasireddy Re: Lost leader exception in Kafka Direct for Streaming Wed, 21 Oct, 05:46
swetha kasireddy Re: Secondary Sorting in Spark Mon, 26 Oct, 04:56
swetha kasireddy Re: Secondary Sorting in Spark Tue, 27 Oct, 01:15
swetha kasireddy Re: Does using Custom Partitioner before calling reduceByKey improve performance? Wed, 28 Oct, 01:35
swetha kasireddy Re: Does using Custom Partitioner before calling reduceByKey improve performance? Wed, 28 Oct, 02:10
syepes Re: [Yarn-Client]Can not access SparkUI Mon, 26 Oct, 07:57
t3l Ahhhh... Spark creates >30000 partitions... What can I do? Tue, 20 Oct, 12:00
t3l Partition for each executor Tue, 20 Oct, 15:13
t3l (SOLVED) Ahhhh... Spark creates >30000 partitions... What can I do? Fri, 23 Oct, 04:13
t3l Prevent partitions from moving Wed, 28 Oct, 11:35
t_ras java.lang.OutOfMemoryError: GC overhead limit exceeded Sun, 04 Oct, 11:26
tarek.abouzei...@yahoo.com.INVALID Spark handling parallel requests Mon, 05 Oct, 13:16
tarek.abouzei...@yahoo.com.INVALID Re: Spark handling parallel requests Sun, 18 Oct, 07:26
tarek.abouzei...@yahoo.com.INVALID Re: Spark handling parallel requests Sun, 18 Oct, 07:28
tarek.abouzei...@yahoo.com.INVALID Re: Spark handling parallel requests Mon, 19 Oct, 18:06
tbenthompson Poor use cases for Spark Wed, 21 Oct, 20:53
tian zhang Re: "Too many open files" exception on reduceByKey Fri, 09 Oct, 17:13
tridib Writing UDF with variable number of arguments Mon, 05 Oct, 21:26
tstewart sparkR 1.5.1 batch yarn-client mode failing on daemon.R not found Thu, 29 Oct, 19:17
tstewart Spark 1.5.1 Dynamic Resource Allocation Fri, 30 Oct, 03:00
unk1102 How to save DataFrame as a Table in Hbase? Thu, 01 Oct, 22:15
unk1102 How to use registered Hive UDF in Spark DataFrame? Fri, 02 Oct, 11:25
unk1102 How to optimize group by query fired using hiveContext.sql? Sat, 03 Oct, 10:19
unk1102 Can we using Spark Streaming to stream data from Hive table partitions? Sat, 03 Oct, 13:01
unk1102 ORC files created by Spark job can't be accessed using hive table Tue, 06 Oct, 15:51
unk1102 How to avoid Spark shuffle spill memory? Tue, 06 Oct, 19:19
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · Next »Thread · Author · Date
Box list
Nov 201973
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137