spark-user mailing list archives: August 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20Thread · Author · Date
satish chandra j Re: Spark Cassandra Connector issue Tue, 11 Aug, 15:19
satish chandra j Re: saveToCassandra not working in Spark Job but works in Spark Shell Thu, 13 Aug, 14:29
satish chandra j Re: saveToCassandra not working in Spark Job but works in Spark Shell Fri, 14 Aug, 10:30
satish chandra j to retrive full stack trace Wed, 19 Aug, 02:01
satish chandra j Transformation not happening for reduceByKey or GroupByKey Thu, 20 Aug, 10:05
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Thu, 20 Aug, 14:43
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Fri, 21 Aug, 09:07
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Fri, 21 Aug, 09:42
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Fri, 21 Aug, 10:02
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Fri, 21 Aug, 12:48
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Fri, 21 Aug, 13:54
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Sat, 22 Aug, 05:57
satish chandra j Re: Transformation not happening for reduceByKey or GroupByKey Mon, 24 Aug, 11:29
satish chandra j Re: Joining using mulitimap or array Mon, 24 Aug, 12:01
satish chandra j Spark SQL vs Spark Programming Mon, 31 Aug, 04:07
satish chandra j Re: Spark SQL vs Spark Programming Mon, 31 Aug, 11:34
scox PySpark on Mesos - Scaling Wed, 19 Aug, 19:39
sequoiadb question about spark streaming Mon, 10 Aug, 10:24
shahid ashraf Re: How to increase parallelism of a Spark cluster? Mon, 03 Aug, 20:27
shahid ashraf Re: Spark ec2 lunch problem Fri, 21 Aug, 15:13
shahid qadri How to effieciently write sorted neighborhood in pyspark Tue, 25 Aug, 09:45
shahid qadri Re: How to effieciently write sorted neighborhood in pyspark Tue, 25 Aug, 17:13
shawon Apache Spark Suitable JDBC Driver not found Sat, 29 Aug, 10:13
shawon Re: Apache Spark Suitable JDBC Driver not found Sun, 30 Aug, 16:29
sim Re: Schema change on Spark Hive (Parquet file format) table not working Sun, 09 Aug, 03:47
sim Re: Spark inserting into parquet files with different schema Sun, 09 Aug, 03:58
sim Writing a DataFrame as compressed JSON Tue, 11 Aug, 04:12
simone.robutti Issue when rebroadcasting a variable outside of the definition scope Fri, 07 Aug, 14:07
smagadi SparkR -Graphx Thu, 06 Aug, 13:21
smagadi SparkR -Graphx Connected components Fri, 07 Aug, 09:36
smagadi Re: SparkR -Graphx Connected components Mon, 10 Aug, 06:03
smagadi SparkR -Graphx Cliques Mon, 10 Aug, 06:13
smagadi SPARK sql :Need JSON back isntead of roq Fri, 21 Aug, 07:59
smagadi SPARK SQL support for XML Fri, 21 Aug, 08:01
smagadi Re: SPARK sql :Need JSON back isntead of roq Fri, 21 Aug, 10:17
smagadi Graphx CompactBuffer help Fri, 28 Aug, 06:40
sooraj Re: mllib kmeans produce 1 large and many extremely small clusters Tue, 11 Aug, 06:13
spark user Data Frame support CSV or excel format ? Thu, 27 Aug, 18:48
stark_summer java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString Tue, 18 Aug, 02:51
stark_summer Re: java.lang.IllegalAccessError: class com.google.protobuf.HBaseZeroCopyByteString cannot access its superclass com.google.protobuf.LiteralByteString Tue, 18 Aug, 03:33
stark_summer Re: issue Running Spark Job on Yarn Cluster Wed, 19 Aug, 23:57
stelsavva Error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/HBaseConfiguration Fri, 14 Aug, 11:59
storm SparkSQL saveAsParquetFile does not preserve AVRO schema Tue, 25 Aug, 12:13
storm Re: SparkSQL saveAsParquetFile does not preserve AVRO schema Wed, 26 Aug, 06:55
suchenzang Spark Direct Streaming With ZK Updates Mon, 24 Aug, 17:09
suchenzang Re: Spark Direct Streaming With ZK Updates Mon, 24 Aug, 17:11
suchenzang Re: Spark Direct Streaming With ZK Updates Mon, 24 Aug, 22:53
suchenzang Spark Streaming Checkpointing Restarts with 0 Event Batches Tue, 25 Aug, 17:53
suchenzang Spark Streaming Listener to Kill Stages? Thu, 27 Aug, 18:14
swetha Multiple UpdateStateByKey Functions in the same job? Tue, 04 Aug, 01:32
swetha What is the optimal approach to do Secondary Sort in Spark? Wed, 12 Aug, 00:36
swetha Failed to fetch block error Wed, 19 Aug, 05:06
swetha How to set the number of executors and tasks in a Spark Streaming job in Mesos Wed, 19 Aug, 20:58
t4ng0 Spark can't fetch application jar after adding it to HTTP server Sun, 16 Aug, 12:47
t4ng0 Re: How to submit an application using spark-submit Sun, 16 Aug, 16:11
t4ng0 Spark cant fetch the added jar to http server Sun, 16 Aug, 17:11
the3rdNotch How to calculate standard deviation of grouped data in a DataFrame? Mon, 03 Aug, 14:30
timothy22000 Spark Effects of Driver Memory, Executor Memory, Driver Memory Overhead and Executor Memory Overhead on success of job runs Sun, 30 Aug, 01:57
unk1102 Best practices to call hiveContext in DataFrame.foreach in executor program or how to have a for loop in driver program Wed, 05 Aug, 15:37
unk1102 How to create DataFrame from a binary file? Sat, 08 Aug, 20:42
unk1102 How to use custom Hadoop InputFormat in DataFrame? Mon, 10 Aug, 18:22
unk1102 Spark executor lost because of time out even after setting quite long time out value 1000 seconds Sun, 16 Aug, 18:15
unk1102 Example code to spawn multiple threads in driver program Sun, 16 Aug, 18:56
unk1102 Re: Apache Spark - Parallel Processing of messages from Kafka - Java Mon, 17 Aug, 16:17
unk1102 Calling hiveContext.sql("insert into table xyz...") in multiple threads? Mon, 17 Aug, 16:39
unk1102 Spark executor lost because of GC overhead limit exceeded even though using 20 executors using 25GB each Tue, 18 Aug, 15:57
unk1102 How to avoid executor time out on yarn spark while dealing with large shuffle skewed data? Wed, 19 Aug, 18:46
unk1102 spark.sql.shuffle.partitions=1 seems to be working fine but creates timeout for large skewed data Wed, 19 Aug, 19:13
unk1102 Spark YARN executors are not launching when using +UseG1GC Sun, 23 Aug, 18:49
unk1102 Spark executor OOM issue on YARN Mon, 31 Aug, 18:03
utk.pat Performance - Python streaming v/s Scala streaming Mon, 24 Aug, 12:22
vchandra Aggregate by timestamp from json message Thu, 06 Aug, 07:16
venkatesh b Is it worth storing in ORC for one time read. And can be replace hive with HBase Thu, 06 Aug, 12:54
venkatesh b Re: Is it worth storing in ORC for one time read. And can be replace hive with HBase Thu, 06 Aug, 13:32
xander92 How to evaluate custom UDF over window Mon, 24 Aug, 13:26
xiaohe lan SparkPi is geting java.lang.NoClassDefFoundError: scala/collection/Seq Sun, 16 Aug, 18:14
xiaohe lan Re: SparkPi is geting java.lang.NoClassDefFoundError: scala/collection/Seq Mon, 17 Aug, 11:17
yael aharon Adding Kafka topics to a running streaming context Thu, 27 Aug, 14:19
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20Thread · Author · Date
Box list
Sep 202181
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137