spark-user mailing list archives: July 2016

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · Next »Thread · Author · Date
pooja mehta How to use Spark scala custom UDF in spark sql CLI or beeline client Sun, 17 Jul, 16:37
VG Error in using filter when using dataset API in java Sun, 17 Jul, 16:57
Ted Yu   Re: Error in using filter when using dataset API in java Sun, 17 Jul, 23:54
condor join Question About OFF_HEAP Caching Mon, 18 Jul, 07:11
Gene Pang   Re: Question About OFF_HEAP Caching Mon, 18 Jul, 13:36
Bin Fan     Re: Question About OFF_HEAP Caching Mon, 18 Jul, 18:15
manish jaiswal Spark Job trigger in production Mon, 18 Jul, 07:13
Jagat Singh   Re: Spark Job trigger in production Mon, 18 Jul, 07:15
Andrew Ehrlich     Re: Spark Job trigger in production Wed, 20 Jul, 03:37
Rabin Banerjee       Re: Spark Job trigger in production Wed, 20 Jul, 11:08
Sathish Kumaran Vairavelu         Re: Spark Job trigger in production Wed, 20 Jul, 13:47
Lars Albertsson           Re: Spark Job trigger in production Thu, 21 Jul, 09:52
leezy how to tuning spark shuffle Mon, 18 Jul, 07:16
Mich Talebzadeh   Re: how to tuning spark shuffle Mon, 18 Jul, 09:57
lizhenm...@163.com   Re: Re: how to tuning spark shuffle Mon, 18 Jul, 10:20
Divya Gehlot Dynamically get value based on Map key in Spark Dataframe Mon, 18 Jul, 07:23
Jacek Laskowski   Re: Dynamically get value based on Map key in Spark Dataframe Mon, 18 Jul, 15:06
Divya Gehlot     Re: Dynamically get value based on Map key in Spark Dataframe Tue, 19 Jul, 02:31
Jacek Laskowski       Re: Dynamically get value based on Map key in Spark Dataframe Tue, 19 Jul, 07:17
pseudo oduesp pyspark 1.5 0 save model ? Mon, 18 Jul, 09:58
Holden Karau   Re: pyspark 1.5 0 save model ? Mon, 18 Jul, 18:09
the spark job is so slow - almost frozen
Zhiliang Zhu   the spark job is so slow - almost frozen Mon, 18 Jul, 10:04
Zhiliang Zhu     Re: the spark job is so slow - almost frozen Mon, 18 Jul, 10:20
Chanh Le       Re: the spark job is so slow - almost frozen Mon, 18 Jul, 10:24
Zhiliang Zhu         Re: the spark job is so slow - almost frozen Mon, 18 Jul, 10:33
Zhiliang Zhu           the spark job is so slow during shuffle - almost frozen Tue, 19 Jul, 03:52
Andrew Ehrlich           Re: the spark job is so slow - almost frozen Wed, 20 Jul, 03:35
Zhiliang Zhu             Re: the spark job is so slow - almost frozen Thu, 21 Jul, 04:02
Gourav Sengupta             Re: the spark job is so slow - almost frozen Fri, 22 Jul, 02:07
Saurav Sinha Spark driver getting out of memory Mon, 18 Jul, 10:31
Zhiliang Zhu   Re: Spark driver getting out of memory Mon, 18 Jul, 10:37
Saurav Sinha     Re: Spark driver getting out of memory Mon, 18 Jul, 10:50
Mich Talebzadeh       Re: Spark driver getting out of memory Mon, 18 Jul, 21:12
Saurav Sinha         Re: Spark driver getting out of memory Tue, 19 Jul, 07:09
RK Aduri           Re: Spark driver getting out of memory Tue, 19 Jul, 16:44
Saurav Sinha             Re: Spark driver getting out of memory Wed, 20 Jul, 06:08
RK Aduri               Re: Spark driver getting out of memory Wed, 20 Jul, 16:50
Raghava Mutharaju               Re: Spark driver getting out of memory Sun, 24 Jul, 18:53
Abhishek Anand Concatenate the columns in dataframe to create new collumns using Java Mon, 18 Jul, 10:45
nihed mbarek   Re: Concatenate the columns in dataframe to create new collumns using Java Mon, 18 Jul, 11:09
Abhishek Anand     Re: Concatenate the columns in dataframe to create new collumns using Java Mon, 18 Jul, 12:14
nihed mbarek       Re: Concatenate the columns in dataframe to create new collumns using Java Mon, 18 Jul, 12:26
Abhishek Anand         Re: Concatenate the columns in dataframe to create new collumns using Java Mon, 18 Jul, 13:23
Koert Kuipers transtition SQLContext to SparkSession Mon, 18 Jul, 15:37
Michael Armbrust   Re: transtition SQLContext to SparkSession Mon, 18 Jul, 19:16
Reynold Xin     Re: transtition SQLContext to SparkSession Mon, 18 Jul, 22:26
Maciej Bryński       Re: transtition SQLContext to SparkSession Tue, 19 Jul, 16:47
Reynold Xin         Re: transtition SQLContext to SparkSession Tue, 19 Jul, 17:01
Benjamin Kim   Re: transtition SQLContext to SparkSession Mon, 18 Jul, 22:02
Sunita Arvind Increasing spark.yarn.executor.memoryOverhead degrades performance Mon, 18 Jul, 15:47
Sean Owen   Re: Increasing spark.yarn.executor.memoryOverhead degrades performance Mon, 18 Jul, 15:53
Rory Waite spark-submit local and Akka startup timeouts Mon, 18 Jul, 16:34
Bryan Cutler   Re: spark-submit local and Akka startup timeouts Tue, 19 Jul, 01:20
Rory Waite     Re: spark-submit local and Akka startup timeouts Tue, 19 Jul, 09:29
Bryan Cutler       Re: spark-submit local and Akka startup timeouts Tue, 19 Jul, 21:05
joshuata Execute function once on each node Mon, 18 Jul, 21:57
Aniket Bhatnagar   Re: Execute function once on each node Mon, 18 Jul, 22:43
Josh Asplund     Re: Execute function once on each node Tue, 19 Jul, 01:54
Aniket Bhatnagar       Re: Execute function once on each node Tue, 19 Jul, 06:42
Josh Asplund         Re: Execute function once on each node Tue, 19 Jul, 16:26
Koert Kuipers       Re: Execute function once on each node Tue, 19 Jul, 14:08
Josh Asplund         Re: Execute function once on each node Tue, 19 Jul, 16:30
Rabin Banerjee   Re: Execute function once on each node Tue, 19 Jul, 18:55
ApacheCon: Getting the word out internally
Melissa Warnkin   ApacheCon: Getting the word out internally Mon, 18 Jul, 23:15
Unsubscribe
Jinan Alhajjaj   Unsubscribe Tue, 19 Jul, 03:33
V, Gokulakrishnan     Unsubscribe Tue, 19 Jul, 04:08
sjk   Unsubscribe Wed, 20 Jul, 01:22
Kath Gallagher   Unsubscribe Thu, 21 Jul, 07:08
wdaehn Scala code as "spark view" Tue, 19 Jul, 08:26
pseudo oduesp which one spark ml or spark mllib Tue, 19 Jul, 09:55
Holden Karau   Re: which one spark ml or spark mllib Tue, 19 Jul, 17:03
Eli Super I'm trying to understand how to compile Spark Tue, 19 Jul, 11:22
Ted Yu   Re: I'm trying to understand how to compile Spark Tue, 19 Jul, 13:42
Jakob Odersky     Re: I'm trying to understand how to compile Spark Tue, 19 Jul, 16:09
Jacek Laskowski       Re: I'm trying to understand how to compile Spark Tue, 19 Jul, 19:50
RK Spark Error in Word Count Program Tue, 19 Jul, 11:30
Jakob Odersky   Re: Error in Word Count Program Tue, 19 Jul, 16:12
Guruji Spark ResourceLeak?? Tue, 19 Jul, 13:11
Ted Yu   Re: Spark ResourceLeak?? Tue, 19 Jul, 13:27
saurabh guru Spark ResourceLeak? Tue, 19 Jul, 13:12
Sachin Mittal Building standalone spark application via sbt Tue, 19 Jul, 14:09
Andrew Ehrlich   Re: Building standalone spark application via sbt Tue, 19 Jul, 14:53
Sachin Mittal     Re: Building standalone spark application via sbt Wed, 20 Jul, 08:54
Mich Talebzadeh       Re: Building standalone spark application via sbt Wed, 20 Jul, 14:39
Marco Mistroni         Re: Building standalone spark application via sbt Wed, 20 Jul, 16:12
Sachin Mittal           Re: Building standalone spark application via sbt Wed, 20 Jul, 17:13
Marco Mistroni             Re: Building standalone spark application via sbt Wed, 20 Jul, 17:53
Sachin Mittal               Re: Building standalone spark application via sbt Wed, 20 Jul, 18:00
Yu Wei Is it good choice to use DAO to store results generated by spark application? Tue, 19 Jul, 16:34
Andrew Ehrlich   Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 03:27
Ted Yu     Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 04:14
Yu Wei     Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 06:33
Deepak Sharma   Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 04:34
Yu Wei     Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 06:36
Rabin Banerjee       Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 10:57
ayan guha         Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 13:34
Yu Wei         Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 14:22
Ted Yu           Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 14:34
Yu Wei           Re: Is it good choice to use DAO to store results generated by spark application? Wed, 20 Jul, 14:42
Re: how to setup the development environment of spark with IntelliJ on ubuntu
joshuata   Re: how to setup the development environment of spark with IntelliJ on ubuntu Tue, 19 Jul, 18:25
rachmaninovquartet Strange behavior including memory leak and NPE Tue, 19 Jul, 18:53
Little idea needed
Aakash Basu   Little idea needed Tue, 19 Jul, 19:27
Jörn Franke     Re: Little idea needed Tue, 19 Jul, 19:57
Aakash Basu       Re: Little idea needed Wed, 20 Jul, 20:23
Mich Talebzadeh     Re: Little idea needed Tue, 19 Jul, 20:08
ayan guha       Re: Little idea needed Tue, 19 Jul, 23:10
Mich Talebzadeh         Re: Little idea needed Wed, 20 Jul, 12:22
Aakash Basu       Re: Little idea needed Wed, 20 Jul, 20:26
Re: Task not serializable: java.io.NotSerializableException: org.json4s.Serialization$$anon$1
joshuata   Re: Task not serializable: java.io.NotSerializableException: org.json4s.Serialization$$anon$1 Tue, 19 Jul, 20:51
RK Aduri   Re: Task not serializable: java.io.NotSerializableException: org.json4s.Serialization$$anon$1 Tue, 19 Jul, 21:32
Everett Anderson Role-based S3 access outside of EMR Tue, 19 Jul, 21:30
Andy Davidson   Re: Role-based S3 access outside of EMR Tue, 19 Jul, 21:47
Everett Anderson     Re: Role-based S3 access outside of EMR Thu, 21 Jul, 00:06
Gourav Sengupta       Re: Role-based S3 access outside of EMR Thu, 21 Jul, 06:37
Teng Qiu         Re: Role-based S3 access outside of EMR Thu, 21 Jul, 07:37
Gourav Sengupta           Re: Role-based S3 access outside of EMR Thu, 21 Jul, 09:32
Everett Anderson             Re: Role-based S3 access outside of EMR Thu, 21 Jul, 16:00
Ewan Leith               RE: Role-based S3 access outside of EMR Thu, 21 Jul, 16:23
Steve Loughran                 Re: Role-based S3 access outside of EMR Sat, 23 Jul, 11:11
Everett Anderson                   Re: Role-based S3 access outside of EMR Thu, 28 Jul, 23:07
Rachana Srivastava Missing Exector Logs From Yarn After Spark Failure Tue, 19 Jul, 22:23
Ted Yu   Re: Missing Exector Logs From Yarn After Spark Failure Tue, 19 Jul, 22:58
ayan guha     Re: Missing Exector Logs From Yarn After Spark Failure Tue, 19 Jul, 23:35
Ajinkya Kale Saving a pyspark.ml.feature.PCA model Tue, 19 Jul, 22:54
Shuai Lin   Re: Saving a pyspark.ml.feature.PCA model Wed, 20 Jul, 03:13
Ajinkya Kale     Re: Saving a pyspark.ml.feature.PCA model Wed, 20 Jul, 03:22
Ajinkya Kale       Re: Saving a pyspark.ml.feature.PCA model Wed, 20 Jul, 18:14
Yanbo Liang         Re: Saving a pyspark.ml.feature.PCA model Sun, 24 Jul, 11:46
Yanbo Liang           Re: Saving a pyspark.ml.feature.PCA model Sun, 24 Jul, 11:51
Aaron Jackson Heavy Stage Concentration - Ends With Failure Wed, 20 Jul, 00:16
Kuchekar   Re: Heavy Stage Concentration - Ends With Failure Wed, 20 Jul, 01:19
Andrew Ehrlich     Re: Heavy Stage Concentration - Ends With Failure Wed, 20 Jul, 03:20
satyajit vegesna HiveContext , difficulties in accessing tables in hive schema's/database's other than default database. Wed, 20 Jul, 01:23
Neil Chang spark worker continuously trying to connect to master and failed in standalone mode Wed, 20 Jul, 01:25
Andrew Ehrlich   Re: spark worker continuously trying to connect to master and failed in standalone mode Wed, 20 Jul, 03:12
Igor Berman     Re: spark worker continuously trying to connect to master and failed in standalone mode Wed, 20 Jul, 15:03
Neil Chang       Re: spark worker continuously trying to connect to master and failed in standalone mode Fri, 22 Jul, 18:08
Brett Randall Should it be safe to embed Spark in Local Mode? Wed, 20 Jul, 02:35
Holden Karau   Re: Should it be safe to embed Spark in Local Mode? Wed, 20 Jul, 05:14
Storm HDFS bolt equivalent in Spark Streaming.
Rajesh_Kall...@DellTeam.com   Storm HDFS bolt equivalent in Spark Streaming. Wed, 20 Jul, 04:18
Deepak Sharma     Re: Storm HDFS bolt equivalent in Spark Streaming. Wed, 20 Jul, 04:31
Rabin Banerjee       Re: Storm HDFS bolt equivalent in Spark Streaming. Wed, 20 Jul, 11:06
Rajesh_Kall...@DellTeam.com   Storm HDFS bolt equivalent in Spark Streaming. Wed, 20 Jul, 16:40
Jon Chase Extremely slow shuffle writes and large job time fluxuations Wed, 20 Jul, 04:30
Running multiple Spark Jobs on Yarn( Client mode)
Vaibhav Nagpal   Running multiple Spark Jobs on Yarn( Client mode) Wed, 20 Jul, 06:00
vaibhavrtk   Running multiple Spark Jobs on Yarn( Client mode) Wed, 20 Jul, 06:35
Rabin Banerjee     Re: Running multiple Spark Jobs on Yarn( Client mode) Wed, 20 Jul, 11:00
Divya Gehlot write and call UDF in spark dataframe Wed, 20 Jul, 07:14
Rabin Banerjee   Re: write and call UDF in spark dataframe Wed, 20 Jul, 10:51
Rishabh Bhardwaj     Re: write and call UDF in spark dataframe Wed, 20 Jul, 11:22
Mich Talebzadeh       Re: write and call UDF in spark dataframe Wed, 20 Jul, 12:12
Andy Davidson       Re: write and call UDF in spark dataframe Wed, 20 Jul, 16:24
Divya Gehlot         Re: write and call UDF in spark dataframe Thu, 21 Jul, 02:53
Mich Talebzadeh           Re: write and call UDF in spark dataframe Thu, 21 Jul, 03:53
Jacek Laskowski             Re: write and call UDF in spark dataframe Thu, 21 Jul, 07:13
Kabeer Ahmed               Re: write and call UDF in spark dataframe Thu, 21 Jul, 09:25
Jacek Laskowski           Re: write and call UDF in spark dataframe Thu, 21 Jul, 07:11
Jacek Laskowski       Re: write and call UDF in spark dataframe Thu, 21 Jul, 07:09
raaggarw How spark decides whether to do BroadcastHashJoin or SortMergeJoin Wed, 20 Jul, 08:07
Matthias Niehoff   Re: How spark decides whether to do BroadcastHashJoin or SortMergeJoin Fri, 22 Jul, 08:49
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · Next »Thread · Author · Date
Box list
Oct 2020218
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137