spark-user mailing list archives: March 2017

Site index · List index
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Saisai Shao Re: How to use ManualClock with Spark streaming Wed, 01 Mar, 01:39
Michael Armbrust Re: Why Spark cannot get the derived field of case class in Dataset? Wed, 01 Mar, 02:46
jeremycod Can't transform RDD for the second time Wed, 01 Mar, 04:17
KhajaAsmath Mohammed Re: Spark - Not contains on Spark dataframe Wed, 01 Mar, 04:29
Prithish Re: Custom log4j.properties on AWS EMR Wed, 01 Mar, 05:33
Prithish Re: RDD blocks on Spark Driver Wed, 01 Mar, 05:35
Mark Hamstra Re: Can't transform RDD for the second time Wed, 01 Mar, 05:53
Justin Pihony Jar not in shell classpath in Windows 10 Wed, 01 Mar, 06:05
Justin Pihony Re: Jar not in shell classpath in Windows 10 Wed, 01 Mar, 06:07
Justin Pihony Re: Jar not in shell classpath in Windows 10 Wed, 01 Mar, 06:20
Jörn Franke Re: using spark to load a data warehouse in real time Wed, 01 Mar, 07:25
Sam Elamin Re: using spark to load a data warehouse in real time Wed, 01 Mar, 08:28
Triones,Deng(vip.com) 答复: 答复: spark append files to the same hdfs dir issue for LeaseExpiredException Wed, 01 Mar, 09:25
Jakub Dubovsky Number of partitions in Dataset aggregations Wed, 01 Mar, 09:28
Phadnis, Varun Spark driver CPU usage Wed, 01 Mar, 12:11
Charles O. Bajomo [Spark] Accumulators or count() Wed, 01 Mar, 12:26
Rohit Verma Re: Spark driver CPU usage Wed, 01 Mar, 12:38
Phadnis, Varun RE: Spark driver CPU usage Wed, 01 Mar, 12:57
Dominik Safaric Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function Wed, 01 Mar, 13:19
Yong Zhang Re: Spark driver CPU usage Wed, 01 Mar, 13:24
Sean Owen Re: Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function Wed, 01 Mar, 13:51
Dominik Safaric Re: Spark Streaming - java.lang.ClassNotFoundException Scala anonymous function Wed, 01 Mar, 14:01
Madabhattula Rajesh Kumar Continuous or Categorical Wed, 01 Mar, 14:36
Richard Siebeling Re: Continuous or Categorical Wed, 01 Mar, 15:13
Daniel Siegmann Re: [Spark] Accumulators or count() Wed, 01 Mar, 15:30
Bill Schwanitz question on transforms for spark 2.0 dataset Wed, 01 Mar, 16:21
Marco Mistroni Re: question on transforms for spark 2.0 dataset Wed, 01 Mar, 17:04
Subhash Sriram Re: question on transforms for spark 2.0 dataset Wed, 01 Mar, 17:20
Parag Chaudhari Re: Why spark history server does not show RDD even if it is persisted? Wed, 01 Mar, 17:33
Bill Schwanitz Re: question on transforms for spark 2.0 dataset Wed, 01 Mar, 18:28
Mike Thomsen Combining reading from Kafka and HDFS w/ Spark Streaming Wed, 01 Mar, 19:50
Simona Rabinovici-Cohen reaasign location of partitions Wed, 01 Mar, 21:17
Ankur Srivastava Spark 2.0 issue with left_outer join Wed, 01 Mar, 21:28
Everett Anderson Best way to assign a unique IDs to row groups Wed, 01 Mar, 21:50
Mike Thomsen Combining reading from Kafka and HDFS w/ Spark Streaming Thu, 02 Mar, 01:19
Han-Cheol Cho strange usage of tempfile.mkdtemp() in PySpark mllib.recommendation doctest Thu, 02 Mar, 08:30
vimal dinakaran Restart if driver gets insufficient resources Thu, 02 Mar, 08:32
Aseem Bansal Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Thu, 02 Mar, 11:04
Marco Mistroni Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Thu, 02 Mar, 11:33
Aseem Bansal spark keeps on creating executors and each one fails with "TransportClient has not yet been set." Thu, 02 Mar, 12:04
Madabhattula Rajesh Kumar SimpleConfigObject Thu, 02 Mar, 19:45
SRK How to tune groupBy operations in Spark 2.x? Thu, 02 Mar, 21:14
Aseem Bansal Re: spark keeps on creating executors and each one fails with "TransportClient has not yet been set." Fri, 03 Mar, 07:31
任弘迪 Re: spark sql: full outer join optimization Fri, 03 Mar, 07:53
Mich Talebzadeh kafka and zookeeper set up in prod for spark streaming Fri, 03 Mar, 08:15
Gaurav1809 Server Log Processing - Regex or ElasticSearch? Fri, 03 Mar, 08:27
vincent gromakowski Re: kafka and zookeeper set up in prod for spark streaming Fri, 03 Mar, 08:29
Jörn Franke Re: kafka and zookeeper set up in prod for spark streaming Fri, 03 Mar, 08:29
vincent gromakowski Re: kafka and zookeeper set up in prod for spark streaming Fri, 03 Mar, 08:31
Aseem Bansal Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 09:14
Noorul Islam K M Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 10:12
Mich Talebzadeh Re: kafka and zookeeper set up in prod for spark streaming Fri, 03 Mar, 10:33
Mazen Resource manager: estimation of application execution time/remaining time. Fri, 03 Mar, 12:17
Kristinn Rúnarsson Problems when submitting a spark job via the REST API Fri, 03 Mar, 13:22
veera satya nv Dantuluri Re: Server Log Processing - Regex or ElasticSearch? Fri, 03 Mar, 14:11
Kristinn Rúnarsson Re: Problems when submitting a spark job via the REST API Fri, 03 Mar, 14:37
Anahita Talebi How to run a spark on Pycharm Fri, 03 Mar, 14:43
Pushkar.Gujar Re: How to run a spark on Pycharm Fri, 03 Mar, 14:48
Anahita Talebi Re: How to run a spark on Pycharm Fri, 03 Mar, 15:05
Pushkar.Gujar Re: How to run a spark on Pycharm Fri, 03 Mar, 15:11
Sidney Feiner RE: How to run a spark on Pycharm Fri, 03 Mar, 15:11
TheGeorge1918 . Re: How to run a spark on Pycharm Fri, 03 Mar, 15:28
Mark Hamstra Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 16:03
Rohit Verma Re: Spark join over sorted columns of dataset. Fri, 03 Mar, 16:06
Koert Kuipers Re: Spark join over sorted columns of dataset. Fri, 03 Mar, 16:23
Marco Mistroni Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 22:27
Marco Mistroni Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 22:30
Mark Hamstra Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 22:51
Marco Mistroni Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 23:05
Mark Hamstra Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Fri, 03 Mar, 23:09
Ankur Srivastava Re: Spark 2.0 issue with left_outer join Sat, 04 Mar, 03:32
Old-School [RDDs and Dataframes] Equivalent expressions for RDD API Sat, 04 Mar, 13:59
PSw...@in.imshealth.com Not able to remove header from a text file while creating a data frame . Sat, 04 Mar, 14:42
KhajaAsmath Mohammed Re: Not able to remove header from a text file while creating a data frame . Sat, 04 Mar, 15:43
KhajaAsmath Mohammed Re: Spark - Not contains on Spark dataframe Sat, 04 Mar, 15:45
bryan.jeff...@gmail.com Re: [RDDs and Dataframes] Equivalent expressions for RDD API Sat, 04 Mar, 16:02
Aseem Bansal Re: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources Sat, 04 Mar, 16:38
Adaryl Wakefield RE: using spark to load a data warehouse in real time Sat, 04 Mar, 19:28
Adaryl Wakefield RE: using spark to load a data warehouse in real time Sat, 04 Mar, 19:32
ayan guha Re: Spark 2.0 issue with left_outer join Sat, 04 Mar, 20:09
Yuhao Yang Sharing my DataFrame (DataSet) cheat sheet. Sat, 04 Mar, 20:55
Ankur Srivastava Re: Spark 2.0 issue with left_outer join Sun, 05 Mar, 01:05
ayan guha Re: Spark 2.0 issue with left_outer join Sun, 05 Mar, 05:55
khwunchai jaengsawang Re: [RDDs and Dataframes] Equivalent expressions for RDD API Sun, 05 Mar, 08:10
ayan guha Re: [RDDs and Dataframes] Equivalent expressions for RDD API Sun, 05 Mar, 10:17
颜发才(Yan Facai) Re: Sharing my DataFrame (DataSet) cheat sheet. Sun, 05 Mar, 11:38
Howard Chen unsubscribe Sun, 05 Mar, 13:40
Madabhattula Rajesh Kumar spark jobserver Sun, 05 Mar, 15:39
Noorul Islam K M Re: spark jobserver Sun, 05 Mar, 15:48
Ofer Eliassaf Re: pyspark cluster mode on standalone deployment Sun, 05 Mar, 18:43
Allan Richards Spark Beginner: Correct approach for use case Sun, 05 Mar, 20:49
kant kodali Re: [ANNOUNCE] Apache Bahir 2.1.0 Released Sun, 05 Mar, 21:15
Subhash Sriram Re: Spark Beginner: Correct approach for use case Mon, 06 Mar, 00:56
ayan guha Re: Spark Beginner: Correct approach for use case Mon, 06 Mar, 02:11
Charles O. Bajomo [Spark Streamiing] Streaming job failing consistently after 1h Mon, 06 Mar, 02:37
nguyen duc Tuan Kafka failover with multiple data centers Mon, 06 Mar, 02:51
Timothy Chan How do I deal with ever growing application log Mon, 06 Mar, 04:18
Raju Bairishetti FPGrowth Model is taking too long to generate frequent item sets Mon, 06 Mar, 04:56
devjyoti patra Re: How do I deal with ever growing application log Mon, 06 Mar, 05:22
Noorul Islam Kamal Malmiyoda Re: How do I deal with ever growing application log Mon, 06 Mar, 06:10
Message list1 · 2 · 3 · 4 · 5 · 6 · 7 · Next »Thread · Author · Date
Box list
May 2019273
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137